Software Engineering Courses (SECourses)•15mo ago

there are lots of text to video AIs out there - and meta just annouced this https://ai.meta.com/rese

there are lots of text to video AIs out there - and meta just annouced this https://ai.meta.com/research/movie-gen/

AI at Meta

Meta Movie Gen - the most advanced media foundation AI models

Meta Movie Gen is our latest research breakthrough that allows you to use simple text inputs to create videos and sounds, edit existing videos or transform your personal image into a unique video.

Xxlads It would be so cool if we could generate videos with our models using text to vi...

Furkan Gözükara SECourses•10/4/24, 11:18 PM

nothing good

Ccrystalwizard there are lots of text to video AIs out there - and meta just annouced this http...

Furkan Gözükara SECourses•10/4/24, 11:18 PM

i am about to publish a video for it

Ccrystalwizard there are lots of text to video AIs out there - and meta just annouced this http...

xlads•10/4/24, 11:21 PM

Yes, I heard about this, but we’re unable to use our own trained models

FFurkan Gözükara SECourses i am about to publish a video for it

crystalwizardOP•10/4/24, 11:21 PM

you might want to wait till it's more than a research paper

Xxlads Yes, I heard about this, but we’re unable to use our own trained models

crystalwizardOP•10/4/24, 11:22 PM

yes, well - you could use them with animate diff or live portrait

Ccrystalwizard yes, well - you could use them with animate diff or live portrait

xlads•10/4/24, 11:24 PM

Hmmmm need to look into animate diff

Xxlads Hmmmm need to look into animate diff

crystalwizardOP•10/4/24, 11:25 PM

https://animatediff.github.io/

Ccrystalwizard https://animatediff.github.io/

xlads•10/4/24, 11:26 PM

Sent you a friend request

Ccrystalwizard https://animatediff.github.io/

xlads•10/4/24, 11:26 PM

Thanks will check it in a few minutes

Xxlads Yes, I heard about this, but we’re unable to use our own trained models

Furkan Gözükara SECourses•10/4/24, 11:54 PM

yes nothing published yet

Furkan Gözükara SECourses•10/4/24, 11:54 PM

https://www.youtube.com/watch?v=hnkuuqJVGK0

YouTubeSECourses

Meta Movie Gen: The Future of Filmmaking is Here

Movie Gen sets a new standard for immersive AI content. Meta announced the Meta Movie Gen just today which is going to change the Cinema, Video and Animation industries forever. This will shock the industry workers.

Paper : https://ai.meta.com/static-resource/movie-gen-research-paper

How Meta Movie Gen could usher in a new AI-enabled era for c...

CNOC•10/5/24, 1:42 AM

@Dr. Furkan Gözükara Have you had any success with the batch 7 training? If the config is ready but no video yet would it be possible to receive the config file to try?

CCNOC @Dr. Furkan Gözükara Have you had any success with the batch 7 training? If the ...

Furkan Gözükara SECourses•10/5/24, 2:12 AM

yes it is working great

Furkan Gözükara SECourses•10/5/24, 2:12 AM

but i still didnt finalize

Furkan Gözükara SECourses•10/5/24, 2:12 AM

let me put into zip file

CCNOC @Dr. Furkan Gözükara Have you had any success with the batch 7 training? If the ...

Furkan Gözükara SECourses•10/5/24, 2:16 AM

https://www.patreon.com/posts/112099700

Patreon

Kohya FLUX Fine Tuning (Full Checkpoints) Training Full Tutorial Fo...

Get more from SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts on Patreon

OinkSauce•10/5/24, 2:45 AM

Just a quick question on Supir upscaling: are there a collection of presets that match up with some of the tests run? I'm not seeing exactly how to configure this to match up with the grid tests run on the SECourses channel. Is there a go-to configuration that I can start with and experiment from there?

I'm likely most interested in upscaling images generated in Flux and likely 2x to 4x in resolution

OOinkSauce Just a quick question on Supir upscaling: are there a collection of presets that...

Furkan Gözükara SECourses•10/5/24, 2:46 AM

i have a default config

Furkan Gözükara SECourses•10/5/24, 2:46 AM

that upscales with loyal to original image

Furkan Gözükara SECourses•10/5/24, 2:47 AM

and also we have Replicate.json

Furkan Gözükara SECourses•10/5/24, 2:47 AM

which is same as on replicate

OinkSauce•10/5/24, 2:48 AM

Ah - is that in the lower right in this image?

OinkSauce•10/5/24, 2:48 AM

are default and replicate different?

OOinkSauce Ah - is that in the lower right in this image?

Furkan Gözükara SECourses•10/5/24, 2:48 AM

yep

Furkan Gözükara SECourses•10/5/24, 2:48 AM

presets

Furkan Gözükara SECourses•10/5/24, 2:48 AM

replicate is same config on replicate

Furkan Gözükara SECourses•10/5/24, 2:48 AM

or almost same

OinkSauce•10/5/24, 2:48 AM

What does replicate do?

OinkSauce•10/5/24, 2:49 AM

and this is using juggernaut-xl?

OinkSauce•10/5/24, 2:49 AM

for default?

OinkSauce•10/5/24, 2:50 AM

ok, i see. I need to use default and then actually load it.

OinkSauce•10/5/24, 2:51 AM

I incorrectly assumed default was the application default and it was already loaded.

OinkSauce•10/5/24, 2:51 AM

ty!@

Furkan Gözükara SECourses•10/5/24, 2:57 AM

compare both

Furkan Gözükara SECourses•10/5/24, 2:57 AM

with different base models

Furkan Gözükara SECourses•10/5/24, 2:57 AM

see which you like most

OinkSauce•10/5/24, 2:59 AM

ty - i was just having some trouble getting started. much appreciated!

Ereshkigal•10/5/24, 4:06 AM

lul so I was quite sure my RAM capacity being inadequate was the reason for my system basically being unusable for over a minute while Flux was loading stuff each time I changed LORAs etc... I had 32GB before... got the new kit in tonight, and this is what using Flux looks like so far:

Ereshkigal•10/5/24, 4:06 AM

Ereshkigal•10/5/24, 4:07 AM

Glad I got 96GB & not 64GB, I would've had the same issue & that woulda pissed me off

EEreshkigal lul so I was quite sure my RAM capacity being inadequate was the reason for my s...

crystalwizardOP•10/5/24, 4:11 AM

you need vram, not ram

crystalwizardOP•10/5/24, 4:12 AM

you want everythign loaded into vram and on your gpu. not into ram or on your cpu

Ccrystalwizard you need vram, not ram

Ereshkigal•10/5/24, 4:18 AM

I have an RTX 4090, the loading process before it's transferred to the GPU was where I was having hard lags, because I only had 32GB of system RAM and it was using ALL of it lol

EEreshkigal I have an RTX 4090, the loading process before it's transferred to the GPU was w...

crystalwizardOP•10/5/24, 4:19 AM

i have a 4090 as well and don't have that sort of lag. what CPU do you have?

Ereshkigal•10/5/24, 4:20 AM

How much system RAM do you have? And my CPU is my next upgrade, right now I'm running a 7800X3D, the system was originally upgraded/built for gaming.

EEreshkigal How much system RAM do you have? And my CPU is my next upgrade, right now I'm r...

crystalwizardOP•10/5/24, 4:20 AM

crystalwizardOP•10/5/24, 4:21 AM

and you have an AMD - that's a problem. i have an intel. there are things you have to do for an AMD that you don't have to do for an intel. have you gone through CS1o's AMD guides?

Ereshkigal•10/5/24, 4:23 AM

Nope, and it's not having an issues now, it capping out system RAM with 32GB was the main issue I was having and that causing the system to basically be unusable for 2 minutes each time I changed the prompts or settings significantly. Are you running the full FP16 Flux Dev version?

crystalwizardOP•10/5/24, 4:23 AM

yup. all the original models from BFL. i don't use the quantized stuff

crystalwizardOP•10/5/24, 4:23 AM

or gguf

there are lots of text to video AIs out there - and meta just annouced this https://ai.meta.com/rese

Similar Threads