Software Engineering Courses (SECourses)•11mo ago

https://youtu.be/EEV8RPohsbw

YouTubeSECourses

How To Do Stable Diffusion XL (SDXL) DreamBooth Training (Full Fine...

Patreon post for config files

https://www.patreon.com/posts/89213064

SECourses Discord To Get Full Support

https://discord.com/servers/software-engineering-courses-secourses-772774097734074388

My LinkedIn

https://www.linkedin.com/in/furkangozukara/

My Instagram

https://www.instagram.com/gozukarafurkan/

My Medium

@FurkanGozuka...

FFurkan Gözükara SECourses https://youtu.be/EEV8RPohsbw

Unc0nn3cteD•2/15/25, 9:38 PM

Perfect, thank you so much!

MetaKan•2/17/25, 5:56 PM

what is the estimated time for a training of a dreambooth with aprox 200 images, 1 batch, 200 epoch and a gtx 4090 with a 64gb ram?

MMetaKan what is the estimated time for a training of a dreambooth with aprox 200 images,...

Furkan Gözükara SECoursesOP•2/17/25, 9:25 PM

i dont know exact timing but lets assume 5.5 second

Furkan Gözükara SECoursesOP•2/17/25, 9:25 PM

5.5 * 200 * 200 seconds

Furkan Gözükara SECoursesOP•2/17/25, 9:25 PM

if faster it will be lower

MetaKan•2/17/25, 9:27 PM

Ok thank you !!

MMetaKan Ok thank you !!

Furkan Gözükara SECoursesOP•2/17/25, 10:12 PM

200 epoch probably not needed for that many images

FFurkan Gözükara SECourses 200 epoch probably not needed for that many images

MetaKan•2/18/25, 8:06 AM

In the end, it turned out to be 180 images. I'm using 100 epochs, and right now it's at 50% of the training process at a speed of 6.6s per step. We'll see how the final result turns out

MetaKan•2/18/25, 8:08 AM

What would be the best way to train a model for interior design? Let me explain.
I need to apply a specific product to a given room. For example, I want a Renaissance-style room with this product on the wall and this product on the floor.
I understand that in this case, it makes sense to train a highly structured model with all the individual products and, at the same time, the same products applied to different rooms. I assume that captions are important in this scenario.
What would be your approach to training a model for this application?

MMetaKan What would be the best way to train a model for interior design? Let me explain....

Furkan Gözükara SECoursesOP•2/18/25, 12:59 PM

full research so best to keep experimenting

Absentis•2/19/25, 11:27 PM

Hey @Furkan Gözükara SECourses, I'm enjoying the 5090 videos you've done and had a question. Wondering if you're planning on doing a video comparing 3090 vs 5090 for fine tuning or lora training? Sorry if asked elsewhere discord didn't show if it had or hadn't.

AAbsentis Hey <@205854764540362752>, I'm enjoying the 5090 videos you've done and had a qu...

Furkan Gözükara SECoursesOP•2/20/25, 12:17 AM

yep i will show

Furkan Gözükara SECoursesOP•2/20/25, 12:17 AM

i made a quick test also

Furkan Gözükara SECoursesOP•2/20/25, 12:17 AM

i am waiting official pytorh

Furkan Gözükara SECoursesOP•2/20/25, 12:18 AM

https://www.reddit.com/r/SECourses/comments/1iq42h4/flux_dev_dreambooth_finetuning_speed_test_for_rtx/

From the SECourses community on Reddit: FLUX Dev DreamBooth / FineT...

Explore this post and more from the SECourses community

Elli_Oaken•2/20/25, 8:24 AM

Hi! Don't know which channel to write this on. I'm training a lora and I'm wondering if I can stop the training and start a training on the latest save like you can when training checkpoint?

EElli_Oaken Hi! Don't know which channel to write this on. I'm training a lora and I'm wonde...

Elli_Oaken•2/20/25, 8:34 AM

Save training state (including optimizer states etc.) when saving models
Save training state (not enabled)

Save training state (including optimizer states etc.) on train end
Save training state at end of training (not enabled)

Resume from saved training state (path to "last-state" state folder)
Saved state to resume training from

MetaKan•2/20/25, 9:09 AM

I have finetuned flux-dev with 180 images of a character and 180 photos from various angles. Maybe it's not the best dataset because it didn’t have varied backgrounds. Almost all the images were just of the face without the body.
I'm having quite a few issues with prompts where I request a stylization. I trained a batch with 100 epochs and have 4 safetensors—I’ve tested them all, and I’m experiencing the same issues across the board.
When I ask for a stylized result, like a cartoon or anime style, it struggles to adhere to the prompt and often generates random things instead.
What could be happening? Thanks a lot!

MMetaKan I have finetuned flux-dev with 180 images of a character and 180 photos from var...

Timson•2/20/25, 9:28 AM

this is normal, nothing is wrong. You trained the model on realism data and it is inclined to generate it.

Timson•2/20/25, 9:29 AM

18000 steps is a lot, you may want to try earlier checkpoints

Timson•2/20/25, 9:31 AM

you may also try different prompt engineering, generate a lot of images and cherrypick from them secondary dataset to include in traning of second gen model with more stilyzed images in training data

TTimson 18000 steps is a lot, you may want to try earlier checkpoints

MetaKan•2/20/25, 10:36 AM

yes I did it

MetaKan•2/20/25, 10:36 AM

I did imagine that. But I watched @Furkan Gözükara SECourses tutorial and saw that he had some incredibly stylized images... I think he also only trained with realistic images. That's where my doubt comes from

EElli_Oaken Hi! Don't know which channel to write this on. I'm training a lora and I'm wonde...

Furkan Gözükara SECoursesOP•2/20/25, 10:48 AM

yes buyt i never tried

Furkan Gözükara SECoursesOP•2/20/25, 10:48 AM

its option is here

Furkan Gözükara SECoursesOP•2/20/25, 10:49 AM

MMetaKan I have finetuned flux-dev with 180 images of a character and 180 photos from var...

Furkan Gözükara SECoursesOP•2/20/25, 10:49 AM

yes flux is very realistic

Furkan Gözükara SECoursesOP•2/20/25, 10:49 AM

therefore i recommend 2 step training for stylized images

Furkan Gözükara SECoursesOP•2/20/25, 10:49 AM

first train, generate some good stylized images, and retrain on them

MMetaKan I did imagine that. But I watched <@205854764540362752> tutorial and saw that h...

Furkan Gözükara SECoursesOP•2/20/25, 10:50 AM

i had 256 images and dataset was variety . also still i had hard time and needed to find prompts

MetaKan•2/20/25, 10:52 AM

thank you sir!

Furkan Gözükara SECoursesOP•2/20/25, 10:56 AM

The grid test I am analyzing to find newer FLUX DEV training. This is not even including the first 10 different trainings i made

1176 images. I think we gonna have a better workflow than what we have with using more VRAM and more training time.

Renzo•2/21/25, 1:46 PM

In case someone is interested in creating LoRAs from Lumina2: https://huggingface.co/sayakpaul/trained-lumina2-lora-yarn, https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_lumina2.md (the code).

GitHub

diffusers/examples/dreambooth/README_lumina2.md at main · huggingfa...

Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX. - huggingface/diffusers

FFurkan Gözükara SECourses The grid test I am analyzing to find newer FLUX DEV training. This is not even i...

Mathew•2/21/25, 6:49 PM

Its Lora train or checkpoint ?

MMathew Its Lora train or checkpoint ?

Furkan Gözükara SECoursesOP•2/21/25, 11:46 PM

fine tuning atm

Furkan Gözükara SECoursesOP•2/21/25, 11:46 PM

after that i plan lora

ghstoic•2/22/25, 10:42 AM

For multi-GPU training, does the set-up need 80gb vram TOTAL, or does EACH gpu need 80gb vram?

Gghstoic For multi-GPU training, does the set-up need 80gb vram TOTAL, or does EACH gpu n...

Furkan Gözükara SECoursesOP•2/22/25, 11:23 AM

for fine tuning

Furkan Gözükara SECoursesOP•2/22/25, 11:23 AM

each gpu 80 gb

Furkan Gözükara SECoursesOP•2/22/25, 11:23 AM

for lora not necessary 48 gb gpus works great

FFurkan Gözükara SECourses each gpu 80 gb

ghstoic•2/22/25, 12:25 PM

Gottcha, thank you!

ghstoic•2/22/25, 12:27 PM

Out of interest, what causes the VRAM per GPU requirements to jump up so much? Just curious on what's going on in the background processes that requires VRAM requirement to go from 24gb VRAM per GPU from single training to 80gb VRAM per GPU for muli-traning

Gghstoic Out of interest, what causes the VRAM per GPU requirements to jump up so much? J...

Furkan Gözükara SECoursesOP•2/22/25, 12:45 PM

extremely good question

Furkan Gözükara SECoursesOP•2/22/25, 12:45 PM

i asked this to kohya

Furkan Gözükara SECoursesOP•2/22/25, 12:46 PM

he was also not sure

Timson•2/22/25, 11:51 PM

How does multy GPU trainign work anyways?
Each GPU has a copy of a trained model and perform traning steps independantly, so how in the end we are not gettign two separate models?

Timson•2/22/25, 11:52 PM

they cannot possibly synchronize model state after each step, that woudl take ages (minutes)

Timson•2/22/25, 11:55 PM

And if the models are just merged as last step - would that mean the final model can have questionable quality (missed local minimas and such)?

TTimson How does multy GPU trainign work anyways? Each GPU has a copy of a trained model...

Furkan Gözükara SECoursesOP•2/23/25, 10:01 AM

with diffuser models

Furkan Gözükara SECoursesOP•2/23/25, 10:01 AM

each models loaded fully into vram

https://youtu.be/EEV8RPohsbw

Similar Threads