Software Engineering Courses (SECourses)•8mo ago

Doctor, could you please tell me the best settings for LoRA training for SDXL? I saw your previous p

Doctor, could you please tell me the best settings for LoRA training for SDXL? I saw your previous post about fine tuning... Have you already posted about LoRA training?

JJAV_Pomoe Doctor, could you please tell me the best settings for LoRA training for SDXL? I...

Furkan Gözükara SECourses•5/14/25, 2:12 AM

we have dreambooth

Furkan Gözükara SECourses•5/14/25, 2:12 AM

i recommend after that extract lora

FFurkan Gözükara SECourses i recommend after that extract lora

JAV_PomoeOP•5/14/25, 2:32 AM

I see. I'll give it a try. Thank you as always.

Escanor•5/14/25, 11:15 AM

@JAV_Pomoe Personally, on my end and from what I see in all the guides, I get better results by training either with kohya_ss dreambooth or onetrainer and then extracting the lora from the finetuned model with koyha_ss. The resulting extracted lora seems better to me than one training directly trained as such. Plus, you also have the finetuned model you can keep too

It's crucial to use the good settings for extracting the lora and finetuning the model though. For extracting the LORA, the settings can be found in an image at the very bottom of this patreon post

However, do note that in the image, the Clamp Quantile and Minimum difference don't have red rectangels around them, but they do have different values than the default and you have to use those precisely.

Good luck!

Patreon

Full Workflow For Newbie Stable Diffusion Trainers For SD 1.5 Model...

Get more from SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts on Patreon

uisato•5/14/25, 4:25 PM

Kinestasis Stop Motion / Hyperlapse - [new WAN 2.1 LORAs]

https://www.youtube.com/watch?v=3rYPtYxq_3c&ab_channel=uisato

YouTubeuisato

Kinestasis Stop Motion / Hyperlapse - [WAN 2.1 LORAs Project Files]

Technique consisting in a fine-tuned AI model [WAN 2.1 / txt2vid]. Hundreds of hours of training and testing. Still far from good, but hopefully getting somewhere. I'm a huge fan of this technique.

Music by @klsr-av

You can access these new WAN 2.1 LORAs, through my Patreon profile.

#stopmotion #machinelearning #design #aiart

petecemetery•5/14/25, 10:42 PM

looking for some advice on this regularization workflow for training this flux concept. my concept im training is faces pressed against glass. So i have 75 images of faces like the above. Then I have captioned each one without any mention of pressing against glass, and have generated regularization images with those captions so that each training image has a corresponding regularization image to help isolate the concept. With this workflow, do i want to keep repeats on both training and reg images at 1?

petecemetery•5/14/25, 10:45 PM

also as long as my txt files are in the same folder as my training images , they should be used to train right?

petecemetery•5/14/25, 10:50 PM

im using the lora config for this 1voteup

Ppetecemetery looking for some advice on this regularization workflow for training this flux c...

Furkan Gözükara SECourses•5/14/25, 10:54 PM

you dont need reg images

Furkan Gözükara SECourses•5/14/25, 10:54 PM

make sure every person in dataset is different

Furkan Gözükara SECourses•5/14/25, 10:54 PM

it should work perfect

petecemetery•5/14/25, 10:54 PM

ok great, thanks

Ppetecemetery ok great, thanks

Furkan Gözükara SECourses•5/14/25, 11:04 PM

you are welcome

EEscanor <@1320367778317865031> Personally, on my end and from what I see in all the guid...

JAV_PomoeOP•5/15/25, 7:32 AM

Thank you so much for the great information!

Stav•5/15/25, 11:13 PM

Hi, how many epochs are recommended for a 15 pictures training with dreamboth?

SStav Hi, how many epochs are recommended for a 15 pictures training with dreamboth?

Furkan Gözükara SECourses•5/15/25, 11:33 PM

at least 200

Furkan Gözükara SECourses•5/15/25, 11:33 PM

but you can go up to 300 and compare

FFurkan Gözükara SECourses at least 200

Stav•5/16/25, 11:42 AM

Thank you doctor

Escanor•5/16/25, 1:48 PM

Honestly I'm always wondering how to know the number of epochs and such. Should we just aim for a certain # of total steps and play with the # of epochs and repeats?

For example, with 15 images 200-300 epochs but how many images repeats? Or is it better 1 epoch and tons of repeats?

Escanor•5/16/25, 1:50 PM

I also wonder if with like 15 portrait images we should be using captions or not

Escanor•5/16/25, 1:58 PM

Also wondering because the sdxl kohya 48gb config uses 1 epoch

skyrrr•5/16/25, 4:45 PM

Hey, for flux full finetuning is there a solution faster than L40S for the 48gb config file ? Thanks

EEscanor Honestly I'm always wondering how to know the number of epochs and such. Should ...

Furkan Gözükara SECourses•5/16/25, 5:30 PM

repeat is always 1 for flux

Furkan Gözükara SECourses•5/16/25, 5:30 PM

we had to use repeat for sdxl to use more reg images due to how kohya bad coded reg images logic

EEscanor Also wondering because the sdxl kohya 48gb config uses 1 epoch 🤔

Furkan Gözükara SECourses•5/16/25, 5:31 PM

because with sdxl we want to use more reg images

Furkan Gözükara SECourses•5/16/25, 5:31 PM

and only way is more repeat with kohya

Sskyrrr Hey, for flux full finetuning is there a solution faster than L40S for the 48gb ...

Furkan Gözükara SECourses•5/16/25, 5:32 PM

what do you mean?_

Escanor•5/16/25, 5:42 PM

Ahh I see. Then for sdxl is it better to use onetrainer instead in your opinion? Considering I have only 8 portrait images and the 5000 reg images of your patreon. Also unsure if I should use captions or not

Thank you

FFurkan Gözükara SECourses what do you mean?_

skyrrr•5/16/25, 6:40 PM

I mean would an H100 run the training significantly faster than the L40S ? I'm currently at 4.8sec/iteration

EEscanor Ahh I see. Then for sdxl is it better to use onetrainer instead in your opinion?...

Furkan Gözükara SECourses•5/16/25, 9:12 PM

yes onetrainer also has EMA

Furkan Gözükara SECourses•5/16/25, 9:12 PM

which works good for SDXL

Sskyrrr I mean would an H100 run the training significantly faster than the L40S ? I'm c...

Furkan Gözükara SECourses•5/16/25, 9:12 PM

yes it is faster

Furkan Gözükara SECourses•5/16/25, 9:12 PM

are you batch size 7?

Furkan Gözükara SECourses•5/16/25, 9:13 PM

4.8 sec is low for H100

Escanor•5/16/25, 9:23 PM

Ok for onetrainer, will try.

Is FLUX really that much better than SDXL though even for just 8 training images? Wondering because it's so slow to run on my m2 macbook pro..

EEscanor Ok for onetrainer, will try. Is FLUX really that much better than SDXL though ...

Furkan Gözükara SECourses•5/16/25, 9:24 PM

very very better

Furkan Gözükara SECourses•5/16/25, 9:25 PM

so much difference

Escanor•5/16/25, 9:27 PM

Urgh ok. Because on mac I need to use a weird flux model or else tons of errors. Model is flux1-dev-Q8_0.gguf

EEscanor Urgh ok. Because on mac I need to use a weird flux model or else tons of errors....

Furkan Gözükara SECourses•5/16/25, 9:40 PM

i would use mac if only i was developing an app for iphone :d

Escanor•5/16/25, 9:41 PM

Meh, for developing from backend to frontend it's great, ai stuff it's shit lol

Escanor•5/16/25, 9:41 PM

Compatibility is atrocious

Escanor•5/16/25, 9:42 PM

Especially with arm/sillicon chips

EEscanor Especially with arm/sillicon chips

Furkan Gözükara SECourses•5/16/25, 9:54 PM

yep that is why

Escanor•5/17/25, 12:04 AM

What is the best workflow for preparing images?

Let's say I have portrait images that are mediocre quality and not 1024x1024. Which of the following is the best workflow:

Workflow A: joycaption,supir 5x upscale with caption,outpaint image sides,downscale to 1024x1024
Workflow B: joycaption,supir 5x upscale with caption,downscale to 1024x1024 with transparent sides
Workflow C: joycaption,supir 5x upscale with caption,downscale to 1024x1024 with black or white sides

Escanor•5/17/25, 12:04 AM

Also, I'm unsure which caption type + length I should use with joycaption

Escanor•5/17/25, 12:06 AM

And for having square images, for my current dataset, I had used Fooocus to outpaint the sides since the original images were portrait, but would it be acceptable or good to just resize to 1024x1024 and have the sides be black,white or transparent..? Or will that confuse the training?

Escanor•5/17/25, 12:06 AM

Sorry for many questions, thank you very much for the help!

FFurkan Gözükara SECourses are you batch size 7?

skyrrr•5/17/25, 8:25 AM

No I mean I'm currently using the 48go config with an L40S and getting around4.8 sec. I have a deadline and would need the training to be twice faster, so I wondered if that was achievable with an H100 SXM. Sorry if I explained myself wrong

EEscanor What is the best workflow for preparing images? Let's say I have portrait image...

Furkan Gözükara SECourses•5/17/25, 10:59 AM

for flux i dont use captions i dont recommend

Sskyrrr No I mean I'm currently using the 48go config with an L40S and getting around4.8...

Furkan Gözükara SECourses•5/17/25, 11:00 AM

ah yes go with h100 it will be faster directly

Doctor, could you please tell me the best settings for LoRA training for SDXL? I saw your previous p

Similar Threads

Similar Threads

Similar Threads