32 linear under lora?
32 linear under lora?
Fyep
AWhat are you reccomending 64?
F128
A
AI'm training without regularization too, seems like theyre working ok so far... not sure how to add regularization in ai toolkit yet
Freg images doesnt help i tested
Fhuge updates
FPatreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
AMy man! ty sir
F
G@Dr. Furkan Gözükara question bro, making a lora for a person is one thing. what do you recommend for settings and image amounts if i want to make a style lora? For instance, there is an NFT I want to make a style lora of. How many images should I do? 100? 500? How many steps? To do a Lora with 32 images alone at 1024x1024 took 14 hrs and 10 mins on FLUX. I did a lora once on sdxl with 3000 images and that only took like 9hrs. 512x512 of course. So I just want to know why it takes so much longer on FLUX and the amount of images I should use?
Ftry to get at least 200 images good captions
Fand how many epochs is another question
Fsadly i dont know yet for flux
Fbut go with 50 and see if trained good
Fcompare checkpoints
GI remember doing it on SDXL for 3000 images but dont remember steps none of that
Fmore images better for style
Gstill dont have my 48GB A6000 running yet, just using my 3090ti for now
Fye it will take time on that gpu especially if you are not using linux
Gif it took 14hrs on my 3090ti on windows, how much faster would the A6000 do it?
Fsame speed 
Fyou need 4090 for speed up
For L40S
Gwtf
Funless you make multiple batch size
Fwith fp8 on A6000
Fwhich i plan to do
Gmultiple?
Fwhen training 20800 images
Fye batch size like 2 3 i havet tested yet
Gwhy is 4090 faster than a 48GB card?
Fit has more cuda and power
G:1222pepeblunt:
Gso the only good thing is the VRAM i have
Fyep
Gtell me the setting for batch, I will test it myself,
Gcan do 3? 4 batches?
GI will get that system up tonight or tomorrow
Fcaptioning 10400 images started
Gthen I can tell you
Fi will test later
GYeah but the setting, ill test it, where is it
Gi can try it once i reinstall windows
Fwhich settings?
Fbatch size is on gradio
Fi got to sleep
Gill check it and increase it to 4
Gand see if it works
ADoes anyone know if ai toolkit you need to be connected to the internet for it to work?