for style i suggest more
for style i suggest more
�I have seen people train on style using 7 images
DI'm really happy with how good Flux can be trained, the rank 3 is perfect for the 4090, thanks Doctor 
funny how despite all its capabilities, Flux if it EVER needs to show a nipple, even accidentally its so LOST that it just puts flesh colored gummy candies in their place
funny how despite all its capabilities, Flux if it EVER needs to show a nipple, even accidentally its so LOST that it just puts flesh colored gummy candies in their place
JDr. Furkan, could you make a video how to train multiple people, objects or styles in one training? Is it possible to train a person, a style and an object in the same time?
Fmultiple people really hard they bleed
Fyou need to have them in same picture
Fi plan that
Dwe can get good people loras in around 2k steps, but what about concepts? does that require more learning? like unique physical characteristics and such
Fit is hard to tell that is why you should save checkpoints and compare
Fmy 256 images was best at 80 epoch
JMaybe I overlooked the video, do you also have a good tutorial on training with Dreambooth? When using 20 images, can I use 200 epoch like the Lora training? Is there a general rule of thumb regarding amount of pictures vs epochs?
Fyes all same
Fjust use my configs
JBased on your experience what is the recommended amount of pictures and epochs for getting the best results without overfitting? Lora/Dreambooth?
JIn my last Lora training I used 20 pictures, 200 epochs and Rank_3_18950MB_9_05_Second_IT, it took almost 5 hours to complete. when I use 40, 60, 80 or 100 pictures, how many epochs would your recommend, is there a rule of thumb?
Fsadly no rule of thumb
Fbut for 15 images i get 150 epoch best
Ffor 256 i got best at 80 epoch - it was on 8 gpu batch size 8
Ffor 256 images 40 epoch was undertrained with batch size 1
JThanks for your fast answer, so it's more trial and error then
JI am now training an interior style 14 pictures with 200 epochs...I am curious what the quality will be
DI get error when using ultimate imageprocessor: too many open files. Why?
Dnow it says "cannot load backend tkagg which requires tk interactive framework. headless is currently running"
What deos this mean?
What deos this mean?
Dnevermind. fixed above issues. nnot sure how i fixed the second one but after restart it worked. and changing file description limit via terminal.
Finteresting
E@Furkan Gözükara SECourses Hello! I'm using RTX4090 (24Gb)
For full FLUX finetuning I used your config "Rank_1_15500MB_39_Second_IT.json" and It took me 16.5 hours to train 15 images dataset.
Then I tried the config "Quality_1_23100MB_14_12_Second_IT.json" and It took me 23.5 hours to train the same dataset
Why the training goes slower on the second config although it is more vram consuming?
For full FLUX finetuning I used your config "Rank_1_15500MB_39_Second_IT.json" and It took me 16.5 hours to train 15 images dataset.
Then I tried the config "Quality_1_23100MB_14_12_Second_IT.json" and It took me 23.5 hours to train the same dataset
Why the training goes slower on the second config although it is more vram consuming?
Fit means that your initial vram usage was a lot
Fthus you should do this
Fmonitor your shared vram usage
Funtil it doesnt get increase
Fincrease number of block swaps
F1 block swap will reduce vram usage 640 mb for double blocks but reduce speed too
Fso very likely that before starting training you were using at least 800 900 mb vram
FPatreon
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
WHi @Furkan Gözükara SECourses is there a way to save the training process into local computer then resume later on mass compute or runpod or something else. Due to training times is very long in case of server restart or crash, are there anyway to save the on going process then resume later ?
Ffor fine tuning yes
Fuse your latest checkpoint
A'block swaps' - I presume that's somewhere in the kohya_ss gui, specifically "double_blocks_to_swap = 5 (in the .toml file)?
AI kept my VRAM right on 23.9 GB using the "Quality_1_23100MB_14_12_Second_IT.json" config (on a 24 GB card). I had to try a few tricks to reduce VRAM usage, such as switching off hardware accelerated GPU scheduling, and selecting 'Adjust for best performance' under Visual Effects in the Control Panel for Advanced System Settings. This helped a little though I still had 400 MB shared on RAM.
Fyou can also compare swap 6 7 speed difference
Fand use fastest one
Fall quality same
AI had tried 4e-06 learning rate, on 26 input images, but all of my epoch results looked similar (I was saving checkpoints every tenth epoch), so I tried again on 5e-06 LR and saw some improvement, though very gradual. I also noticed, right from my earliest checkpoint save, that sample photographic images of a 'woman' looked identical to those for 'ohxw woman', whereas for SDXL dreambooth the two images converged once the model was being over-trained in the new subject.
Fit is true that 05 06 or 03 may work better depending on dataset
Freally hard to set one LR for all
Fi tried to set an LR that will not very undertrain or overtrain
Fbut with my LR as you do more training, you should eventually get your perfect checkpoint
AYes, I eventually got a good result.
WCan you describe more out which step to do it. Where I can load the latest checkpoint and how to calculate the remain step for the latest checkpoint to continue
DI've seen Flux not really converge on realism when the LR is too low, no matter how long you run it. It changes facial features but remains in its plastic AI style with a low LR