How should you determine which base model to train your dream booth/lora on? Is there a good compari
How should you determine which base model to train your dream booth/lora on? Is there a good comparison sheet somewhere
TThe best model to start is always the 'base' model , not any 'trained' model
Fyes will cover both hopefully
Fflux base
Fbest
CIf it's objectively best why are so many people still training on other models nowadays?
Ftesting :d
Fi tested these for example : https://medium.com/@furkangozukara/thoroughly-experimented-with-fine-tuning-dreambooth-training-of-flux-dev-de-distill-pixelwave-13fab8c625bf
Medium
Thoroughly experimented with Fine-Tuning / DreamBooth training of Flux-dev-de-distill, PixelWave v03, Verus Vision and base FLUX Dev model…
Coh cool, thanks!!
NI did one training on Flux DeDistilled, because negative prompts were important to me, and I am very satisfied with result. I didn't see any objective benefits from base model over the de-distilled one - and negative prompt is a huge benefit on the other hand.
that said, I guess it all depends on your personal goal and needs.
that said, I guess it all depends on your personal goal and needs.
AYes a little, but in the end it will not work
AI have tried extensively. Same for piercings
AI had some small luck with a piercing https://civitai.com/user/Aikage you can see my Sanne character has black ear clips but they're not always consistent.
AYou are correct the best way I have found is to take a lot of pictures of JUST the tattoo and tag it something, then take pictures of the character with the tattoo and without and when the tattoo is present tag it with the tattoo tag which will link it to the close up pictures. Still it mostly just gets the rough shape correct
HBased off the example 256 img training log for the 48GB-batch size 1 config, should I expect to train until ~50K steps before seeing decent results?
F50k probably overkill
Fi had best checkpoint at 70 epoch
F17920 steps
H
what epoch was your best checkpoint for the batch 7 config? I have 252 imgs so I’ve been training until 111 epochs to reach 4K steps but never went higher than that.Fi dont remember but probably similar
Fyou know epoch doesnt change but step count changes
Fwith batch size
HSo the higher the batch size, the lower amount of steps you’ll need to achieve a quality result?
HLike if I rented an H200 and set the batch count to 14, I would likely need fewer than 4K steps to get the same quality as batch size 7?
Fbatch size meaning is at 1 step it process more images
Fso we are still processing like equal number of samples (the model trained number of images)
Fbut the model weights are updated lesser
Fsince batch size changes averaged
HGotcha, thank you for clarifying!
Yhey just joined to try get better settings for kohya finetune of flux and see discord pop up so thought I'd ask here. 48gb RTX 6000 Ada should be enough to finetune right? going mad here keeps getting CUDA out of memory even with 512x512, batch 1, fp16, adam8, gradient_checkpointing and everything i can find to reduce memory, and feel i must be doing something wrong 
its really odd
its really oddYnm i used one of the scripts from the patreon for 48gb and it works - god only knows which setting it is 
Thanks! much worth the patreon sub!
Thanks! much worth the patreon sub!
R@Furkan Gözükara SECourses The onetrainer sdxl config files load into fine tune, not lora. is this the intent?
Fyep i dont have lora config sadly
PHi, I've been trying to merge 2 Flux LoRas via Kohya SS together and I keep failing.
Say, if normally I set these 2 Loras to the strenght of 1 and 0.6, what ratios should I put in there? And then, sometimes it merges a lora to the size of 24Gb or 40Gb+ if I switch the save precision so I'm not really sure what settings in general there would be the best
Say, if normally I set these 2 Loras to the strenght of 1 and 0.6, what ratios should I put in there? And then, sometimes it merges a lora to the size of 24Gb or 40Gb+ if I switch the save precision so I'm not really sure what settings in general there would be the best
CIs ohwx an especially good instance prompt or would using any another string of rare special characters would be just as good?
Fohwx good
Frare token
RJust got around to dreambooth videos and I gotta say this is amazing we can do this. You are a god send my friend...Keep up the great work!
AIs it a bad idea to use regularisation dataset with a cartoon dataset for fine tuning?
Fit depends. for flux we dont use. for sdxl if your reg images are also cartoon good
LI admire your work. As a Patreon member and Massed Compute user ($100+ spent), I'm experiencing an issue with my Dreambooth training.
My training with 277 properly prepared images, using background filling, is progressing using the "Fine Tuning / DreamBooth: 256 Training Images & Batch Size is 1 : Best Epoch is 70" setting. This should finish within the hour on Massed Compute, totaling 277 x 70 steps. I have checkpoint intervals every 10 epochs and have six models so far.
The first checkpoint showed excellent results, but subsequent epochs have produced increasingly blurry images.
Would it be possible to discuss this with you, perhaps via Skype? I would appreciate any guidance you can offer, either freely or through a specialized support option.
My training with 277 properly prepared images, using background filling, is progressing using the "Fine Tuning / DreamBooth: 256 Training Images & Batch Size is 1 : Best Epoch is 70" setting. This should finish within the hour on Massed Compute, totaling 277 x 70 steps. I have checkpoint intervals every 10 epochs and have six models so far.
The first checkpoint showed excellent results, but subsequent epochs have produced increasingly blurry images.
Would it be possible to discuss this with you, perhaps via Skype? I would appreciate any guidance you can offer, either freely or through a specialized support option.
Fthank you so much and welcome. replied you from email
�can you explain this, why are the eyes so bad? did sdxl lora training, 30 train pics, all great quality, many close ups on face, 150 epochs, repeat 1, 1024 resolution, biglovexl2 as base model.
�training on civitai
�training-data, i see network rank 32. don't know if its possible to change that on training
train-data.txt1.41KB
Fare you using our config_?
Fwhich config name?
Falso some people reporting bad results
Fi am gonna train now to see