ok, disabled memory efficient save now, continuing from last created epoch
ok, disabled memory efficient save now, continuing from last created epoch
Fyes system ram
MIf I may, be careful how many times you save intermediate [models, not modules] and states; I ended up with a full HD very soon. Remember that when Kohya save a training state (those folders whose name ends with 'state'), there's also a partially-trained, but full-size model in it. If it's a Flux-dev finetune, each file is 21 GB IIRCâŠ
TDo you mean that if I need to resume, so I have to uncheck "memory efficient save" and set "Save last N epochs state" to 2 (if I want to keep the last 2 epoch ? (I don't really understand this setting, if I keep 200 epoch, save every 25 epoch and save last 2 epoch, is that mean that every epoch, the state is saved but keeping only 2 last ? or it keep only the epoch number 175 and 200 (state) ?
Also, what is the setting to only keep for example 4 last checkpoints corresponding epoch 125, 150, 175 and 200 ?
Also, what is the setting to only keep for example 4 last checkpoints corresponding epoch 125, 150, 175 and 200 ?
ïżœinstead of setting flux dev as base, you set i.e. mycheckpoint-000075.safetensors. I would now rename the model to mycheckpoint-from75 so you remember where you started, then rename the numbers after by adding 75 
Tin this case, do you need to set also "save state with checkpoint" ?
ïżœeverything else is the same as before
ïżœ@Furkan GözĂŒkara SECourses Is it possible to have 1.jpg 1.txt 2.jpg 2.txt while the rest of the pics are not manually captioned?
ïżœChatGPT says yes
RWhen it comes to training speed/performance, is there a noticiable difference between dreambooth and LoRA? Is the latter significantly faster? Or is the main the difference the size of the output?
Fcan I train a person and and object in the same training without captions?
Fit reads folder name if not finds .txt
Factually if you go with best quality
Ffine tuning faster than best of lora
Fhave them in different folders under the same main folder which you give as path
Fbut how good it will be i cant say for sure
FAnd how I make the trigger words?
Fohwx man
Fbbuk item
Fwhatever the item class
FBut there is two objects
Fthey will bleed
Fsmae class bleeds hard
FWell
Thank you
Iâll try !!
Thanks for your awesome work
Thank you
Iâll try !!
Thanks for your awesome work
Fty
Y@Furkan GözĂŒkara SECourses I saw you mentioned you were doing research on the bleed problem, I was wondering if there was any new information?
YI have a Flux fine-tuned on a person, and I'm trying to pair with a LoRA trained on clothing. The face is getting really messed up unless I turn off the last lora block, and then the clothing lora isn't nearly as good, but the face works.
YI've now cropped out the faces in my clothing LoRA dataset, hoping that'll help
Fthey didnt work
YDo you think only training specific LoRA blocks would help me, just cropping the faces out?
Fi tested it
Fit doesnt help
Fcertain blocks
Feven single layer training still turns entire model into your face :d
ZCould someone tell me if stylistic Loras are applied correctly to your fine-tuned models? Because on my own model, Loras don't work with the same settings that work on the shared flux.dev model. ... If it turns out that Loras don't work with fine-tuned models, that would be a failure...))
ZI understand this is a real problem with fine-tuned models?? Why was this not mentioned anywhere? Creating custom Loras and applying them to my characters was the main plan... Why did no one say a word about this? This is a mega failure...
Z
Y@Zhigarev yeah this has been a real issue for me. The only thing that helps is disabling the last double block of the LoRA but it also really hurts the style
ZUnfortunately, this destroys the entire pipeline I had planned for future potential clients, as I wonât even be able to apply something like a branded armored t-shirt from a specific company to them... let alone a vintage photography style, like in this example...
ZWhat are the options for this mistake@Furkan GözĂŒkara SECourses
Floras overwriting your character
Fbecause they are overfit
Zokey whats the solution ?
ZYou do understand that people mostly use models with Loras, right?
Fthey use to generate random stuff
Fnot certain people
Fthat is the whole world difference
ZWell, to create serious works, the consistency of the character and the uniformity of the style are crucial.
ZLetâs focus on how this issue can be resolved?
