how much time did it take?
how much time did it take?
Fit is around 30 second per it when batch size is 7
Fso 100 steps would be 3000 seconds
JOkay, please forget about the NSFW. It is not important.
Do you think it is worth to try a community Flux Checkpoint for training a Dreambooth Model? If yes, which would you recommend ? Or would you always recommend to use the base version? Best regards and thanks a lot
Do you think it is worth to try a community Flux Checkpoint for training a Dreambooth Model? If yes, which would you recommend ? Or would you always recommend to use the base version? Best regards and thanks a lot
D@Furkan Gözükara SECourses Flux anti-bleeding protection. look at right-most column. No more Furkan Obama 
Lthe issue was I put a "space" in the name of the output model, it wasn't a good idea
LI don't get it, could you tell more please? and a picture of the original woman would be great
Dleft is without lora, just Flux. the middle is regular lora training with the bleeding effect. you can see that not only the prompt "ohwx woman" was changed, but also "woman" by a lot. on the right is the lora with prior regularization: the prompt "woman" looks almost exactly like in the unchanged model with no lora on the left, only "ohwx woman" is changed
Mhow many regularzation images did you use? did you caption your training images?
DI did not use any reg images. it's a code change of the trainer.
Mwhat code did you change?
SVery interesting since prior reg means using reg images
S
Dprior just means original model. I guess the name of "prior preservation" parameter is named that because originally people used images generated by the prior model
SSo what did you change in order to avoid bleeding? Would love to experiment with this aswell
Fcan you eloborate more? last time i tried it wasnt have any improvement :d
Fyes i was gonna ask this
Fbecause it was not working at all last time i tested. which trainer code change fixed?
DOT, but it's experimental.
Dyou might be able to reach a good result with reg images too, because it does something very similar. not exactly though
Cyou do realize that because of what was done to flux - it really is not trainable, right?
Dit's not a secret but this is not a development channel. I've shared on the OT discord
Fso you modified OT code? can you give full details please we can forward to kohya
Malready done
Fcan you link
Fyou forwarded ? i dont see :d
FGitHub
Replace SD3Tokenizer with the original CLIP-L/G/T5 tokenizers.
Extend the max token length to 256 for T5XXL.
Refactor caching for latents.
Refactor caching for Text Encoder outputs
Extract arch...
Extend the max token length to 256 for T5XXL.
Refactor caching for latents.
Refactor caching for Text Encoder outputs
Extract arch...
Mdm on twitter i sent him
Fhe doesnt read there :d
Mhe does
Fcan you reply to this thread
Mhe replies to me
Fhe does but rarely
Mbut sure
Fhe says he doesnt get dm notifications
Cfrom you maybe
Fgive me related code part i will forward
Fnope he replies back my every reply
Che obviously replies to max or max wouldn't have said he does
Fhe also replied my dms but he said he doesnt get notifications so he replies so late
Dhttps://discord.com/channels/1102003518203756564/1188183242747158630/1292072916976009348 the sample and some discussions below that, also a code snippet
Mhe's also japan time zone so keep that in mind
Cmaybe he jsut means he has notifications turned off then
Fok i forwarded code to the thread
Flets see now
FGitHub
Replace SD3Tokenizer with the original CLIP-L/G/T5 tokenizers.
Extend the max token length to 256 for T5XXL.
Refactor caching for latents.
Refactor caching for Text Encoder outputs
Extract arch...
Extend the max token length to 256 for T5XXL.
Refactor caching for latents.
Refactor caching for Text Encoder outputs
Extract arch...
M@crystalwizard you think the same issues will happen with sd3 8b
Fdid you notice any resemblance quality loss?_
Falso which file you added this i will test :d
Cyup. it's just larger. issues don't show up quite as much with a larger model - but they don't vanish just because it's larger