i am, but testing something at 512 so can't compare speed to my 1024 runs
i am, but testing something at 512 so can't compare speed to my 1024 runs
Nrank 5 with updated torch (I guess updated, but I did update)...1024, without t5 att masking
Fi hope it works perfect
Fi will be able to test only during night
NI will not finish this training, so I can't tell you result. But maybe I will try to start training at night. So could be some results tomorrow...or not)
Fi will do same :d
MHello everyone, quick question: what does this script do?
https://huggingface.co/MonsterMMORPG/Generative-AI/resolve/main/kohua_gui_pass_update.sh
As far as I understand, it replaces kohya_ss's
https://huggingface.co/MonsterMMORPG/Generative-AI/resolve/main/kohua_gui_pass_update.sh
As far as I understand, it replaces kohya_ss's
gui.sh
Dokay, lets see the local flux kohya training
NI think updates a few libraries to newer versions, then patches original gui to not roll them back? not sure though.
Ddo we still need to use the kohya training folder structure? even with the folder name #_name_class?
Nthat's what kohya is still expecting as of now (space between name and class though, not _ )
SDr Furkan i hope everyting is ok, wich is your estimate tha could be a video tutorial of FLUX Lora step by steps? wonderfull work
Fit prevents kohya to revert back requirements
Fso our custom torch installation remains
Fthank you. still editing video 
EHas anyone gotten a slider Lora training working for Flux yet? I have seen a few sliders on Civit but I don't think they are trained the same way SD sliders were trained.
Anyone seen anything? I tried modifying the ai-toolkit code to get it to work but it didn't work out ;P
Anyone seen anything? I tried modifying the ai-toolkit code to get it to work but it didn't work out ;P
Fnope i didnt see yet
Dwhen the trained person should be blonde but her last name is "Blue" 
Nwhat is better to have more epochs or more repeats?
Fthey have different purposes
Fexplained in video :d
Fnormally you dont need repeat
NI'm in a middle of watching))
S
Ftotally depends on your total steps and gpu
Fbut rtx 3090 can get amazing model within 5 hours
Frtx 4090 likely to with like 2 hours 2.5 hours
D2-2.5 hours for the 4090 is correct
SNice I'll have to check it out. I have a 4090
Fyep
Fgreat
Fuse torch 2.5 to have best speed on windows
Si have like 60 more models to merge but i want to check it out this weekend for sure
S
Sfine tuning and adding flexibility to this 1.5 model
Swhile keeping the most accuracy
Si wish i knew the science behind how merging works but i just mix them up and hope for the best
SThis man Sciences
Fthere is no science it averages neural network weights and you expect to work
it averages neural network weights and you expect to workShahah well i just mean in a basic sense, like if i do 50% + 50% of one model and then merge that with another at 50% does it equal out to be 25% +25% +50% or what lol
Sor am i actually losing any data or does other data just cover it up to where i can bring other data forward by adjusting weights of tokens and what not
Dhm, I seem to be using less VRAM than supposed to
odd
odd
Fmaybe torch 2.5 diff
Fare you using torch 2.5? vrams tested on torch 2.4
AThanks to your guides and configs I fine tuned an SDXL model with pics of my dog and of me using OneTrainer (will post some results later). The thing I'm struggling with is extracting a Lora from the model. I was able to do this with kohya_ss but the Lora comes out at almost 2Gb. I was wondering am I using wrong settings in kohya_ss or should I extract the Lora and then run the reduce Lora option in kohya_ss?
Fwhy you need to reduce its size?
Fyou can reduce by
Fset precision to bf16 or fp16 compare each one quality
Fset rank 128 or lower if you need lower size