I hope that was kinda clear? difficult to explain in two sentences
I hope that was kinda clear? difficult to explain in two sentences
Fdid you make a PR for this?
Fonly for one trainer?
Dno, I've talked to the OT developer and he is not interested. he thinks it is too specific for my/our use case. he also thinks the same can be done with additional embeddings - but I've tried that. it's worse.
AThe workflow works on this clip but other clips just dont load at all and give that error
Dso whenever you have the chance, it would be great to get your opinion.
Fsure i would like to test
Fcurrently i was using kohya
Fdo you have same for kohya?
Fthat would be a nice comparison but i can test on OT too
DI had it for kohya, as I was using kohya until we noticed the quality isn't good anymore. so I think testing this for kohya only makes sense after you have found the perfect hyperparameters again. otherwise we'd compare against something that is bad for other reasons
Fye i found them
Fgoing to update now
DI DMed you a patch. The class it controls against is hardcoded to 'man', so if you are training a woman or something else, you need to change that
Dparameters: leave everything as-is, but turn on TE2, too, and set both TE1 and TE2 learning rates to the main learning rate 1e-05
Dif you want it for kohya, I'd have to first test it again tomorrow, as it was a while ago and I don't know if I have left it in a working state
Doff to bed now, let me know if you have any questions!
FKohya config updated https://www.patreon.com/posts/very-best-for-of-89213064
AWhats the difference between kohya and onetrainer?
Fdifferent scripts
Fdifferent features
Fand produces even different results in same settings :d
AInteresting
AHow long should using 20 images take to train using the 24gb json file roughly?
Fdepends on gpu
A3090 is what I have
Fbut lets say you did 150 repeat
Fye around 1.7 second / it lets say
Fso
F6000 * 1.7 second
Ain your latest post there what did you do change the 24gb json file configs?
Flearning rates
Fread the patreon post very detailed
Fi should test and see if SD 1.5 broken too or not :/
DI'm training on an rtx 3090 with Gradient checkpointing off and CrossAttention sdpa at 1.52s/it
Fnice speed
Fspda speed up
Fbut i dont know how much quality loss
D1.51s/it now, still slower than previous versions with the same settings but it is faster than using Gradient checkpointing on this capture is with an older version
DI didn't know that this option can decrease quality, what about xformers, with it also can get quality loss?
DI get almost the same speeds with xformers and a little more vram usage 20gb or so
Fyes in past both degraded
Fbut it is getting better
Dok thanks!! I will check if I can see any difference
Fi will do a training with onetrainer
Flets see difference between kohya
Dthat will be an interesting test!! a good test can be also to do a run test with xformers and spda, its a little speed up but can be very significant speed up for very large datasets and very long trainings.
Fdoing a fresh install
Fof onetrainer
Fye for massive dataset
Fyou have to have xformers and batch size bigger