but there is no fp8 training for fine tuning
but there is no fp8 training for fine tuning
Fkohya doesnt support
RI was asking for the dreambooth tab. so fp8 is only for lora
R@Furkan Gözükara SECourses do you know what is used for fp8 finetune ? do other tools like onetrainer support it ? or is the only option to do full training and then save as fp8
Fit only converts base model into fp8
Ftraining is still done as fp16
Fkohya said me that he doesnt know how to make training in fp8
S@Furkan Gözükara SECourses I did the updates as suggested and played with the repeat and epoch numbers. still it won't go past 1600 steps and 10 epochs (I've set it to 200). is this normal or am i missing something?
Fyes you need to enter max steps count
Fin the gui look for it
SYes sirr 
. Had to override the default =0.
. Had to override the default =0.
Fyep 
�Perfect, just what I was gonna ask too 
Got my answer quickly here. Thanks
Got my answer quickly here. Thanks�Here's a challenge I want to complete. I have a fine-tuned checkpoint for my character, but I want my characters body to be taken from another character. So I trained a lora using pics of the other character, but the lora also includes that characters face. What do you guys suggest I do to get best result? I don't want my face changed because of this lora. So is using the <segment...> syntax in swarmui a way to go, or should I change the training images such that the head is cut off? Appreciate this community so much, I learn something every day!
Appreciate this community so much, I learn something every day!
Fi dont think it will work
Fyou can inpaint face of another character
R@Furkan Gözükara SECourses reporting 2 things.
- now when I install v44 or v14 scripts it does update kohya and I am getting correct step count.
- in your lora configs you are using additional parameters for block swap. this throws an exit 0 error and training exits. the UI in lora in latest kohya now has block swap option in UI. if I manually set it to what your config has and remove the additional parameter the training works but not sure if as the UI option says (use with fused back pass) which is not available in UI. but the training works with block swap if I set in UI and remove your addition parameters setting.
Can you fix the configs so that it works for lora ? have not tested the finetune in new config but see if that also needs update etc.
Whi @Furkan Gözükara SECourses I just download dreambooth v15 few days ago now you already uploaded v16. Is there something new in this new version ?
WAnd I also have a question about training full dreambooth checkpoint @Furkan Gözükara SECourses . Since you said training person with dreambooth should separate into 2 part of training. Part 1 to take the epoch which is flexible to style. Part 2 is train new epoch with the base is flexible style model from part 1.
What is the different with continue training compare with separte with 2 parts like this. since we used constant learning rate.
For example: Part 1 - I choose epoch 30 to use as based model to retrain. Part 2 - I train 100 more epoch with based model in Part 1. But that just similar to train 130 epoch from Part 1 right ? Because we use constant learning rate.
What is the different with continue training compare with separte with 2 parts like this. since we used constant learning rate.
For example: Part 1 - I choose epoch 30 to use as based model to retrain. Part 2 - I train 100 more epoch with based model in Part 1. But that just similar to train 130 epoch from Part 1 right ? Because we use constant learning rate.
�So as a general rule, the more training images you have of 1 character, the less epochs you would need to get good result. Am I getting the logic right? So 300 pics you might get good result with 10 or 20 epochs, but with 15 pics, you will need more epochs, like 100-200.
Fyes both should be same continue
Fno changes for fine tuning only dowgnrade torch to 2.5.0
DFlast time i tested it was but i didnt test recentyly
Fplanning to test after we update our massed compute image
Dif you open an issue I can have a look, but please provide as much info as you can so I can replicate it without massed compute
MDo any have experience in training yourself with dreambooth sdxl model ....
This the params i use
but my in the image generation i get completly different image
Whether using vae model is the mistake hera ....
DR.furkan gozukara u only can help me out
I was stuck in it for past 1 month
I need to train myself and reproduce it like professional image
This the params i use
but my in the image generation i get completly different image
Whether using vae model is the mistake hera ....
DR.furkan gozukara u only can help me out
I was stuck in it for past 1 month
I need to train myself and reproduce it like professional image
D@Furkan Gözükara SECourses are you in contact with anyone who is doing large finetunes like RealVis/Juggernaut, and is attempting to do the same for Flux? I might have something that helps.
X@Furkan Gözükara SECourses ss_network_args": "{"loraplus_lr_ratio": "16", "loraplus_text_encoder_lr_ratio": "4", "dropout": null}"
do you know what is this? if know how to do this?
do you know what is this? if know how to do this?
Flooks to me very random parameters
Fnot any sadly
Fi dont know
S@Furkan Gözükara SECourses Doc, When preparing the images, is the resizing step necessary? I cropped using your tool and I'm not training on faces. Most images to train on are larger than 1024p and in various aspect ratios. in that case, should I change the max resolution setting in Kohya?
Fif you dont resize
Fthey will be random aspect ratios
Fdepending on subject cropping
SIn kohya, do I change the max resolution or maybe enable buckets? images are around 1000*1900 few are large and some are smaller
Fi would crop myself to all 1024x1024 it works best
Fwhat you are training?
Sclothes types. traditional dresses
Snot really an option
Fok in that case
Fmake it like 2048x2048 and enable bucket
Fbut i cant say how good it will work
Fa bit experimental
Fi trained a style at 1536px and it didnt learn style accurately
Shaha, will let you know the results
STy doc and gn
MHow can i select the better one
Fi have sdxl dreambooth good config