Then, best way to speed up the training is - lora - batch size 1 - multiple gpus(for linear speed up
Then, best way to speed up the training is
- lora
- batch size 1
- multiple gpus(for linear speed up)
MAdditional question, is there any way that I can improve training speed itself?
- I used best Tier 1 config for 48GB vram for lora training
- But, set "cache_latents = false / cache_latents_to_disk = false"
- With RTX 6000 Ada, it took 24 mins for 20 epoch
- With A100 SXM, it took 16 mins for 20 epoch
Fsadly not much else
Fgraident checkpointing slows down
Fbut turning it of requires huge vram
Mhmmm... in that case, I need to think about how to optimize gpu cost
MMI'm curious how much quality difference between fp8 and fp16
Fnot possible
Feven if you use fp8 weights the training happens at 16 bit precision
Fkohya doesnt support fp8 training
MThank you so much for answering all the questions! I'll focus on facial accuracy with Kohya fisrt, and then think about speed later haha
ZI see, thank you.
Where we can see the class type for this flux model?
Where we can see the class type for this flux model?
Fthere is no class types
Fyou need to understand yourself sadly
HYoo devs
U@Furkan Gözükara SECourses Hello 
I was wondering if you have any plans in the future to train a custom lora for wan 2.1/2.2 (when it releases) video generation?
I was wondering if you have any plans in the future to train a custom lora for wan 2.1/2.2 (when it releases) video generation?
Fi saw today wan 2.2 coming haha
UCant wait for your video 
UWhen should I be looking out for it?
Fafter this video upscaler i plan to research them :d
Fi need to fisnih this
UCan't wait
UHey, I have been finding resources and documents for text to video for wan with images being dataset or image to video with videos being dataset, but I was wondering if there is a way to train lora with images and use first and last image as reference and generate a video based on the reference images? do you happen to know any models which lets you train on images and then use that lora with reference images?
Fi dont know such model
Fbut wan 2.1 can be trained from images to generate videos
0Hey guys, so I'm really impressed with the fine tune accuracy with regards to my model's face. it looks great. but it still has a bit of AI look to it. and I know the model is trained on photorealism.
my goal is it make it look more candid, like it was shot on an iPhone or a digital cam. I've used loras with varying strengths and it completely changes the faces on the model. I've tried different resolutions but it doesnt help much.
my goal is it make it look more candid, like it was shot on an iPhone or a digital cam. I've used loras with varying strengths and it completely changes the faces on the model. I've tried different resolutions but it doesnt help much.
0should I try and combine the fine tune with a realism fine tune or would that totally mess it up?
Fmore realism is obtainerd with
Fmore images + more training
Fbut if you use a more realism oriented fine tuned base flux model
Fit may also help
0I actually just tried that but it keeps giving me an error. Specifically I'm using ultrarealfinetunev4 as the base model and its saying
KeyError: 'time_embed.0.weight'
Chatgpt is saying:
"You're running into a common issue: the UltraRealFineTune .safetensors file is not a full Stable Diffusion checkpoint — it's missing key components, particularly UNet time embedding weights, which causes this error:
KeyError: 'time_embed.0.weight'"
KeyError: 'time_embed.0.weight'
Chatgpt is saying:
"You're running into a common issue: the UltraRealFineTune .safetensors file is not a full Stable Diffusion checkpoint — it's missing key components, particularly UNet time embedding weights, which causes this error:
KeyError: 'time_embed.0.weight'"
0so assuming I cannot use that model do you have any reccomendations?
Fchat gpt or alikes will know nothing
Fare you training stable diffusion
For flux?
0in this case I did everything the same as your Flux dreambooth finetune video except I changed the base model, so flux im assuming? I noticed that it will work when the "flux1" box is checked but not otherwise
Fyes it is flux
FUltraRealFineTune is flux model? how many gb?
0V4 Alright, so what’s new in this version? I cranked up the aesthetic dial, added more diversity in ages, and improved how it handles Asian feature...
0it's over 22gb so I figured it would be the full model
0should I check the flux1 box and train or will that mess it up?
Fyes this should work
FFull Model fp16 (22.17 GB)
Fif not working you should open an issue thread for kohya to fix
Fto support model loading format
0I'll go ahead and train it with the "flux1" checked I'm assuming that means im telling kohya its a flux1 model. we will see what happens.
0thanks for your help