Software Engineering Courses (SECourses)•16mo ago

Good morning! I am doing the KOHYA flux training according to your video. I have an RTX 4090 however

Good morning! I am doing the KOHYA flux training according to your video. I have an RTX 4090 however I'm only getting 4.39it/s even with the torch 2.5.... Any ideas on what I am doing that might cause it to be so slow?

WebsteriaOP•9/4/24, 7:15 PM

running windows 11

WWebsteria Good morning! I am doing the KOHYA flux training according to your video. I have...

Furkan Gözükara SECourses•9/4/24, 7:25 PM

Which config?

WebsteriaOP•9/4/24, 7:32 PM

Rank_2_27700MB_4_85_Second_IT

WebsteriaOP•9/4/24, 7:33 PM

wait

WebsteriaOP•9/4/24, 7:33 PM

Rank_3_18950MB_9_05_Second_IT

WebsteriaOP•9/4/24, 7:34 PM

GPU Memory is at 21GB

WebsteriaOP•9/4/24, 7:35 PM

@Dr. Furkan Gözükara

Dazzastrous [4090]•9/4/24, 7:37 PM

erm the first prompt wheres the airplane

WWebsteria Rank_2_27700MB_4_85_Second_IT

Furkan Gözükara SECourses•9/4/24, 7:37 PM

Great speed for rank 3

Furkan Gözükara SECourses•9/4/24, 7:37 PM

Use rank 4 for faster

DDazzastrous [4090]erm the first prompt wheres the airplane 🙂

Furkan Gözükara SECourses•9/4/24, 7:38 PM

Prompt was wrong fixed it :))

WebsteriaOP•9/4/24, 7:38 PM

gotcha. Thanks! Your video was very detailed and informative.

Furkan Gözükara SECourses•9/4/24, 7:38 PM

Will update grids

WebsteriaOP•9/4/24, 7:42 PM

@Dr. Furkan Gözükara Using Rank_4_16960MB_Fast.json and still getting

WebsteriaOP•9/4/24, 7:42 PM

12/2800 [00:41<2:42:26, 3.50s/it,

WWebsteria 12/2800 [00:41<2:42:26, 3.50s/it,

Furkan Gözükara SECourses•9/4/24, 7:43 PM

Wait 150 steps and let me know

Dazzastrous [4090]•9/4/24, 7:43 PM

Furkan Gözükara SECourses•9/4/24, 7:43 PM

But it is already like 2x of a6000

WebsteriaOP•9/4/24, 7:50 PM

@Dr. Furkan Gözükara After 150 steps these are the stats: 150/2800 [08:46<2:35:08, 3.51s/it, avr_loss=0.393]

slipkn67•9/4/24, 8:21 PM

can I use flux dev with 12GB vram?

WWebsteria @Dr. Furkan Gözükara After 150 steps these are the stats: 150/2800 [08:46<2:35:...

Furkan Gözükara SECourses•9/4/24, 8:22 PM

ok it is a good speed but slower than linux i guess

Furkan Gözükara SECourses•9/4/24, 8:22 PM

A6000 gets like 4.5 second it on linux

Sslipkn67 can I use flux dev with 12GB vram?

Furkan Gözükara SECourses•9/4/24, 8:22 PM

yep

FFurkan Gözükara SECourses ok it is a good speed but slower than linux i guess

GomezBro•9/4/24, 8:39 PM

Final question I just loaded up a 4GPU L40S and going to train, I did 4GPU config, but learning rate is 0.00005? Change it to 0.0001? Your config comes preloaded at 0.00005

GGomezBro Final question I just loaded up a 4GPU L40S and going to train, I did 4GPU confi...

Furkan Gözükara SECourses•9/4/24, 8:40 PM

change 0.0001

Furkan Gözükara SECourses•9/4/24, 8:40 PM

0.00005 i,s fo single gpu / b atch size

FFurkan Gözükara SECourses change 0.0001

GomezBro•9/4/24, 8:41 PM

you have your config saved that way, just FYI

GomezBro•9/4/24, 8:41 PM

I wonder how fast this will do 10000 images 1 Epoch about to find out

Furkan Gözükara SECourses•9/4/24, 8:41 PM

guys i need your careful analysis and your opinions which check point looks best

trained style images as a single grid : https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Trained_Style_Images.jpg
trained checkpoints grid comparison : https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX/resolve/main/Trained_Checkpoints_Massive_Grid.jpg

GGomezBro you have your config saved that way, just FYI

Furkan Gözükara SECourses•9/4/24, 8:41 PM

sure

FFurkan Gözükara SECourses guys i need your careful analysis and your opinions which check point looks best...

GomezBro•9/4/24, 8:42 PM

2nd link is broken

GGomezBro 2nd link is broken

Furkan Gözükara SECourses•9/4/24, 8:42 PM

it works just big

Furkan Gözükara SECourses•9/4/24, 8:42 PM

save it as

Furkan Gözükara SECourses•9/4/24, 8:44 PM

i just noticed the art style dataset was not super consistent lol

GomezBro•9/4/24, 8:55 PM

I think its subjective too, CAptioned has more control, uncaptioned more random

GomezBro•9/4/24, 8:55 PM

Same issue happening bro, im going to give up hahaha

GomezBro•9/4/24, 8:56 PM

I only see 1 GPU being used and im paying for L40S rn since A6000 were taken

GomezBro•9/4/24, 8:56 PM

GomezBro•9/4/24, 8:56 PM

training ended, doest work

GomezBro•9/4/24, 8:57 PM

@Dr. Furkan Gözükara

GGomezBro Click to see attachment

Furkan Gözükara SECourses•9/4/24, 9:00 PM

what is the full message

Furkan Gözükara SECourses•9/4/24, 9:00 PM

of error

xlads•9/4/24, 9:03 PM

@Dr. Furkan Gözükara when downloading and extracting Kohya GUI, how do i install it into my hard drive? i also have an external ssd but i want to install it into my hard drive.

Xxlads @Dr. Furkan Gözükara when downloading and extracting Kohya GUI, how do i install...

Furkan Gözükara SECourses•9/4/24, 9:06 PM

please follow this video it shows : https://youtu.be/nySGu12Y05k

YouTubeSECourses

FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI ...

Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...