Software Engineering Courses (SECourses)•17mo ago

What's the new parameter

NNeuromasters What's the new parameter

Furkan Gözükara SECourses•8/20/24, 3:40 PM

probably for turbo model

dsienra•8/20/24, 3:51 PM

dsienra•8/20/24, 3:52 PM

1e_04_fp8_bf16_accelerate_full_bf16_32_rank config

dsienra•8/20/24, 3:52 PM

something is not right

dsienra•8/20/24, 3:52 PM

is consuming too much vram

dsienra•8/20/24, 3:54 PM

dsienra•8/20/24, 3:59 PM

one thing I saw yesterday was that no matter the lora rank I use the vram usage was the same

dsienra•8/20/24, 4:01 PM

lora rank 32

dsienra•8/20/24, 4:07 PM

lora rank 128 is consuming less vram??? what??

dsienra•8/20/24, 4:08 PM

must be a bug

Ddsienra lora rank 128 is consuming less vram??? what??

Furkan Gözükara SECourses•8/20/24, 4:18 PM

lora rank impact on VRAM is very minimal i tested

Ddsienra lora rank 128 is consuming less vram??? what??

Furkan Gözükara SECourses•8/20/24, 4:18 PM

how much vram usage you have before starting the training?

dsienra•8/20/24, 4:22 PM

0.6

dsienra•8/20/24, 4:22 PM

I can turn off the monitors and get 0.4 gb

Ddsienra 0.6

Furkan Gözükara SECourses•8/20/24, 4:23 PM

0.6 should work but still using some extra. i wonder if due to operating system

Furkan Gözükara SECourses•8/20/24, 4:23 PM

i tested vram usages on ubuntu

dsienra•8/20/24, 4:23 PM

but yesterday worked

Furkan Gözükara SECourses•8/20/24, 4:23 PM

interesting

Furkan Gözükara SECourses•8/20/24, 4:23 PM

are you using latest version?

Furkan Gözükara SECourses•8/20/24, 4:23 PM

of kohya

Ddsienra Is training on my rtx 3090 but 9 times slower than sdxl, lora rank 8 1024x1024 r...

dsienra•8/20/24, 4:24 PM

I cant remenber what was diferent

dsienra•8/20/24, 4:25 PM

it was rank 8

dsienra•8/20/24, 4:26 PM

now is working rank 8

dsienra•8/20/24, 4:28 PM

dsienra•8/20/24, 4:29 PM

for Network Rank (Dimension) 8 I need to set Convolution Rank (Dimension) to 8 too?

dsienra•8/20/24, 4:30 PM

and what about Network Alpha and Convolution Alpha?

FFurkan Gözükara SECourses are you using latest version?

dsienra•8/20/24, 4:31 PM

yes I did a git pull before training

dsienra•8/20/24, 5:04 PM

I'm going to test your lowest_vram config now

dsienra•8/20/24, 5:53 PM

Now is working with your 1e_04_fp8_bf16_accelerate_full_bf16_32_rank config, I just restarted the PC and enabled buckets not all my images are 1024x1024 is working with great speed

dsienra•8/20/24, 6:01 PM

that was with my monitors turned off but I need to use my pc for other tasks, using the pc the speed decreased

Ddsienra Now is working with your 1e_04_fp8_bf16_accelerate_full_bf16_32_rank config, I j...

�

𝔸𝖨ΞӾ•8/20/24, 6:03 PM

Is 200 epochs per image really necessary tho? 387 images in your dataset and training will be finished like in 4 days lol

dsienra•8/20/24, 6:05 PM

hehe yes

dsienra•8/20/24, 6:06 PM

I can stop it earlier and test

dsienra•8/20/24, 6:06 PM

but yes is too slow

Ddsienra hehe yes

�

𝔸𝖨ΞӾ•8/20/24, 6:08 PM

Ok because I was testing Dr's 128 rank config earlier and was wondering why it was set at 200 epochs, not sure how many images he had so I was just curious why. I'm still learning btw