Software Engineering Courses (SECourses)•14mo ago

<@205854764540362752> doc, what's limiting my epochs to only 18 and 1600 steps? using the new 48gb c

@Furkan Gözükara SECourses doc, what's limiting my epochs to only 18 and 1600 steps? using the new 48gb configs in kohya.

XXcorpion <@205854764540362752> Is it possible to put a new optimizer? like this one?https...

Furkan Gözükara SECourses•11/18/24, 12:02 PM

you can request from kohya only he can do

SShamsi <@205854764540362752> doc, what's limiting my epochs to only 18 and 1600 steps? ...

Furkan Gözükara SECourses•11/18/24, 12:03 PM

bmaltais error

Furkan Gözükara SECourses•11/18/24, 12:03 PM

reported

Furkan Gözükara SECourses•11/18/24, 12:03 PM

i put a new bat file that switches back to older working commit

Furkan Gözükara SECourses•11/18/24, 12:03 PM

you can use it

Furkan Gözükara SECourses•11/18/24, 12:03 PM

cd kohya_ss

git checkout d47e3e664286314c6b9728bb38b1c7a576211572

Rockerx•11/18/24, 12:42 PM

@Furkan Gözükara SECourses one question for understanding. why would 16GB config be slower than 12gb config. isn't more VRAM better? I am comparing configs and only difference is blocks to swap. should it now slow down training if 12gb config has more blocks to swap ?

FFurkan Gözükara SECourses you can request from kohya only he can do

Rockerx•11/18/24, 12:43 PM

so for v14 it is necessary to use the bat file fix ? or is it only if this error is encountered

Rockerx•11/18/24, 1:41 PM

also. 3rd question. do we still need Windows_update_kohya_and_fix_FLUX_Step2 ? or is it not necessary? @Furkan Gözükara SECourses

FFurkan Gözükara SECourses cd kohya_ss git checkout d47e3e664286314c6b9728bb38b1c7a576211572

ShamsiOP•11/18/24, 2:55 PM

I used these steps in the terminal at kohya_ss folder, still the same issue

RRockerx <@205854764540362752> one question for understanding. why would 16GB config be s...

Furkan Gözükara SECourses•11/18/24, 4:24 PM

even kohya couldnt find it

Furkan Gözükara SECourses•11/18/24, 4:24 PM

it is a weird thing

RRockerx so for v14 it is necessary to use the bat file fix ? or is it only if this error...

Furkan Gözükara SECourses•11/18/24, 4:25 PM

yes but bmaltais fixed

Furkan Gözükara SECourses•11/18/24, 4:25 PM

latest version should work now

RRockerx also. 3rd question. do we still need Windows_update_kohya_and_fix_FLUX_Step2 ? o...

Furkan Gözükara SECourses•11/18/24, 4:25 PM

not atm but in future maybe

SShamsi I used these steps in the terminal at kohya_ss folder, still the same issue

Furkan Gözükara SECourses•11/18/24, 4:25 PM

try latst version

Furkan Gözükara SECourses•11/18/24, 4:25 PM

maybe now works

Furkan Gözükara SECourses•11/18/24, 4:25 PM

he made an update

FFurkan Gözükara SECourses try latst version

ShamsiOP•11/18/24, 4:56 PM

Sorry, what do you mean latest version? I'm V44 files from a day ago.

�🍭🎀 𝒜𝓋𝒶 𝐹𝓇𝒾𝑔𝑔 🎀🍭L40S, got it, thanks!

CMatias•11/18/24, 6:56 PM

L40S and A100 PCIe, are my first choices.
L40S is very polyvalent and has a good speed.
I use A100 PCIe when I don't want to loose time about searching for the parameters limits and fall into Out Of Memory problems.

SShamsi Sorry, what do you mean latest version? I'm V44 files from a day ago.

Furkan Gözükara SECourses•11/18/24, 8:12 PM

i mean run updater bat file

Furkan Gözükara SECourses•11/18/24, 8:12 PM

kohya gui fixed error

FFurkan Gözükara SECourses i mean run updater bat file

ShamsiOP•11/18/24, 8:18 PM

i'm running ubuntu on massed

SShamsi i'm running ubuntu on massed

Furkan Gözükara SECourses•11/18/24, 8:20 PM

then run installer

Furkan Gözükara SECourses•11/18/24, 8:20 PM

it will update

Furkan Gözükara SECourses•11/18/24, 8:20 PM

our installer from zip file

FFurkan Gözükara SECourses our installer from zip file

ShamsiOP•11/18/24, 8:59 PM

link please doc

Furkan Gözükara SECourses•11/18/24, 9:01 PM

https://www.patreon.com/posts/112099700

Furkan Gözükara SECourses•11/18/24, 9:02 PM

use massed compute instructions

ShamsiOP•11/18/24, 9:23 PM

ty ty doc!

FFurkan Gözükara SECourses https://www.patreon.com/posts/112099700

ShamsiOP•11/18/24, 9:26 PM

I'm creating Loras

ShamsiOP•11/18/24, 9:26 PM

it is the same?

SShamsi I'm creating Loras

Furkan Gözükara SECourses•11/18/24, 9:37 PM

yes

Furkan Gözükara SECourses•11/18/24, 9:37 PM

uses same files

ShamsiOP•11/18/24, 9:38 PM

ok thank you again doc

Rockerx•11/18/24, 9:54 PM

thanks for the responses.

Rockerx•11/18/24, 9:55 PM

@Furkan Gözükara SECourses can we train FP8 models as well using same configs? or do I need to select fp8 in the training parameters. Atm I can train lora on FP8 using your fp8 config.

RRockerx <@205854764540362752> can we train FP8 models as well using same configs? or do...

Furkan Gözükara SECourses•11/18/24, 10:01 PM

yes

Furkan Gözükara SECourses•11/18/24, 10:01 PM

but there is no fp8 training for fine tuning

Furkan Gözükara SECourses•11/18/24, 10:01 PM

kohya doesnt support

FFurkan Gözükara SECourses but there is no fp8 training for fine tuning

Rockerx•11/18/24, 11:29 PM

I was asking for the dreambooth tab. so fp8 is only for lora

RRockerx I was asking for the dreambooth tab. so fp8 is only for lora

Rockerx•11/18/24, 11:31 PM

@Furkan Gözükara SECourses do you know what is used for fp8 finetune ? do other tools like onetrainer support it ? or is the only option to do full training and then save as fp8

RRockerx <@205854764540362752> do you know what is used for fp8 finetune ? do other tools...

Furkan Gözükara SECourses•11/18/24, 11:39 PM

it only converts base model into fp8

Furkan Gözükara SECourses•11/18/24, 11:39 PM

training is still done as fp16

Furkan Gözükara SECourses•11/18/24, 11:39 PM

kohya said me that he doesnt know how to make training in fp8

ShamsiOP•11/18/24, 11:53 PM

@Furkan Gözükara SECourses I did the updates as suggested and played with the repeat and epoch numbers. still it won't go past 1600 steps and 10 epochs (I've set it to 200). is this normal or am i missing something?