Software Engineering Courses (SECourses)•17mo ago

if you do ```1 Repeat 20 Images 100 Epochs = 2000 steps ```

if you do

1 Repeat
20 Images
100 Epochs

= 2000 steps

1 Repeat
20 Images
100 Epochs

= 2000 steps

1 Repeat
20 Images
100 Epochs

= 2000 steps

1 Repeat
20 Images
100 Epochs

= 2000 steps

LW24Ai•9/2/24, 5:06 AM

And where do the files go after training?

itOP•9/2/24, 5:06 AM

Wherever you put your output folder

FFurkan Gözükara SECourses https://www.patreon.com/posts/110879657

druhl•9/2/24, 5:29 AM

Doc, the Lora turned out so good, even with the initial settings, that I'm going to wait till the next weekend just so you're able to release a significant update to the settings, before training again.

druhl•9/2/24, 5:30 AM

At this point, I believe further improvement in the input dataset will bring vast gains.

druhl•9/2/24, 5:32 AM

However, what I'd like to know - does Rank 1 bring more quality in the final results than say, Rank 5?

druhl•9/2/24, 5:33 AM

(my current understanding is that Ranks are just means to be able to train on any GPU, time varies but quality does not - am I wrong?).

druhl•9/2/24, 5:34 AM

@Dr. Furkan Gözükara

Iit if you do ```1 Repeat 20 Images 100 Epochs = 2000 steps ```

LW24Ai•9/2/24, 5:51 AM

Thanks

LW24Ai•9/2/24, 5:53 AM

Will Lora work with fp8 or is it only on fp16?

LLW24Ai Thanks❤️

itOP•9/2/24, 6:30 AM

are you using @Dr. Furkan Gözükara configs?

LLW24Ai Will Lora work with fp8 or is it only on fp16?

Neo•9/2/24, 6:43 AM

I just used his (2nd to latest) config with 20 images to ~4000 steps, with no issues. Make sure in the dataset preparation you are updating the folder repeats from 40 to 1 (saying because I missed that step). If you've already started teh training you can stop it and just rename the img sub-folder(s) to 1_ohwx man (or whatever concept it is)

Neo•9/2/24, 6:44 AM

@Laura Wolf If it has saved outputs you technically can resume the LoRA training from the latest output...

daryhead•9/2/24, 8:51 AM

I'm on runpod using a 3090 training flux with kohya and using the rank 4 file.
It's going for 3800 steps and says it's going to take 6 hours.
I'm going to stop it after about 2,000 steps, but even that is going to take a very long time.

What can I do to train in a shorter amount of time?
And is this normal for flux?
(When I used to do trainings for SDXL it was about 30 minutes to an hour)

Iit are you using @Dr. Furkan Gözükara configs?

LW24Ai•9/2/24, 10:09 AM

Uporabljam config Rank_5_11498mb_počasi

LW24Ai•9/2/24, 10:10 AM

LLW24Ai Who can tell me if this is normal at this rate of training?

Furkan Gözükara SECourses•9/2/24, 10:28 AM

you made the repeat 40

Furkan Gözükara SECourses•9/2/24, 10:28 AM

repeat has to be 1

Furkan Gözükara SECourses•9/2/24, 10:28 AM

speed is normal for rtx 3060

Ddruhl Doc, the Lora turned out so good, even with the initial settings, that I'm going...

Furkan Gözükara SECourses•9/2/24, 10:29 AM

rank 1 and rank 5 are very similar

Furkan Gözükara SECourses•9/2/24, 10:29 AM

since uses lora 128 t5 attention and 1024 px t5 text encoder

LLW24Ai Will Lora work with fp8 or is it only on fp16?

Furkan Gözükara SECourses•9/2/24, 10:30 AM

it works both after training

Ddaryhead I'm on runpod using a 3090 training flux with kohya and using the rank 4 file. ...

Furkan Gözükara SECourses•9/2/24, 10:30 AM

tell me step speed

Furkan Gözükara SECourses•9/2/24, 10:30 AM

but sounding accurate

Furkan Gözükara SECourses•9/2/24, 10:30 AM

you can also use multi gpu training

Furkan Gözükara SECourses•9/2/24, 10:31 AM

i am editing video sadly it is delayed to today

LLW24Ai Uporabljam config Rank_5_11498mb_počasi

Furkan Gözükara SECourses•9/2/24, 10:31 AM

ye this one is slow config expected

FFurkan Gözükara SECourses ye this one is slow config expected

LW24Ai•9/2/24, 10:40 AM

I am working on the flux1CompactCLIPAnd_Flux1DevFp8 model If I train lora on your config. Will it work on my flux1 Compact model? I tried third-party lora, they didn't work on it.

LLW24Ai I am working on the flux1CompactCLIPAnd_Flux1DevFp8 model If I train lora on you...

Furkan Gözükara SECourses•9/2/24, 10:49 AM

dont use it

Furkan Gözükara SECourses•9/2/24, 10:49 AM

use fp8 or fp16

Furkan Gözükara SECourses•9/2/24, 10:50 AM

and it doesnt matter what you use but use accurate model to not have any error

LW24Ai•9/2/24, 10:50 AM

Thanks

ghstoic•9/2/24, 11:13 AM

Ever since updating to the latest patreon version, I keep getting "training has ended." without any error messages before a single step has even run. I've tried doing clean reinstalls and downgrading to an earlier patreon script version, but it keeps happening. I've tried it with the new configs, as well as old configs & training datasets that worked perfectly yesterday on an older script version (I can't recall which version, though), but the same issue keeps occurring. Any idea's how to fix it as tried googling it without much success and doing clean installs as well?

WindowsTerminal_02-September-2024_02.12.02PM.png

Gghstoic Ever since updating to the latest patreon version, I keep getting "training has ...

Furkan Gözükara SECourses•9/2/24, 11:21 AM

looks to me like out of RAM

Furkan Gözükara SECourses•9/2/24, 11:21 AM

can you set virtual RAM

Furkan Gözükara SECourses•9/2/24, 11:21 AM

restart PC and let me know?

Furkan Gözükara SECourses•9/2/24, 11:21 AM

start from minute 39 to learn how to set virtual ram

Furkan Gözükara SECourses•9/2/24, 11:21 AM

set it 50 GB

ghstoic•9/2/24, 11:42 AM

Thanks a lot for the reply. Are you referring to 39mins of this video or a diff video? https://www.youtube.com/watch?v=sBFGitIvD2A

YouTubeSECourses

Become A Master Of SDXL Training With Kohya SS LoRAs - Combine Powe...

In this tutorial, you will learn how to install Automatic1111 Web UI for SDXL. How to use LoRAs with Automatic1111 SD Web UI. How to install Kohya SS GUI scripts to do Stable Diffusion training. How to train LoRAs on SDXL model with least amount of VRAM using settings. All of the details, tips and tricks of Kohya trainings. How to do x/y/z plot ...

Gghstoic Thanks a lot for the reply. Are you referring to 39mins of this video or a diff ...

Furkan Gözükara SECourses•9/2/24, 11:44 AM

flux video

Furkan Gözükara SECourses•9/2/24, 11:44 AM

https://youtu.be/nySGu12Y05k

YouTubeSECourses

FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI ...

Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...

FFurkan Gözükara SECourses tell me step speed

daryhead•9/2/24, 11:55 AM

5.65
So it's expected for each Lora training to take somewhere around an hour and a half to two hours?

Ddaryhead 5.65 So it's expected for each Lora training to take somewhere around an hour an...

Furkan Gözükara SECourses•9/2/24, 11:59 AM

on that gpu yes

Furkan Gözükara SECourses•9/2/24, 11:59 AM

rtx 4090 faster than 2x :d

FFurkan Gözükara SECourses https://youtu.be/nySGu12Y05k

ghstoic•9/2/24, 11:59 AM

Thanks, I followed it and restarted PC but same error still persists. Surprised it could be a RAM issue as I didn't get this issue before and am trying Rank_4 config (17gb) on a RTX 3090 with 24gb vram

Furkan Gözükara SECourses•9/2/24, 11:59 AM

you can also rent multiple

Gghstoic Thanks, I followed it and restarted PC but same error still persists. Surprised ...

Furkan Gözükara SECourses•9/2/24, 11:59 AM

can you send me your json file from private mesage

ghstoic•9/2/24, 12:00 PM

sure