Software Engineering Courses (SECourses)•17mo ago

are you using @Dr. Furkan Gözükara configs?

LLW24Ai Will Lora work with fp8 or is it only on fp16?

Neo•9/2/24, 6:43 AM

I just used his (2nd to latest) config with 20 images to ~4000 steps, with no issues. Make sure in the dataset preparation you are updating the folder repeats from 40 to 1 (saying because I missed that step). If you've already started teh training you can stop it and just rename the img sub-folder(s) to 1_ohwx man (or whatever concept it is)

Neo•9/2/24, 6:44 AM

@Laura Wolf If it has saved outputs you technically can resume the LoRA training from the latest output...

daryhead•9/2/24, 8:51 AM

I'm on runpod using a 3090 training flux with kohya and using the rank 4 file.
It's going for 3800 steps and says it's going to take 6 hours.
I'm going to stop it after about 2,000 steps, but even that is going to take a very long time.

What can I do to train in a shorter amount of time?
And is this normal for flux?
(When I used to do trainings for SDXL it was about 30 minutes to an hour)

Iit are you using @Dr. Furkan Gözükara configs?

LW24Ai•9/2/24, 10:09 AM

Uporabljam config Rank_5_11498mb_počasi

LW24Ai•9/2/24, 10:10 AM

LLW24Ai Who can tell me if this is normal at this rate of training?

Furkan Gözükara SECourses•9/2/24, 10:28 AM

you made the repeat 40

Furkan Gözükara SECourses•9/2/24, 10:28 AM

repeat has to be 1

Furkan Gözükara SECourses•9/2/24, 10:28 AM

speed is normal for rtx 3060

Ddruhl Doc, the Lora turned out so good, even with the initial settings, that I'm going...

Furkan Gözükara SECourses•9/2/24, 10:29 AM

rank 1 and rank 5 are very similar

Furkan Gözükara SECourses•9/2/24, 10:29 AM

since uses lora 128 t5 attention and 1024 px t5 text encoder

LLW24Ai Will Lora work with fp8 or is it only on fp16?

Furkan Gözükara SECourses•9/2/24, 10:30 AM

it works both after training

Ddaryhead I'm on runpod using a 3090 training flux with kohya and using the rank 4 file. ...

Furkan Gözükara SECourses•9/2/24, 10:30 AM

tell me step speed

Furkan Gözükara SECourses•9/2/24, 10:30 AM

but sounding accurate

Furkan Gözükara SECourses•9/2/24, 10:30 AM

you can also use multi gpu training

Furkan Gözükara SECourses•9/2/24, 10:31 AM

i am editing video sadly it is delayed to today

LLW24Ai Uporabljam config Rank_5_11498mb_počasi

Furkan Gözükara SECourses•9/2/24, 10:31 AM

ye this one is slow config expected

FFurkan Gözükara SECourses ye this one is slow config expected

LW24Ai•9/2/24, 10:40 AM

I am working on the flux1CompactCLIPAnd_Flux1DevFp8 model If I train lora on your config. Will it work on my flux1 Compact model? I tried third-party lora, they didn't work on it.

LLW24Ai I am working on the flux1CompactCLIPAnd_Flux1DevFp8 model If I train lora on you...

Furkan Gözükara SECourses•9/2/24, 10:49 AM

dont use it

Furkan Gözükara SECourses•9/2/24, 10:49 AM

use fp8 or fp16

Furkan Gözükara SECourses•9/2/24, 10:50 AM

and it doesnt matter what you use but use accurate model to not have any error

LW24Ai•9/2/24, 10:50 AM

Thanks

ghstoic•9/2/24, 11:13 AM

Ever since updating to the latest patreon version, I keep getting "training has ended." without any error messages before a single step has even run. I've tried doing clean reinstalls and downgrading to an earlier patreon script version, but it keeps happening. I've tried it with the new configs, as well as old configs & training datasets that worked perfectly yesterday on an older script version (I can't recall which version, though), but the same issue keeps occurring. Any idea's how to fix it as tried googling it without much success and doing clean installs as well?

WindowsTerminal_02-September-2024_02.12.02PM.png

Gghstoic Ever since updating to the latest patreon version, I keep getting "training has ...

Furkan Gözükara SECourses•9/2/24, 11:21 AM

looks to me like out of RAM

Furkan Gözükara SECourses•9/2/24, 11:21 AM

can you set virtual RAM

Furkan Gözükara SECourses•9/2/24, 11:21 AM

restart PC and let me know?

Furkan Gözükara SECourses•9/2/24, 11:21 AM

start from minute 39 to learn how to set virtual ram

Furkan Gözükara SECourses•9/2/24, 11:21 AM

set it 50 GB

ghstoic•9/2/24, 11:42 AM

Thanks a lot for the reply. Are you referring to 39mins of this video or a diff video? https://www.youtube.com/watch?v=sBFGitIvD2A

YouTubeSECourses

Become A Master Of SDXL Training With Kohya SS LoRAs - Combine Powe...

In this tutorial, you will learn how to install Automatic1111 Web UI for SDXL. How to use LoRAs with Automatic1111 SD Web UI. How to install Kohya SS GUI scripts to do Stable Diffusion training. How to train LoRAs on SDXL model with least amount of VRAM using settings. All of the details, tips and tricks of Kohya trainings. How to do x/y/z plot ...

Gghstoic Thanks a lot for the reply. Are you referring to 39mins of this video or a diff ...

Furkan Gözükara SECourses•9/2/24, 11:44 AM

flux video

Furkan Gözükara SECourses•9/2/24, 11:44 AM

https://youtu.be/nySGu12Y05k

YouTubeSECourses

FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI ...

Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...

FFurkan Gözükara SECourses tell me step speed

daryhead•9/2/24, 11:55 AM

5.65
So it's expected for each Lora training to take somewhere around an hour and a half to two hours?

Ddaryhead 5.65 So it's expected for each Lora training to take somewhere around an hour an...

Furkan Gözükara SECourses•9/2/24, 11:59 AM

on that gpu yes

Furkan Gözükara SECourses•9/2/24, 11:59 AM

rtx 4090 faster than 2x :d

FFurkan Gözükara SECourses https://youtu.be/nySGu12Y05k

ghstoic•9/2/24, 11:59 AM

Thanks, I followed it and restarted PC but same error still persists. Surprised it could be a RAM issue as I didn't get this issue before and am trying Rank_4 config (17gb) on a RTX 3090 with 24gb vram

Furkan Gözükara SECourses•9/2/24, 11:59 AM

you can also rent multiple

Gghstoic Thanks, I followed it and restarted PC but same error still persists. Surprised ...

Furkan Gözükara SECourses•9/2/24, 11:59 AM

can you send me your json file from private mesage

ghstoic•9/2/24, 12:00 PM

sure

Charkel•9/2/24, 12:17 PM

I'm trying to run on kaggle but i get an error with the backend after I am doing the cancel run and restarting

CCharkel I'm trying to run on kaggle but i get an error with the backend after I am doing...

Furkan Gözükara SECourses•9/2/24, 12:18 PM

yes kaggle broken

Charkel•9/2/24, 12:18 PM

Furkan Gözükara SECourses•9/2/24, 12:18 PM

here : https://github.com/pytorch/pytorch/issues/134929

GitHub

On Kaggle : libcusparse.so.12: undefined symbol: __nvJitLinkComplet...

Describe the bug I have tried everything but no luck Waiting your inputs to try more I tried torch 2.4.0, 2.5 - dev, cu 118, cu121 and cu124 - all same error This below code - I got the same erro...