Software Engineering Courses (SECourses)•13mo ago

hey quick question, im trying to train a LoRa on Flux, I have a 3060 with 12gb so im using your conf

hey quick question, im trying to train a LoRa on Flux, I have a 3060 with 12gb so im using your config tier 2 for and following the youtube tutorial. I disabled all my start ups and my task manager is showing im using about 3-400mb of memory on my gpu when I start training. Ive reduced my resolution to 512x512, increased block swaps, and tried using the 10gb config. everytime I get a CUDA out of memory error and the training fails

zaiarOP•12/16/24, 2:42 PM

any advice?

ArtChicken•12/16/24, 3:47 PM

does anybody knows if the free kaggle notebook is still good (I'd rather say:"working") at SDXL training? And, if so, a tutorial to use it with the new Kohya interface?

Timson•12/16/24, 5:28 PM

Guys, are the current commit of sd3-flux.1 branch kohya_ss working for you? I swear the branch worked perfectly yesterday, but I'm having this annoying error.

Timson•12/16/24, 5:29 PM

did 2 clean installs with pip cache purging to no avail

Timson•12/16/24, 5:31 PM

also this warning, not shure if they are new or normal

Timson•12/16/24, 5:39 PM

Never mind, I'm just an idiot and forgot --noverify flag, so torch and xformers version reset on gui.sh run. Here goes an hour of my life

D4UNTLESS•12/16/24, 6:57 PM

D4UNTLESS•12/16/24, 6:58 PM

@Timson hi I also used the sd3-flux.1 but am getting this error. You probably fixed this but I don't understand your solution. Could you explain? I'm doing dreambooth training following Furkan's tutorial. I can do lora but on model training, I get this error

DD4UNTLESS Click to see attachment

Timson•12/16/24, 7:30 PM

this is different error, it says CUDA is out of memory, so it probably failed to fit in VRAM whatever you are trying to train

Timson•12/16/24, 7:31 PM

you can use nvitop tool to monitor your GPU status, ensure you have enough of free VRAM to fit all models (flux + t5xxl + clip_l + vae)

Timson•12/16/24, 7:32 PM

around 29 GB for fp16 flux dev

TTimson you can use nvitop tool to monitor your GPU status, ensure you have enough of fr...

D4UNTLESS•12/16/24, 8:03 PM

I used the config that uses 8400mb of vram. I have 12gb 4070 super that had around 10gb free vram. I checked that using nvitop

D4UNTLESS•12/16/24, 8:27 PM

Also, I'm thinking about doing it on massed compute instead. In the tutorial, he said that kohya is not on main branch there. Can I use/switch to this sd3-flux.1 on massed compute?

DD4UNTLESS Also, I'm thinking about doing it on massed compute instead. In the tutorial, he...

Timson•12/16/24, 9:37 PM

I would say doing training in the cloud is the best option unless you can't afford spending a few bucks on this project. It requires more effort though and basic linux administration skills

AArtChicken does anybody knows if the free kaggle notebook is still good (I'd rather say:"wo...