Software Engineering Courses (SECourses)•3y ago

Hello guys. I'm new to the discord and wanted to ask for information. I'm having a big problem these

Hello guys. I'm new to the discord and wanted to ask for information. I'm having a big problem these days, trying to train the lora sdxl on colab. Do you know who could give me a hand?

MaxOP•12/22/23, 11:51 PM

Thanks in advice

MMetaphysix I used your crop & resizer tool and made them 896x1152, It's still using 14.9 GB...

Furkan Gözükara SECourses•12/22/23, 11:52 PM

great

JJozsef I get 1.2s/it on my 4090, that is why I was wondering why it's slower on a p100

Furkan Gözükara SECourses•12/22/23, 11:53 PM

1.2 s / it is great

MMax Hello guys. I'm new to the discord and wanted to ask for information. I'm having...

Furkan Gözükara SECourses•12/22/23, 11:53 PM

welcome

Furkan Gözükara SECourses•12/22/23, 11:53 PM

sadly i have no colab for sdxl

Furkan Gözükara SECourses•12/22/23, 11:53 PM

but we have automatic1111 web ui for kaggle

Furkan Gözükara SECourses•12/22/23, 11:53 PM

supports all controlnet and sdxl

Llucy @Dr. Furkan Gözükara have you tried multi gpu lora training with kohya? `ddp_buc...

Furkan Gözükara SECourses•12/22/23, 11:54 PM

i did multi sdxl dreambooth and lora training on kaggle

Furkan Gözükara SECourses•12/22/23, 11:54 PM

he is making some fixes to multi gpu recently

FFurkan Gözükara SECourses supports all controlnet and sdxl

MaxOP•12/22/23, 11:55 PM

hi furkan! Thanks for answering me

I also recently tried to use kaggle, but unfortunately I saw that they blocked it and it no longer works. Is there a way to bypass it? Thank you

FFurkan Gözükara SECourses i did multi sdxl dreambooth and lora training on kaggle

lucy•12/22/23, 11:56 PM

so how did you get it to actually offload across multiple gpus? I tried accelerate config, accelerate arguments etc

MMax hi furkan! Thanks for answering me 🙂 I also recently tried to use kaggle, but u...

Furkan Gözükara SECourses•12/23/23, 12:04 AM

yes

Furkan Gözükara SECourses•12/23/23, 12:04 AM

there is bypass

Furkan Gözükara SECourses•12/23/23, 12:04 AM

on kaggle

Llucy so how did you get it to actually offload across multiple gpus? I tried accelera...

Furkan Gözükara SECourses•12/23/23, 12:04 AM

it auto does that on kaggle

Furkan Gözükara SECourses•12/23/23, 12:04 AM

now on runpod as well

Furkan Gözükara SECourses•12/23/23, 12:04 AM

our kaggle notebooks : https://www.patreon.com/collection/258108?view=expanded

FFurkan Gözükara SECourses on kaggle

MaxOP•12/23/23, 12:05 AM

Sorry for asking but I've been going crazy for a week. Could you tell me how to solve it please?

lucy•12/23/23, 12:05 AM

well I'm on local hardware haha, would've loved to know what runpod and kaggle do, that just scales across GPUs, though they might be just in SLI/nvlink

BB0nd Whats the best tool for scanning a large dataset folder for duplicate images? (S...

Furkan Gözükara SECourses•12/23/23, 12:22 AM

vector based search

Furkan Gözükara SECourses•12/23/23, 12:22 AM

i have script for this let me share on patreon

B0nd•12/23/23, 12:22 AM

ok amazing thankyou

Llucy well I'm on local hardware haha, would've loved to know what runpod and kaggle d...

Furkan Gözükara SECourses•12/23/23, 12:22 AM

are you trying on kaggle

Furkan Gözükara SECourses•12/23/23, 12:22 AM

or your pc?

FFurkan Gözükara SECourses or your pc?

lucy•12/23/23, 12:30 AM

my own pc

Llucy my own pc

Furkan Gözükara SECourses•12/23/23, 12:30 AM

what gpus you have?

FFurkan Gözükara SECourses what gpus you have?

lucy•12/23/23, 12:34 AM

4090+3060

lucy•12/23/23, 12:38 AM

https://github.com/bmaltais/kohya_ss/issues/521#issuecomment-1496009490

lucy•12/23/23, 12:38 AM

you were part of that discussion, I tried to accelerate config the same way, but all that did was oom my 4090 even on batch 1 lol

BB0nd ok amazing thankyou

Furkan Gözükara SECourses•12/23/23, 12:39 AM

here

Furkan Gözükara SECourses•12/23/23, 12:39 AM

if you want exact duplicate

Furkan Gözükara SECourses•12/23/23, 12:39 AM

set that parameter

Furkan Gözükara SECourses•12/23/23, 12:39 AM

https://www.patreon.com/posts/find-and-move-or-95143007

Furkan Gözükara SECourses•12/23/23, 12:39 AM

set cutoff = 0

Llucy 4090+3060

Furkan Gözükara SECourses•12/23/23, 12:39 AM

hello

Furkan Gözükara SECourses•12/23/23, 12:40 AM

i think it needs duplicate gpu

Furkan Gözükara SECourses•12/23/23, 12:40 AM

for synch

Furkan Gözükara SECourses•12/23/23, 12:40 AM

but not sure

Furkan Gözükara SECourses•12/23/23, 12:40 AM

because it loads model and everything on both gpus

Furkan Gözükara SECourses•12/23/23, 12:40 AM

so your batch size becomes 2

Furkan Gözükara SECourses•12/23/23, 12:41 AM

in 1 step

MaxOP•12/23/23, 12:41 AM

@Dr. Furkan Gözükara sorry if I bother you, but can I ask you if we can do what is in this video without your patreon?
https://www.youtube.com/watch?v=16-b1AjvyBE

YouTubeSECourses

How To Do Stable Diffusion XL (SDXL) DreamBooth Training For Free -...

Master Stable Diffusion XL Training on Kaggle for Free!

Welcome to this comprehensive tutorial where I'll be guiding you through the exciting world of setting up and training Stable Diffusion XL (SDXL) with Kohya on a free Kaggle account. This video is your one-stop resource for learning everything from initiating a Kaggle session with dual ...