Software Engineering Courses (SECourses)•3y ago

someone i know tried your dreambooth notebook and got this error. do you know what could be wrong?

MMnova someone i know tried your dreambooth notebook and got this error. do you know wh...

Furkan Gözükara SECourses•12/21/23, 8:13 PM

you forgatten to enable gpu

samopopo•12/21/23, 9:34 PM

Furkan where you going for vacation?

samopopo•12/21/23, 9:34 PM

Can I come with you Haha

Ssamopopo Furkan where you going for vacation?

Furkan Gözükara SECourses•12/21/23, 9:39 PM

i dont have any vacation haha

not even weekends

Furkan Gözükara SECourses•12/21/23, 9:39 PM

checkout the newest article : https://medium.com/@furkangozukara/comparison-between-sdxl-full-dreambooth-training-vs-lora-training-vs-lora-extraction-44ada854f1b9

Medium

Comparison Between SDXL Full DreamBooth Training vs LoRA Training v...

Hello everyone. I have trained myself recently by using Kohya GUI latest version. Used official SDXL 1.0 base version.

Deleted User•12/21/23, 9:41 PM

he's always working working working

shortdwarf•12/21/23, 10:27 PM

Anyone know why I always get bad results from Adetailer? Does it only work well on small further faces? On my images where my face is pretty large (think portrait) Adetailer always makes my face look worse, like its set to a higher CFG Scale (its not) I followed the same settings @Dr. Furkan Gözükara used in the SDXL Dreambooth training video. For some reason this has always been my results with Adetailer and I'm not sure what I could be doing wrong

Sshortdwarf Anyone know why I always get bad results from Adetailer? Does it only work well ...

Furkan Gözükara SECourses•12/21/23, 10:48 PM

can you show previous after and your settings?

Furkan Gözükara SECourses•12/21/23, 10:49 PM

i am using adetaler all the time

FFurkan Gözükara SECourses i dont have any vacation haha 😄 not even weekends

Jozsef•12/21/23, 10:49 PM

You are in that same position?

Jozsef•12/21/23, 10:49 PM

AI is hard work, thank you for all these tutorials, I would need 48 hours a day to get everything done.

Jozsef•12/21/23, 10:50 PM

BTW, do you think teaching SDXL style on a realvisXL model would be better? It seems the custom SDXL models are still flexible with prompts more than the 1.5 were.

JJozsef You are in that same position? 😄

Furkan Gözükara SECourses•12/21/23, 10:54 PM

yes D

JJozsef BTW, do you think teaching SDXL style on a realvisXL model would be better? It s...

Furkan Gözükara SECourses•12/21/23, 10:54 PM

sadly didnt have chance to test yet

FFurkan Gözükara SECourses sadly didnt have chance to test yet

Jozsef•12/21/23, 10:55 PM

I'll test it now. Same everything only difference is base vs realvis SDXL

Jozsef•12/21/23, 10:55 PM

The settings already helped me increase the quality by a lot. I just need more steps the next time.

FFurkan Gözükara SECourses checkout the newest article : https://medium.com/@furkangozukara/comparison-betw...

samopopo•12/21/23, 11:03 PM

Awesome keep the work going and don't forget not to burn out

I know it myself

samopopo•12/21/23, 11:07 PM

Can someone share or show us what a high-quality or ultra-high-quality dataset for training looks like for SDXL Dreambooth? For example how many are enough and what ratio between close-up face, upper body, and full body shots is needed? If a photographer takes shots of the subjects what to take care of etc.

Darth Teethius•12/22/23, 2:34 AM

Hello, new to the patreon, looking at the config files and i notice i can't find the network dim or alpha. Is 128/1 still the default we are using here, or is it 128/128?

Diego•12/22/23, 8:40 AM

Hi @Dr. Furkan Gözükara and everyone. My 10 year old nephew wants a cool illustration of himself for xmas so I wan to to do a lora training of him. Can I use the images from the download_man_reg_imgs.sh file? Or is there a child regimages dataset somewhere? Lastly, will the class prompt "man" work in this case or does it have to be "child"? Thanks!

ockhamrazor•12/22/23, 9:39 AM

guys whats the best XL-based model for landscape?

Jozsef•12/22/23, 11:22 AM

The checkpoint that I have thought a style with, now produces that style even without a triggerword. Is that normal? Or is it overtrained?

FFurkan Gözükara SECourses 1280x1536 will use more vram

Metaphysix•12/22/23, 12:29 PM

I used your crop & resizer tool and made them 896x1152, It's still using 14.9 GB VRAM so I switched to P100 GPU, it slow but works just fine.

MMetaphysix I used your crop & resizer tool and made them 896x1152, It's still using 14.9 GB...

Jozsef•12/22/23, 12:32 PM

Is it just me or does that 6s/it for a p100 seem slow?

Metaphysix•12/22/23, 12:35 PM

Idk how fast it should be. For me 4.5h training time for an sdxl dreambooth for free is good enough.

Jozsef•12/22/23, 12:49 PM

Ah, for free. Then it's fine

Jozsef•12/22/23, 12:49 PM

I get 1.2s/it on my 4090, that is why I was wondering why it's slower on a p100

Jozsef•12/22/23, 12:50 PM

Oh wait, p100 isn't that new. Nevermind me.

Jozsef•12/22/23, 12:51 PM

I was thinking about the A100

Metaphysix•12/22/23, 1:15 PM

With kaggle's double gpu it's around 1.3s/it but it has only 14GB Vram

lucy•12/22/23, 3:41 PM

@Dr. Furkan Gözükara have you tried multi gpu lora training with kohya?

ddp_bucket_view

ddp_bucket_view

and the other parameter dont seem to exist even on dev branch

lucy•12/22/23, 3:42 PM

B0nd•12/22/23, 6:00 PM

Whats the best tool for scanning a large dataset folder for duplicate images? (Some duplicates might be different size / res)

Vexmachina•12/22/23, 7:15 PM

So I'm using all the latest instructions and settings, and I'm running training on a 4090 in Runpod. When I watch the video, Dr Furkan gets a total training time of 50m-2h using a 3090 on Runpod. For some reason I'm getting a training time of ~3hours, despite being on a 4090.

Did something change about the training between the video publication and now, making it more intensive? Or am I doing something wrong?

Vexmachina•12/22/23, 7:16 PM

This is with 15 example images, scaled to 1024x1024, and using the reg set of men at 1024x1024 as well.

Pflanzen die Tanzen•12/22/23, 7:17 PM

In the vast expanse of the whimsical world of Widdendream, where every creature was as unique as a snowflake in a winter flurry, there stood two friends: little Lyla Longbeak and the towering Tara Tattercloak. Lyla, with her inquisitive eyes and a beak sharp enough to pick the seeds of wisdom from the fruits of knowledge, gazed up in awe at her friend. Tara, draped in a cloak of midnight blue, tattered at the edges from embracing every thorn and rose life offered, towered above like a gentle giant, her eyes kind pools of understanding.

Together, they were a testament to the beauty of difference, a duo that danced in harmony despite their contrasting tunes. The room they shared was filled with oddities and ends, with hanging cages that held not birds but blooming ideas, and a television that was old and wise, flickering with the stories of yore.

"See, Lyla," Tara's voice rustled like the leaves of an ancient tree, "we are like these cages, different in size and shape, yet home to ideas just as bright and beautiful." Lyla nodded, her heart swelling with the warmth of acceptance.

Their friendship was a mosaic, a splendid tapestry woven from threads of myriad textures and hues, teaching all who visited Widdendream that diversity was not just to be tolerated, but celebrated, for it was the very essence of life's enchanting tapestry.

VVexmachina So I'm using all the latest instructions and settings, and I'm running training ...

mtnmecca•12/22/23, 8:06 PM

this is typical of my 4090. He may have used xformers which I do not since I want higher quality

Mmtnmecca this is typical of my 4090. He may have used xformers which I do not since I wa...

Vexmachina•12/22/23, 8:16 PM

Gotcha, thanks for the reply!

Antek•12/22/23, 9:27 PM

Looking for the best workflow for a apparell mockup task:
I have a t-shirt design in transparent png and want to insert it onto a person wearing a plain t-shirt. The person is in a dynamic pose, so I need to get the shading, wrinkles done right.

Hope you can give me advice on how to approach this

stillmotion•12/22/23, 10:47 PM

Anyone messed around with training TI embeddings? Trying to figure out why my TI + LoRA results are coming out with artifacts and over saturation. Seems like it could be a scheduler issue or VAE, but not sure right now.

Vexmachina•12/22/23, 10:54 PM

Is there a general rule for how well dreambooth training scales with multi-gpu? I used Dr Furkan's guide on a single 4090 and it took about 3 hours, decided to try it with a 6x 4090 setup, spawned it from cli with

accelerate launch --num_cpu_threads_per_process=4 --num_processes=6 --multi_gpu --num_machines=1 --gpu_ids=0,1,2,3,4,5 "./sdxl_train.py"

accelerate launch --num_cpu_threads_per_process=4 --num_processes=6 --multi_gpu --num_machines=1 --gpu_ids=0,1,2,3,4,5 "./sdxl_train.py"

... and the training only went down to 2 1/2 hours.

stillmotion•12/22/23, 10:58 PM

you need to increase the batch size when doing multi gpu

stillmotion•12/22/23, 10:58 PM

ie. increase the number of images processed at a time

Vexmachina•12/22/23, 11:06 PM

Thanks, testing it now with a batch size of 6. I googled that earlier and the top comment I found said you want to keep a small batch size for multi gpu in order to make sure each GPU is always fully utilized, confusing

Vexmachina•12/22/23, 11:14 PM

Hmm, so setting

--train_batch_size="2"

--train_batch_size="2"

to anything higher than 2 leads to it crashing due to out of memory errors. However, with a batch size of 2 it went to a 4 hour estimate, whereas it was at 2.5 hours @ batch size of 1.

Vexmachina•12/22/23, 11:37 PM

Hmm, could this be related? It seems like with 6 processes, batch size of 2 and multi-gpu enabled, I get 96 epochs and 100 batches per epoch. But with 1 process, batch size of 1 and multi-gpu disabled, I get 8 epochs @ 1200 batches per epoch.

num examples / サンプル数: 600
  num batches per epoch / 1epochのバッチ数: 100
  num epochs / epoch数: 96
  batch size per device / バッチサイズ: 2
  gradient accumulation steps / 勾配を合計するステップ数 = 1
  total optimization steps / 学習ステップ数: 9600

num examples / サンプル数: 600
  num batches per epoch / 1epochのバッチ数: 100
  num epochs / epoch数: 96
  batch size per device / バッチサイズ: 2
  gradient accumulation steps / 勾配を合計するステップ数 = 1
  total optimization steps / 学習ステップ数: 9600

running training / 学習開始
  num examples / サンプル数: 600
  num batches per epoch / 1epochのバッチ数: 1200
  num epochs / epoch数: 8
  batch size per device / バッチサイズ: 1
  gradient accumulation steps / 勾配を合計するステップ数 = 1
  total optimization steps / 学習ステップ数: 9600

running training / 学習開始
  num examples / サンプル数: 600
  num batches per epoch / 1epochのバッチ数: 1200
  num epochs / epoch数: 8
  batch size per device / バッチサイズ: 1
  gradient accumulation steps / 勾配を合計するステップ数 = 1
  total optimization steps / 学習ステップ数: 9600

Vexmachina•12/22/23, 11:42 PM

GPUs are being heavily utilized with 6 processes, batch size 2, multi-gpu. So it's not like they aren't doing anything. And yet, it's gonna take 4 hours and 15 minutes like this. Whereas with a single GPU it takes 3 hours.

Vexmachina•12/22/23, 11:42 PM

1.6s/it with 6 GPU, 1.07s/it with 1 GPU.

Furkan Gözükara SECourses•12/22/23, 11:48 PM

ok time to check messages

DDarth Teethius Hello, new to the patreon, looking at the config files and i notice i can't find...

Furkan Gözükara SECourses•12/22/23, 11:49 PM

hello welcome

num examples / サンプル数: 600 num batches per epoch / 1epochのバッチ数: 100 num epochs / epoch数: 96 batch size per device / バッチサイズ: 2 gradient accumulation steps / 勾配を合計するステップ数 = 1 total optimization steps / 学習ステップ数: 9600

running training / 学習開始 num examples / サンプル数: 600 num batches per epoch / 1epochのバッチ数: 1200 num epochs / epoch数: 8 batch size per device / バッチサイズ: 1 gradient accumulation steps / 勾配を合計するステップ数 = 1 total optimization steps / 学習ステップ数: 9600

someone i know tried your dreambooth notebook and got this error. do you know what could be wrong?

Similar Threads