Software Engineering Courses (SECourses)•2y ago

How big to be exact? Do I need 100+ image? or 1000+? And for the captions, is it ok to use caption

How big to be exact?

Do I need 100+ image? or 1000+?
And for the captions, is it ok to use captioning tools such as blip or wd1.4? It seems impossible to manually caption thousands of images. Thanks.

Hhighjourney How big to be exact? Do I need 100+ image? or 1000+? And for the captions, is ...

Furkan Gözükara SECourses•7/29/24, 9:37 AM

you want to do a model like real vis XL 4?

Furkan Gözükara SECourses•7/29/24, 9:38 AM

you need 10s of thousands high quality image to fine to SDXL base into such model

Furkan Gözükara SECourses•7/29/24, 9:38 AM

you can use CogVLM for captioning

Furkan Gözükara SECourses•7/29/24, 9:38 AM

especially CogVLM v2

highjourneyOP•7/29/24, 9:51 AM

I'm wondering if the Dreambooth method would be effective for training with 10,000 high-quality images. Based on the publicly available SDXL base model, there are various fine-tuning methods such as Dreambooth, LoRA, HyperNetwork, and Textual Inversion. From what I know, Dreambooth seems to be the most appropriate. I would appreciate it if you could share any specifically recommended methods for the final training process you emphasized, or if there are any noteworthy precedents for training with such a large dataset.
(P.S. I've watched all of your fine-tuning tutorial videos on YouTube multiple times. I'm a big fan! Thank you!)

Hhighjourney I'm wondering if the Dreambooth method would be effective for training with 10,0...

Furkan Gözükara SECourses•7/29/24, 10:31 AM

dreambooth without class images = fine tuning

Furkan Gözükara SECourses•7/29/24, 10:31 AM

it is best method

highjourneyOP•7/29/24, 10:32 AM

by without class images you mean without regularization images right?

Hhighjourney by without class images you mean without regularization images right?

Furkan Gözükara SECourses•7/29/24, 10:34 AM

yep

Furkan Gözükara SECourses•7/29/24, 10:34 AM

class = reg same meaning

highjourneyOP•7/29/24, 10:44 AM

Okay thanks a lot! Lastly, I'm curious if it would be appropriate to use a dynamic optimizer in this case as well. I've consistently used the Prodigy optimizer and cosine LR scheduler with LoRA, and I'm wondering if they would be effective when training with a large number of images.
Of course, frequent experimentation should be prioritized, but it would be greatly helpful if there's any guidance on where to set the starting point. Thank you!

Hhighjourney Okay thanks a lot! Lastly, I'm curious if it would be appropriate to use a dynam...

Furkan Gözükara SECourses•7/29/24, 10:54 AM

i tested them and i found adafactor works better

Furkan Gözükara SECourses•7/29/24, 10:54 AM

but it is a choice

Furkan Gözükara SECourses•7/29/24, 10:54 AM

before doing a big training

Furkan Gözükara SECourses•7/29/24, 10:54 AM

make smaller ones and see if works

highjourneyOP•7/29/24, 11:40 AM

Thanks bunch. I'll try smaller version first and share the results if it turns out to be ok.

FFurkan Gözükara SECourses yep

sergio_gonzo•7/29/24, 7:21 PM

Dr Furkan iS POSIBLE TO USE STABLE DIFUSION 3 for training in one trainer?

Ssergio_gonzo Dr Furkan iS POSIBLE TO USE STABLE DIFUSION 3 for training in one trainer?

Furkan Gözükara SECourses•7/29/24, 8:47 PM

i think yes

Furkan Gözükara SECourses•7/29/24, 8:47 PM

but i havent had chance yet

Furkan Gözükara SECourses•7/29/24, 8:47 PM

i plan hopefully soon

FFurkan Gözükara SECourses i think yes

sergio_gonzo•7/29/24, 10:19 PM

THank you you are very kind

Ssergio_gonzo THank you you are very kind

Furkan Gözükara SECourses•7/29/24, 10:50 PM

you are welcome

SnicksterJay•7/29/24, 11:48 PM

I'm having trouble adding models to Kohya. Want to add real vis XL 4 but can't find where to put the safetesnor file I downloaded

SSnicksterJay I'm having trouble adding models to Kohya. Want to add real vis XL 4 but can't ...

Furkan Gözükara SECourses•7/29/24, 11:49 PM

where did you download windows=?

SnicksterJay•7/29/24, 11:49 PM

Runnin Kohya through stability matrix

SnicksterJay•7/29/24, 11:49 PM

I'm on windows 11

SSnicksterJay Runnin Kohya through stability matrix

Furkan Gözükara SECourses•7/29/24, 11:51 PM

ok just give your path

Furkan Gözükara SECourses•7/29/24, 11:51 PM

by the way i dont suggest stability matrix

SnicksterJay•7/29/24, 11:53 PM

Ok, my path to Kohya? Just not sure where to drop the safetensor file into. I tried to put it in Kohya's models folder already but it's not showing up in Kohya

SnicksterJay•7/29/24, 11:53 PM

C:\StabilityMatrix\Data\Packages\kohya_ss

SSnicksterJay Ok, my path to Kohya? Just not sure where to drop the safetensor file into. I tr...

Furkan Gözükara SECourses•7/29/24, 11:53 PM

please watch this tutorial

Furkan Gözükara SECourses•7/29/24, 11:53 PM

https://youtu.be/sBFGitIvD2A

YouTubeSECourses

Become A Master Of SDXL Training With Kohya SS LoRAs - Combine Powe...

In this tutorial, you will learn how to install Automatic1111 Web UI for SDXL. How to use LoRAs with Automatic1111 SD Web UI. How to install Kohya SS GUI scripts to do Stable Diffusion training. How to train LoRAs on SDXL model with least amount of VRAM using settings. All of the details, tips and tricks of Kohya trainings. How to do x/y/z plot ...

Furkan Gözükara SECourses•7/29/24, 11:53 PM

it is for lora but only cofig changes when doing dreambooth

FFurkan Gözükara SECourses by the way i dont suggest stability matrix

SnicksterJay•7/29/24, 11:55 PM

I just use matrix as a one stop shop and everything is mostly organised, most models are shared between all programs but Kohya doesn't share them for me. thanks alot for the link

SSnicksterJay I just use matrix as a one stop shop and everything is mostly organised, most mo...

Furkan Gözükara SECourses•7/29/24, 11:55 PM

you are welcome

masoke•7/30/24, 6:56 PM

Hi everyone, I just saw these tutorials (The END of Photography, Ultimate RunPod Tutorial For Stable Diffusion) and I want to know if there is any documentation explaining how to use automatic1111 and dreambooth in Runpod but using endpoints.

Mmasoke Hi everyone, I just saw these tutorials** (The END of Photography, Ultimate RunP...

Furkan Gözükara SECourses•7/30/24, 8:17 PM

hi welcome

Furkan Gözükara SECourses•7/30/24, 8:17 PM

as i replied on patreon

Furkan Gözükara SECourses•7/30/24, 8:17 PM

i never tried serverless

Furkan Gözükara SECourses•7/30/24, 8:17 PM

it is useful only for compaines

Luka_T•7/31/24, 5:03 AM

Any tips for cartoon character lora training?
Which caption approach and which caption tool would you advise?
Running locally on 16G vram, 4080. Using Kohya.
@Furkan Gözükara SECourses no rush, tagging for visibility.

JP525•7/31/24, 7:09 AM

Hi everyone. I just finished learning basics of python. I wanna build up my experience, so I hope I can work on real-world projects for free. How can I get that kind of opportunity?