Software Engineering Courses (SECourses)•2y ago

I'm currently at xformers: 0.0.22.dev597. Any experience with newer version @Dr. Furkan Gözükara ?

KKallamamran I'm currently at xformers: 0.0.22.dev597. Any experience with newer version @Dr....

Furkan Gözükara SECourses•12/28/23, 8:44 PM

well in my tests

Furkan Gözükara SECourses•12/28/23, 8:44 PM

i didnt get better

Furkan Gözükara SECourses•12/28/23, 8:44 PM

actually i recently tested

KallamamranOP•12/28/23, 8:44 PM

Yeah thought so

KallamamranOP•12/28/23, 8:44 PM

Same with older versions. Not much difference

Furkan Gözükara SECourses•12/28/23, 8:45 PM

yes

Furkan Gözükara SECourses•12/28/23, 8:46 PM

currently testing multi gpu training improvement on kaggle

KallamamranOP•12/28/23, 8:47 PM

Just noticed torch 2.1.2 is realeased as well

KallamamranOP•12/28/23, 8:47 PM

And Gradio 4.12.0

Furkan Gözükara SECourses•12/28/23, 9:05 PM

probably will break your existing apps

Furkan Gözükara SECourses•12/28/23, 9:05 PM

new kaggle training

Furkan Gözükara SECourses•12/28/23, 9:05 PM

i am expecting 2100 steps to train good enough

Furkan Gözükara SECourses•12/28/23, 9:05 PM

Mmikemenders I think it will run on Realistic Vision 5.1, and the trained Lora will also run ...

Squid•12/28/23, 9:15 PM

many thanks, I must try SDXL train soon too :nodblue: do you usually use reg imgs from DR.furkan's patron?

lieutenant_mac•12/28/23, 9:21 PM

Hello, just joined this Discord server. Not sure if this is old news that for lora training captions were not found due to wrong file extension? I was following this turorial: https://www.youtube.com/watch?v=AY6DMBCIZ3A

YouTubeSECourses

First Ever SDXL Training With Kohya LoRA - Stable Diffusion XL Trai...

Updated for SDXL 1.0. How to install #Kohya SS GUI trainer and do #LoRA training with Stable Diffusion XL (#SDXL) this is the video you are looking for. I have shown how to install Kohya from scratch. The best parameters to do LoRA training with SDXL. How to use Kohya SDXL LoRAs with ComfyUI. How to do checkpoint comparison with SDXL LoRAs and m...

Llieutenant_mac Hello, just joined this Discord server. Not sure if this is old news that for lo...

Furkan Gözükara SECourses•12/28/23, 9:23 PM

hello

Furkan Gözükara SECourses•12/28/23, 9:23 PM

welcome

Max•12/28/23, 9:28 PM

Guys, a question, what should you use for checkpoints for hyperrealism?

SOPRO•12/28/23, 9:30 PM

is my lora realistic?

263333-4045924025-30-DPM_2M_Karras-1408-serenity_v2.png

SSOPRO is my lora realistic?

Furkan Gözükara SECourses•12/28/23, 9:33 PM

looks really good

MMax Guys, a question, what should you use for checkpoints for hyperrealism?

Furkan Gözükara SECourses•12/28/23, 9:33 PM

I use SDXL 1.0 really works good

FFurkan Gözükara SECourses I use SDXL 1.0 really works good

Max•12/28/23, 9:34 PM

thank YOU!

SSquid many thanks, I must try SDXL train soon too :nodblue: do you usually use reg im...

mikemenders•12/28/23, 9:34 PM

Yes, I use Furkan's reg images, that's best collection!

AIGambino•12/28/23, 10:29 PM

Any idea why my character doesnt have the same style as this guys?
https://www.youtube.com/watch?v=2mUEeeoA6G8
I'm using same settings and checkpoint

YouTubeSebastian Torres

Ai Animation in Stable Diffusion

The Method I use to get consistent animated characters with stable diffusion. BYO video and it's good to go!

Sign up to my Newsletter for the companion PDF with all the links needed to play along.
http://www.sebastiantorres.com.au/newsletter/

Add LCM to Automatic 1111
https://github.com/light-and-ray/sd-webui-lcm-sampler

You're awesome! Than...

AIGambino•12/28/23, 10:29 PM

KallamamranOP•12/28/23, 10:47 PM

@Dr. Furkan Gözükara Why 1536x1536 pixel images in the datasets? Training above 1024 is not a good idea right?!

KKallamamran @Dr. Furkan Gözükara Why 1536x1536 pixel images in the datasets? Training above ...

Alexm•12/28/23, 10:56 PM

it doesnt matter because of bucketing, they will get resized automatically to fit

Alexm•12/28/23, 11:06 PM

just wanted to ask if some people on here use 4090s for dreambooth training in kohya and their experience? I noticed that on runpod, a 4090 is a lot slower than a 3090ti and im trying to figure out if this is a issue on runpod or with a 4090 overall. Ive seen some issues posted on the kohya github about 4090s being slow, but im not sure if this is still the case

FFurkan Gözükara SECourses must watch video : https://youtu.be/-NjNy7afOQ0

banfi6885•12/28/23, 11:22 PM

Hello Furkan, I have watched this video a couple of times and followed the instructions.

I have installed torch using the following command:
pip3 install torch==2.1.0 torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118

and transformers using the following command:
pip install xformers==0.0.23

I also edit webui-user.bat to use xformers:
set COMMANDLINE_ARGS=--xformers

With pip install xformers==0.0.23, I get the following:

Installing collected packages: torch, xformers
Attempting uninstall: torch
Found existing installation: torch 2.1.0+cu118
Uninstalling torch-2.1.0+cu118:
Successfully uninstalled torch-2.1.0+cu118
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
torchvision 0.16.0+cu118 requires torch==2.1.0+cu118, but you have torch 2.1.1 which is incompatible.
torchaudio 2.1.0+cu118 requires torch==2.1.0+cu118, but you have torch 2.1.1 which is incompatible.
Successfully installed torch-2.1.1 xformers-0.0.23

And when I execute webiu-user.bat, I get the following:
RuntimeError: Torch is not able to use GPU; add --skip-torch-cuda-test to COMMANDLINE_ARGS variable to disable this check

Is there something I am overlooking?

Thank you

Alexm•12/28/23, 11:38 PM

is it possible to train dreambooth on kohya with 24gig of vram? no matter what i try, it keeps running oom with 8bitadam

allen•12/29/23, 3:20 AM

@Dr. Furkan Gözükara Hey there - it seems there is an issue with download the runpod installer for your caption scripts

allen•12/29/23, 3:20 AM

allen•12/29/23, 3:20 AM

https://www.patreon.com/posts/sota-very-best-90744385

AAlexm is it possible to train dreambooth on kohya with 24gig of vram? no matter what i...

allen•12/29/23, 3:22 AM

are you using the runpod kohya template by any chance? i had never noticed until watching the good dr's video that if you don't kill auto1111, 25-30% of the vram is getting sucked up before you start

allen•12/29/23, 3:23 AM

i typically just reduce the batch size until it works, or throw on xformers, but i'm going to retry a few of them without cheating since apparently its bad juju

allen•12/29/23, 3:29 AM

@Dr. Furkan Gözükara aha, it's in the zip file at the end. maybe remove the 3 apparent links in that article when you have a sec

DigitalArt_Lover•12/29/23, 7:58 AM

can anyone, help me fix this??
maybe this is the reason, my gpu isnt using full potential, while running the training!!

DDigitalArt_Lover can anyone, help me fix this?? maybe this is the reason, my gpu isnt using full ...

Lorelai AI•12/29/23, 8:09 AM

Looks at potential to me, what are you looking at? You should update Kohya to 22.3 though

LLorelai AI Looks at potential to me, what are you looking at? You should update Kohya to 22...

DigitalArt_Lover•12/29/23, 8:22 AM

Oh, i see, yeah, let me do it as well. potential, means, when i run training, it doesnt take load on gpu it should take....usually, when the temperature gets higher, when the gpu is totally using it's power, but when i run training, with kohya, it only gets half of the temperature, compared to it usually takes.

LLorelai AI Looks at potential to me, what are you looking at? You should update Kohya to 22...

Benjamin•12/29/23, 8:23 AM

since today there's 22.4

BBenjamin since today there's 22.4

Lorelai AI•12/29/23, 8:23 AM

oohhhh

What changes?

DigitalArt_Lover•12/29/23, 8:24 AM

Oh, i can just edit the bat file and add autoupdate, it should update automatically, everytime it runs?

LLorelai AI oohhhh 🙂 What changes?

Benjamin•12/29/23, 8:24 AM

https://github.com/bmaltais/kohya_ss/releases/tag/v22.4.0

GitHub

Release v22.4.0 · bmaltais/kohya_ss

2023/12/28 (v22.4.0)

Fixed to work tools/convert_diffusers20_original_sd.py. Thanks to Disty0! PR #1016
The issues in multi-GPU training are fixed. Thanks to Isotr0py! PR #989 and #1000

--ddp_gr...

Lorelai AI•12/29/23, 8:24 AM

Ohhh seems useless unless you're running more than one GPU

Benjamin•12/29/23, 8:25 AM

PagedAdamW added as optimizer and for the rest mostly fixes, but also some new options for sampling

Lorelai AI•12/29/23, 8:26 AM

Ok now im interested, whats pagedadamw

Lorelai AI•12/29/23, 8:27 AM

ok yeah im about to do a training it looks interesting

Lorelai AI•12/29/23, 8:35 AM

WWhat's the command to update Kohya again I forgot?

Lorelai AI•12/29/23, 8:37 AM

nevermind just a git pull

I'm currently at xformers: 0.0.22.dev597. Any experience with newer version @Dr. Furkan Gözükara ?

Similar Threads