Software Engineering Courses (SECourses)•3y ago

Do the following work for both dreambooth, Lora, Textual inversion: Basic Captioning BLIP Captioning

Do the following work for both dreambooth, Lora, Textual inversion:
Basic Captioning
BLIP Captioning
GIT Captioning
WED14 Captioning
Manual Captioning

Or are the specific to each?

AAndyWear Do the following work for both dreambooth, Lora, Textual inversion: Basic Captio...

Furkan Gözükara SECourses•12/12/23, 11:33 PM

yes all works

Furkan Gözükara SECourses•12/12/23, 11:33 PM

it just different results

FFurkan Gözükara SECourses yes all works

AndyWearOP•12/12/23, 11:34 PM

are there strength and weaknesses for them or do most just use BLIP?

AAndyWear are there strength and weaknesses for them or do most just use BLIP?

Furkan Gözükara SECourses•12/13/23, 12:18 AM

yes each one fits

Furkan Gözükara SECourses•12/13/23, 12:18 AM

different cases

Furkan Gözükara SECourses•12/13/23, 12:18 AM

i try them

Josh•12/13/23, 7:27 PM

Hello Dr. Furkan, i followed your tutorial to get a lora trained using a rtx 4090 gpu, but at my studio we are wanting to use multi-gpu training for sdxl, ive run into issues trying to configure kohya ss to do this properly (it ends up running into a memory issue after maxing out the memory of the first gpu), would you be willing to help me with this issue?

JJosh Hello Dr. Furkan, i followed your tutorial to get a lora trained using a rtx 409...

Furkan Gözükara SECourses•12/14/23, 12:24 AM

yes

Furkan Gözükara SECourses•12/14/23, 12:24 AM

i am giving private consultation and i can help

Furkan Gözükara SECourses•12/14/23, 12:24 AM

but gpus are on same machine right?

Josh•12/14/23, 1:06 AM

yea theyre on the same machine

JJosh yea theyre on the same machine

Furkan Gözükara SECourses•12/14/23, 1:12 AM

then i can help

Josh•12/14/23, 4:49 AM

Thank you! when can we talk about it?

JJosh Thank you! when can we talk about it?

Furkan Gözükara SECourses•12/14/23, 7:51 PM

i am available for several hours more from now on

Josh•12/14/23, 9:01 PM

Josh•12/14/23, 9:02 PM

@Furkan Gözükara SECourses These are the configure settings I use, am I doing anything wrong here to where I will hit a memory road block while training?

JJosh Click to see attachment

Furkan Gözükara SECourses•12/14/23, 9:16 PM

looking good

Josh•12/14/23, 9:28 PM

@Furkan Gözükara SECourses here are my training settings

JJosh <@205854764540362752> here are my training settings

Furkan Gözükara SECourses•12/14/23, 9:31 PM

sadly i dont have best settings for SD 1.5

Josh•12/14/23, 9:32 PM

i was using your settings for sdxl lora training

JJosh i was using your settings for sdxl lora training

Furkan Gözükara SECourses•12/14/23, 9:33 PM

ah yes they are decent but not very best

Furkan Gözükara SECourses•12/14/23, 9:33 PM

best is SDXL DreamBooth

Josh•12/14/23, 9:33 PM

oh i see

Josh•12/14/23, 9:34 PM

@Furkan Gözükara SECourses do you know what would cause these errors?

JJosh <@205854764540362752> do you know what would cause these errors?

Furkan Gözükara SECourses•12/14/23, 9:35 PM

your install selections

Furkan Gözükara SECourses•12/14/23, 9:36 PM

or better

Furkan Gözükara SECourses•12/14/23, 9:36 PM

delete your accelerator settings

Furkan Gözükara SECourses•12/14/23, 9:36 PM

it shows at the end where it is saved

Furkan Gözükara SECourses•12/14/23, 9:36 PM

delete this

Josh•12/14/23, 9:37 PM

ill try that, thank you

Josh•12/14/23, 9:40 PM

@Furkan Gözükara SECourses hmm i still seem to be getting the error

JJosh <@205854764540362752> hmm i still seem to be getting the error

Furkan Gözükara SECourses•12/14/23, 9:44 PM

you have 3 gpus?

Josh•12/14/23, 9:45 PM

yes

JJosh yes

Furkan Gözükara SECourses•12/14/23, 9:45 PM

well your setup wrong

Furkan Gözükara SECourses•12/14/23, 9:45 PM

i can professionally help

Furkan Gözükara SECourses•12/14/23, 9:45 PM

or you can limit to 1 gpu

Furkan Gözükara SECourses•12/14/23, 9:45 PM

easily

Furkan Gözükara SECourses•12/14/23, 9:46 PM

set CUDA_VISIBLE_DEVICES=0

Furkan Gözükara SECourses•12/14/23, 9:46 PM

add this to .bat file

Josh•12/14/23, 9:46 PM

yea, i understand how to limit it to one gpu, but i would like to set it up for 3 gpu's

JJosh yea, i understand how to limit it to one gpu, but i would like to set it up for ...

Furkan Gözükara SECourses•12/14/23, 9:46 PM

are your gpus same?

Josh•12/14/23, 9:46 PM

is that do-able?

Furkan Gözükara SECourses•12/14/23, 9:46 PM

what are they

Josh•12/14/23, 9:46 PM

theyre all 4090's

Furkan Gözükara SECourses•12/14/23, 9:46 PM

ye i think should work

Josh•12/14/23, 9:47 PM

what would i need to change to get that to work?

JJosh what would i need to change to get that to work?

Furkan Gözükara SECourses•12/14/23, 9:49 PM

Don't know. I have to connect your pc and figure out

Josh•12/14/23, 9:51 PM

im not sure that my workplace would be comfortable with that, we deal with a lot of proprietary information, is there any other way to go about it?

Lirezh (cmp-nct)•12/15/23, 1:26 AM

@Josh It's the pytorch package I think, all the libraries in python are a hellish mess.
You can try to find a package that contains the distributed compilation code, you can set your configuration to single_gpu or you can move it into WSL.
I think going WSL is the best option

Josh•12/15/23, 3:09 AM

@Lirezh (cmp-nct) im a bit new to this, how would i go about doing that?

Do the following work for both dreambooth, Lora, Textual inversion: Basic Captioning BLIP Captioning

Similar Threads

Similar Threads

Similar Threads