Software Engineering Courses (SECourses)•3y ago

sorry for asking, i am running the dreambooth version where i can select from "8bit AdamW", "Torch A

sorry for asking, i am running the dreambooth version where i can select from "8bit AdamW", "Torch AdamW" & "Lion" - you did some excessiv testing. what was the best option?

Nn8hawk_sorry for asking, i am running the dreambooth version where i can select from "8...

Furkan Gözükara SECourses•3/24/23, 10:49 PM

I prefer lion

FFurkan Gözükara SECourses I prefer lion

n8hawk_OP•3/24/23, 10:50 PM

thank you!

n8hawk_OP•3/24/23, 10:57 PM

uuuh- 12gb aree not enough

felixsanz•3/24/23, 11:03 PM

@Furkan Gözükara SECourses you should explore this!

felixsanz•3/24/23, 11:03 PM

LoRA: The classic. You can use it in your webui no problem.

LoCon: Has more learning layers, it is reportedly good at artstyles.

LoHa: Has more layers and new mathematical algorithms. Takes much longer but can learn complex things such as styles and characters at the same time.

felixsanz•3/24/23, 11:04 PM

maybe it helps for your animation video, but also for another comparision video

Nn8hawk_uuuh- 12gb aree not enough😫

Furkan Gözükara SECourses•3/24/23, 11:22 PM

12 gb is good for dreambooth

Ffelixsanz LoRA: The classic. You can use it in your webui no problem. LoCon: Has more lea...

Furkan Gözükara SECourses•3/24/23, 11:22 PM

yes web ui supporting that

Furkan Gözükara SECourses•3/24/23, 11:22 PM

actually they gonna make even further improvement

Furkan Gözükara SECourses•3/24/23, 11:22 PM

i am waiting that for video

Furkan Gözükara SECourses•3/24/23, 11:22 PM

currently working on animation video with dreambooth

Furkan Gözükara SECourses•3/24/23, 11:23 PM

having consistency + strong style is the hardest thing to achieve

FFurkan Gözükara SECourses 12 gb is good for dreambooth

n8hawk_OP•3/25/23, 12:17 AM

yeah, i know- we share the same grafikcard

but using lion seemed to be to much for the card. i did not use xformers as well.

Nn8hawk_yeah, i know- we share the same grafikcard 😉 but using lion seemed to be to muc...

Furkan Gözükara SECourses•3/25/23, 12:30 AM

well we have to use xformers

Furkan Gözükara SECourses•3/25/23, 12:30 AM

no other option

Furkan Gözükara SECourses•3/25/23, 12:44 AM

batch processing frames taking time

n8hawk_OP•3/25/23, 12:48 AM

is there a missunderstanding?

Nn8hawk_is there a missunderstanding?

Furkan Gözükara SECourses•3/25/23, 12:51 AM

yes you have to use xformers for 12gb vram

n8hawk_OP•3/25/23, 12:51 AM

right now i do not use it- with the 3060..

Nn8hawk_right now i do not use it- with the 3060..

Furkan Gözükara SECourses•3/25/23, 12:53 AM

wow it works?

Furkan Gözükara SECourses•3/25/23, 12:53 AM

they must have improved memory usage

Furkan Gözükara SECourses•3/25/23, 12:53 AM

or you are using torch 2

Furkan Gözükara SECourses•3/25/23, 12:53 AM

recently i have been testing on runpod :d

n8hawk_OP•3/25/23, 12:56 AM

python: 3.10.6 • torch: 2.0.0+cu118 • xformers: 0.0.17+b6be33a.d20230315 • gradio: 3.16.2 • commit: a9fed7c3 • checkpoint: a2ac9a57f3
i will compare the results to the last training once it is finished. same input images and class images

Nn8hawk_python: 3.10.6 • torch: 2.0.0+cu118 • xformers: 0.0.17+b6be33a.d20230315 • ...

Furkan Gözükara SECourses•3/25/23, 1:08 AM

torch 2 has default xformers

Furkan Gözükara SECourses•3/25/23, 1:08 AM

i think that is the key

n8hawk_OP•3/25/23, 1:16 AM

what is the best way while finding the best checkpoint using x/y-plot (checkpoint on x-axis, steps on y-axis) to use 4 completely different prompts for each example?

Nn8hawk_what is the best way while finding the best checkpoint using x/y-plot (checkpoin...

Furkan Gözükara SECourses•3/25/23, 1:18 AM

best way is find a good prompt

Furkan Gözükara SECourses•3/25/23, 1:18 AM

get 8 decent looking seed

Furkan Gözükara SECourses•3/25/23, 1:19 AM

then use x/y/z plot seed + checkpoints

n8hawk_OP•3/25/23, 1:19 AM

it would be even better to have 4 different prompts to verify the results in different respects

Nn8hawk_it would be even better to have 4 different prompts to verify the results in dif...

Furkan Gözükara SECourses•3/25/23, 1:19 AM

you can also do that

Furkan Gözükara SECourses•3/25/23, 1:19 AM

you can add prompt with s/r option

Furkan Gözükara SECourses•3/25/23, 1:20 AM

into the x/y/z

n8hawk_OP•3/25/23, 1:23 AM

but not exactly what i ment- i really like (and do it the same way) your way to have a prompt with a batch size of 4 and only one prompt- the advantage is to do 4 at a time, but the disadvantage is that they are very similar- and i thought that i can define single parts of the prompt different with s/r but not the wholw prompt

n8hawk_OP•3/25/23, 1:24 AM

sks as a superhero by zack snyder
sks as a cute pixar character
sks as a painting of van gogh on a 3-legged-horse
srs as a pencil drawing

n8hawk_OP•3/25/23, 1:24 AM

sth like that..

Furkan Gözükara SECourses•3/25/23, 1:25 AM

i understand. you can also add different prompts to the x/y/z plot with s/r feature

Furkan Gözükara SECourses•3/25/23, 1:25 AM

so you can compare checkpoints, prompts and seeds all at 1 run

n8hawk_OP•3/25/23, 1:27 AM

it seems that i have to do some more tries- as i thought that this wouldnt work easily

Furkan Gözükara SECourses•3/25/23, 1:28 AM

man i hope the method i am planning eliminates flicker

n8hawk_OP•3/25/23, 1:30 AM

"oil painting of a cabin in the wood, art by olivier ledroit"
Prompt S/R: olivier ledroit, vincent van gogh

n8hawk_OP•3/25/23, 1:34 AM

i will have to put my old 1660 into my server pc to use to instances for doing stuff at the same time...

n8hawk_OP•3/25/23, 1:38 AM

"prompt"
s/r: "sks as a superhero by zack snyder","sks as a cute pixar character","sks as a painting of van gogh on a 3-legged-horse","srs as a pencil drawing"
not sure if that works at all- as once you have a "," in the prompt it could fail. will try in 58%

Zono50•3/25/23, 1:41 AM

Got it!

Zono50•3/25/23, 1:41 AM

im ecstatic

ZZono50 Got it!

Furkan Gözükara SECourses•3/25/23, 1:41 AM

wow looks like perfect

Furkan Gözükara SECourses•3/25/23, 1:41 AM

you made it?

Zono50•3/25/23, 1:41 AM

yup

Furkan Gözükara SECourses•3/25/23, 1:41 AM

what was the problem

sorry for asking, i am running the dreambooth version where i can select from "8bit AdamW", "Torch A

Similar Threads