Software Engineering Courses (SECourses)•3y ago

what's weird is even thouhg i set lora unet leaerning rate to 1 according to the article, it trains

what's weird is even thouhg i set lora unet leaerning rate to 1 according to the article, it trains at 1.10e-6, but also his article says that adan dapation ignores l/r so i'm assumign thats' why

ZZono50 what's weird is even thouhg i set lora unet leaerning rate to 1 according to the...

ashley•6/7/23, 12:10 PM

The D-Adaptation optimizers adapt the Learning Rate constantly, hence their name. If you install Tensorboard, you will be able to view the graph of the LR and you will see that its not constant.

ashley•6/7/23, 12:12 PM

Here is a Tensorboard graph of the Adan D-Adaptation LR, the LR becomes constant eventually but it basically has a bit of a warm up at the beginning.

Zono50OP•6/7/23, 12:20 PM

yeah i did about 5100 steps andd still doesn't even remotely resemble my subject, so either it's broken, or you have to do an insane amount of steps

Zono50OP•6/7/23, 12:21 PM

I may increase the epochs to like 150 and see what happens

Zono50OP•6/7/23, 12:21 PM

how do i pull up that graph on mine?

Ccode Hey lads, anyone know is its bad practices to train on images that are generated...

Furkan Gözükara SECourses•6/7/23, 12:27 PM

can you eloborate more what you mean

Tteachtaha Does anyone knows how to turn off rtx 3090 rgb lights. The light on GEFORCE RTX ...

Furkan Gözükara SECourses•6/7/23, 12:27 PM

haha i would also turn off but never looked for

DDavid Ce Hey all Please i've been trying to use automatic 1111's dreambooth and i've been...

Furkan Gözükara SECourses•6/7/23, 12:28 PM

just solved that problem

Furkan Gözükara SECourses•6/7/23, 12:28 PM

git checkout main

Furkan Gözükara SECourses•6/7/23, 12:28 PM

in dreambooth extension folder

Aai_science_guy That's incredible! Looking forward to know more.

Furkan Gözükara SECourses•6/7/23, 12:28 PM

hopefully coming soon

Tteachtaha @Dr. Furkan Gözükara how to resume training using last gpt.pth in DLAS cmd inter...

Furkan Gözükara SECourses•6/7/23, 12:28 PM

in advanced tab there is a file path which is .pth. it is original file. we give our checkpoint there

Furkan Gözükara SECourses•6/7/23, 12:29 PM

in past we had huge problem with xformers

Furkan Gözükara SECourses•6/7/23, 12:29 PM

it was training but not learning

Furkan Gözükara SECourses•6/7/23, 12:29 PM

xformers 0.0.16

Zono50OP•6/7/23, 12:29 PM

is version 0.0.17 good?

ZZono50 is version 0.0.17 good?

Furkan Gözükara SECourses•6/7/23, 12:29 PM

it was

Furkan Gözükara SECourses•6/7/23, 12:29 PM

i dont know with latest scripts

Furkan Gözükara SECourses•6/7/23, 12:30 PM

definitely do a small test

Furkan Gözükara SECourses•6/7/23, 12:30 PM

and compare xformers vs not xformers

Zono50OP•6/7/23, 12:30 PM

how many num class instances per image should i use with a dataset of 50 images you think?

ZZono50 how many num class instances per image should i use with a dataset of 50 images ...

Furkan Gözükara SECourses•6/7/23, 12:33 PM

50 is sweet spot i think

Furkan Gözükara SECourses•6/7/23, 12:33 PM

i am going to share 10k new class images on patreon today. for 2 new models

Furkan Gözükara SECourses•6/7/23, 12:33 PM

revAnimated_v122

Furkan Gözükara SECourses•6/7/23, 12:33 PM

DreamShaper_6_NoVae

ashley•6/7/23, 12:35 PM

So it is possible to train a person into revAnimated? I tried before but failed.

Aashley So it is possible to train a person into revAnimated? I tried before but failed...

Furkan Gözükara SECourses•6/7/23, 12:39 PM

i will try

Furkan Gözükara SECourses•6/7/23, 12:39 PM

for styling

Furkan Gözükara SECourses•6/7/23, 12:39 PM

prepared class images

ashley•6/7/23, 12:40 PM

It made my person look like a doll

ashley•6/7/23, 12:41 PM

Without any styling prompts, just normal "ohwx woman"

FFurkan Gözükara SECourses xformers 0.0.16

teachtaha•6/7/23, 1:28 PM

DL-Art-School\experiments\voicecloning_archived_230526-145552\models\2155_gpt.pth ----- Is the the right path ? training is still starting from 0.gpt. Installed xformers as well

ZZono50 is version 0.0.17 good?

flowwolf•6/7/23, 4:05 PM

only 0.0.16 caused the dreambooth issue for some 3060s and every 40 card. i think. was fixed in the next release. i'm up to 0.0.20 today and it works fine