Software Engineering Courses (SECourses)•17mo ago

@Dr. Furkan Gözükara I am having a OOM error in Forge, on Massed Compute, do you have any idea?

smokeOP•8/27/24, 7:06 PM

Even when I lower this slider

Ssmoke @Dr. Furkan Gözükara I am having a OOM error in Forge, on Massed Compute, do you...

Furkan Gözükara SECourses•8/27/24, 7:09 PM

can you edit this file and restart let me tell you

Furkan Gözükara SECourses•8/27/24, 7:09 PM

but before that actually can you dm me your entire screen screenshot

Furkan Gözükara SECourses•8/27/24, 7:09 PM

so i can see your exact config

Furkan Gözükara SECourses•8/27/24, 7:09 PM

because today i tested i have no error

smokeOP•8/27/24, 7:09 PM

Sure thing

Dreamer@TDFilmStudio•8/27/24, 7:33 PM

@Dr. Furkan Gözükara Is it possible to integrate joycaption as the default captioner for Supir, instead of llava?

nicearoni•8/27/24, 7:49 PM

running a big grid right now comparing different versions of a person lora... 25, 50, and 75 epoch versions all have long hair for "man as a cosmic jazz improviser whose music causes spontaneous formation of new elements and life forms and wearing eyeglasses" even though short hair in all training images

DDreamer@TDFilmStudio @Dr. Furkan Gözükara Is it possible to integrate joycaption as the default capti...

Furkan Gözükara SECourses•8/27/24, 7:49 PM

i may integrate

Nnicearoni running a big grid right now comparing different versions of a person lora... 25...

Furkan Gözükara SECourses•8/27/24, 7:49 PM

FFurkan Gözükara SECourses 😄

Dreamer@TDFilmStudio•8/27/24, 7:53 PM

Since you've mastered custom LoRA training for people, I encourage you to explore Flux LoRA training for products, objects, and art styles.

DDreamer@TDFilmStudio Since you've mastered custom LoRA training for people, I encourage you to explor...

Furkan Gözükara SECourses•8/27/24, 7:55 PM

yep it is also in progress

DDreamer@TDFilmStudio Since you've mastered custom LoRA training for people, I encourage you to explor...

fadounav•8/27/24, 7:55 PM

I agree, I don't understand why I'm losing the comic style I trained my lora with via comfyUI. I do have my avatar but in a realistic style, whereas I keep the comic side when I go through automatic 1111. I'd like to train a style to have consistency.

Ffadounav I agree, I don't understand why I'm losing the comic style I trained my lora wit...

Dreamer@TDFilmStudio•8/27/24, 7:57 PM

Flux is clearly excelling at art style and product LoRAs, as evidenced by the recent surge of these types on Civitai. Also I look forward to seeing architectural and other categories too.

Ffadounav I agree, I don't understand why I'm losing the comic style I trained my lora wit...

Furkan Gözükara SECourses•8/27/24, 7:59 PM

i added new config

Furkan Gözükara SECourses•8/27/24, 7:59 PM

Best_Configs_Better_Colors

Furkan Gözükara SECourses•8/27/24, 7:59 PM

it may be fix for style training

Furkan Gözükara SECourses•8/27/24, 7:59 PM

i will do more research with it not compoleted yet

Furkan Gözükara SECourses•8/27/24, 8:00 PM

@NicB we got error with forge

Furkan Gözükara SECourses•8/27/24, 8:00 PM

i am gonna email you details

dsienra•8/27/24, 8:25 PM

@Dr. Furkan Gözükara I'm having this errors is training with TE, the speed is lower 6s/it, do you know what this errors are?

Ddsienra @Dr. Furkan Gözükara I'm having this errors is training with TE, the speed is lo...

Furkan Gözükara SECourses•8/27/24, 8:33 PM

they are warnings

Horrid•8/27/24, 8:47 PM

What are the chances that you will make a one click installer for aitoolkit?

HHorrid What are the chances that you will make a one click installer for aitoolkit?

Furkan Gözükara SECourses•8/27/24, 8:56 PM

can you give me github url

nicearoni•8/27/24, 9:14 PM

might be this? https://github.com/ostris/ai-toolkit/

GitHub

GitHub - ostris/ai-toolkit: Various AI scripts. Mostly Stable Diffu...

Various AI scripts. Mostly Stable Diffusion stuff. - ostris/ai-toolkit

Nnicearoni might be this? https://github.com/ostris/ai-toolkit/

Furkan Gözükara SECourses•8/27/24, 9:19 PM

it already has installation?

Furkan Gözükara SECourses•8/27/24, 9:19 PM

Furkan Gözükara SECourses•8/27/24, 9:19 PM

to be able to use it you need to know command line arguments passing

Furkan Gözükara SECourses•8/27/24, 9:20 PM

dont worry i am recording kohya tutorial hopefully today

Furkan Gözükara SECourses•8/27/24, 9:20 PM

i am testing cu118 vs cu124 atm

Furkan Gözükara SECourses•8/27/24, 9:46 PM

12 gb training became slower after last kohya update

Furkan Gözükara SECourses•8/27/24, 9:47 PM

anyone noticed?

Furkan Gözükara SECourses•8/27/24, 9:47 PM

like 2x slow

Furkan Gözükara SECourses•8/27/24, 9:49 PM

or maybe i am wrong testing

Furkan Gözükara SECourses•8/27/24, 9:58 PM

rtx 3090 way powerful than 3060 for sure

Furkan Gözükara SECourses•8/27/24, 9:59 PM

3.15 times exactly matching lol

FFurkan Gözükara SECourses rtx 3090 way powerful than 3060 for sure

Dreamer@TDFilmStudio•8/27/24, 10:00 PM

This style lora is really good: extract - I'm gonna answer here if other people wants more details as well.

For the captioning, here are some examples : https://imgur.com/a/hxAm3fo (used Florence2 as the base caption then rewrote them)

I've used 29 images (all of different aspect ratio, I didnt crop anything). It was with Civitai Lora training tool and I barely changed anything from the default settings :

"engine": "kohya",

"unetLR": 0.0005,

"clipSkip": 1,

"loraType": "lora",

"keepTokens": 0,

"networkDim": 2,

"numRepeats": 15,

"resolution": 512,

"lrScheduler": "cosine_with_restarts",

"minSnrGamma": 5,

"noiseOffset": 0.1,

"targetSteps": 1088,

"enableBucket": true,

"networkAlpha": 16,

"optimizerType": "AdamW8Bit",

"textEncoderLR": 0,

"maxTrainEpochs": 10,

"shuffleCaption": false,

"trainBatchSize": 4,

"flipAugmentation": false,

"lrSchedulerNumCycles": 3

Imgur

Untitled Album