Software Engineering Courses (SECourses)•17mo ago

good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actually learning the toke

good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actually learning the token associated with me, I'm using regularization images from the class person, and my face is not bleeding to other men.

dsienraOP•8/30/24, 11:03 PM

is still training

dsienraOP•8/30/24, 11:05 PM

to accelerate the tests I increased the unet lr to 1e-4

dsienraOP•8/30/24, 11:08 PM

my gol is find a configuration to train multiple people on the same lora avoiding class bleeding and bleeding between the trained subjects

Vvp Doc, when you get a chance, and it's not urgent, but I think the windows version...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

instant id works but i think that error occurs

Furkan Gözükara SECourses•8/30/24, 11:10 PM

i need to check if it affects

Ddsienra good news, with TE lr 9e-4 prompting "myname photo" triggers my photo its actual...

Furkan Gözükara SECourses•8/30/24, 11:10 PM

nice tests

Théo•8/30/24, 11:15 PM

im confuse about something, is it better to train the lora on flux with 1024x picture or higher ? because in your Patreon it says "better resolution is better result, not lower that 1024"

TThéo im confuse about something, is it better to train the lora on flux with 1024x pi...

Furkan Gözükara SECourses•8/30/24, 11:15 PM

higher res yields better true

Furkan Gözükara SECourses•8/30/24, 11:15 PM

if you can afford to wait

Furkan Gözükara SECourses•8/30/24, 11:15 PM

train 1280 x 1280

Théo•8/30/24, 11:16 PM

Oh boi, i was thinking about training 4K pictures, but i suppose even with a 4090 it will take me days hahaha

Furkan Gözükara SECourses•8/30/24, 11:16 PM

by the way after 1536 i didnt test

Furkan Gözükara SECourses•8/30/24, 11:16 PM

i trained max 1536x1536

FFurkan Gözükara SECourses nice tests

dsienraOP•8/30/24, 11:20 PM

I'm using my actual name "Diego" I didn't try with a unique token that are not present on T5, idk if this is good or bad, I suppose that weird tokens like ohwx are not present on T5 or it contains unique combinations of letters? that the token is present on both text encoders is good or bad for training a new concept?

Dragoy•8/30/24, 11:22 PM

Why are my lora files so big (2Gb)?
I trained them with Network Rank = 128, what value should I set to get ~200mb files?

Dragoy•8/30/24, 11:23 PM

used the Rank_3_18246MB_Slow configuration

Ddsienra I'm using my actual name "Diego" I didn't try with a unique token that are not ...

Furkan Gözükara SECourses•8/30/24, 11:27 PM

well the thing is we use something rarely exists so that it can overrwite data

Furkan Gözükara SECourses•8/30/24, 11:27 PM

but t5 thing is new in the workflow opposed to sdxl

DDragoy Why are my lora files so big (2Gb)? I trained them with Network Rank = 128, what...

Furkan Gözükara SECourses•8/30/24, 11:28 PM

because we save as float

Furkan Gözükara SECourses•8/30/24, 11:28 PM

save as fp16

Furkan Gözükara SECourses•8/30/24, 11:28 PM

also we save rank 128 :d

FFurkan Gözükara SECourses well the thing is we use something rarely exists so that it can overrwite data

dsienraOP•8/30/24, 11:30 PM

I know but now with T5 in the equation that is frozen, how reacts to tokens that are not present on it?

dsienraOP•8/30/24, 11:30 PM

that's the question???

dsienraOP•8/30/24, 11:31 PM

really don't know

dsienraOP•8/30/24, 11:31 PM

there is a way to know if a token is on T5 or not?

Ddsienra I know but now with T5 in the equation that is frozen, how reacts to tokens that...

Furkan Gözükara SECourses•8/30/24, 11:51 PM

everything get tokenized

Furkan Gözükara SECourses•8/30/24, 11:51 PM

so it exists

Furkan Gözükara SECourses•8/30/24, 11:51 PM

but it is single token or not unknown

Furkan Gözükara SECourses•8/30/24, 11:51 PM

i asked this to swarmui dev and he said we dont have t5 tokenizer :d

Furkan Gözükara SECourses•8/30/24, 11:51 PM

like clip

Furkan Gözükara SECourses•8/30/24, 11:51 PM

time to work hard :/

Furkan Gözükara SECourses•8/30/24, 11:51 PM

FFurkan Gözükara SECourses c:/kohya_ai

GomezBro•8/30/24, 11:59 PM

is it c:/kohya_ai/kohya_ss correct? batch files in main c:/kohya_ai correct?

Uuisato Great! Changed names and installed said the DLL and it works. Thanks guys.

GomezBro•8/31/24, 12:01 AM

is it c:/kohya_ai/kohya_ss correct? batch files in main c:/kohya_ai correct? and then run the files creating the /kohya_ss folder right? I have this issue too, on 2 machines