Software Engineering Courses (SECourses)•15mo ago

The only way I've gotten it to work close to the way I want it to is using the flux gym on default s

The only way I've gotten it to work close to the way I want it to is using the flux gym on default settings, but I would prefer to use Kohya -- based on the preferred results from flux gym, should I increase the number of repeats (from 1) and decrease the number of epochs (from 200)

DDazzastrous [4090]do u have blue light protection in your lenses ?

Furkan Gözükara SECourses•10/27/24, 9:54 PM

i am not sure how do we check

SSaxon The only way I've gotten it to work close to the way I want it to is using the f...

Furkan Gözükara SECourses•10/27/24, 9:55 PM

i dont think it would make diff

Dazzastrous [4090]•10/27/24, 9:55 PM

they asked me at the opticians

Furkan Gözükara SECourses•10/27/24, 9:55 PM

since you dont use reg images

DDazzastrous [4090]they asked me at the opticians

Furkan Gözükara SECourses•10/27/24, 9:55 PM

i really dont remember :d

Furkan Gözükara SECourses•10/27/24, 9:55 PM

but should have

SaxonOP•10/27/24, 9:55 PM

you can get a little blue laser to check -- they send them automatically with zenni glasses

SaxonOP•10/27/24, 9:55 PM

but it comes pretty standard in quality glasses

SSaxon but it comes pretty standard in quality glasses

Furkan Gözükara SECourses•10/27/24, 9:56 PM

i assume it should have but i will ask

SaxonOP•10/27/24, 9:56 PM

Do you know what those settings from flux gym would correspond to in Kohya?

SSaxon Do you know what those settings from flux gym would correspond to in Kohya?

Furkan Gözükara SECourses•10/27/24, 9:57 PM

sadly not i never used

Furkan Gözükara SECourses•10/27/24, 9:57 PM

kohya gui is easy i think

Dazzastrous [4090]•10/27/24, 9:57 PM

also can put eye drops in as eyes can get dry

Furkan Gözükara SECourses•10/27/24, 9:57 PM

there is a client sent me literally over 600 images picking good subset :d

DDazzastrous [4090]also can put eye drops in as eyes can get dry

Furkan Gözükara SECourses•10/27/24, 9:57 PM

ye the doctor gave me

SaxonOP•10/27/24, 9:59 PM

this is the difference between the outputs of a lora made with flux gym (more pink one) vs the one made with your suggested settings in koyha -- do you have any suggestions for changes to settings that might help?

Dazzastrous [4090]•10/27/24, 9:59 PM

whats the spoiler thing

Dazzastrous [4090]•10/27/24, 9:59 PM

lol

SaxonOP•10/27/24, 10:01 PM

it just seems less obnoxious to make the picture viewing opt-in

Dazzastrous [4090]•10/27/24, 10:05 PM

white-background-X0UKDkmjSG-kQGWxmNy8Ig-WxRu69-vS5KZHYLmX7Qikg.png

SSaxon this is the difference between the outputs of a lora made with flux gym (more pi...

Furkan Gözükara SECourses•10/27/24, 10:19 PM

when training style dataset matters most

Furkan Gözükara SECourses•10/27/24, 10:19 PM

did you read my style training guide?

Furkan Gözükara SECourses•10/27/24, 10:21 PM

selected 189 images for the client

Furkan Gözükara SECourses•10/27/24, 10:21 PM

lets see

SaxonOP•10/27/24, 10:21 PM

I didn't go through it comprehensively, but I did look at it

SSaxon I didn't go through it comprehensively, but I did look at it

Furkan Gözükara SECourses•10/27/24, 10:24 PM

so dataset matters most

Furkan Gözükara SECourses•10/27/24, 10:24 PM

and consistency

Furkan Gözükara SECourses•10/27/24, 10:24 PM

if not consistent captions help

Vigilence•10/27/24, 11:00 PM

@Saxon How many image repeats did you use in kohya? Default is 40 in kohya, 10 in fluxgym. You can look into the flux gym folder and see the settings used for your lora.

SaxonOP•10/27/24, 11:00 PM

I used the default of 10 in flux gym, and 1 in Kohya

Vigilence•10/27/24, 11:03 PM

I think that is a major difference, not enough time to learn the style. I have noticed this myself. The major drawback about fine tuning for styles, I think, is that it needs more image repeats, but I haven’t done enough testing yet. Was the dataset 1:1?

SaxonOP•10/27/24, 11:06 PM

yes, the data set was the same. I'll give it another try with higher repeats in kohya and see if it's the difference.

SaxonOP•10/27/24, 11:06 PM

The default epochs in gym is 16 -- is that how many epochs I would put into Koyha to try and replicate results? It seems low

SSaxon The default epochs in gym is 16 -- is that how many epochs I would put into Koyh...

Furkan Gözükara SECourses•10/27/24, 11:08 PM

default number of epochs really meaningless

Furkan Gözükara SECourses•10/27/24, 11:08 PM

it depends on each dataset

Furkan Gözükara SECourses•10/27/24, 11:08 PM

how many images you have total?

SaxonOP•10/27/24, 11:10 PM

21, but the style is very consistent. I could add more but I'm just trying to get a feel for the settings

Vigilence•10/27/24, 11:10 PM

You really need to look at the training log in flux gym, all the settings are different. I believe it uses Adam8bit, and a slightly faster learning rate. I also think training is in fp8.

Vigilence•10/27/24, 11:11 PM

@Furkan Gözükara SECourses do you have comparison of training with fp16 vs fp8?

Vigilence•10/27/24, 11:12 PM

@Saxon All the settings in the flux gym log can be transferred to kohya (manually) as it’s backend is kohya.

SaxonOP•10/27/24, 11:14 PM

are you referring to the train.bat file?

Vigilence•10/27/24, 11:15 PM

I think that’s it. If you right click and open in a text program you can see the settings.

Vigilence•10/27/24, 11:15 PM

Did you assign a trigger word during training/captioning and use it in both images when testing?

SaxonOP•10/27/24, 11:17 PM

here it is if that helps. They do have a trigger word, and I usually caption them with only the trigger word and the animal in the image

train.bat1.53KB

SSaxon 21, but the style is very consistent. I could add more but I'm just trying to ge...

Furkan Gözükara SECourses•10/28/24, 12:03 AM

you should add more

VVigilence <@205854764540362752> do you have comparison of training with fp16 vs fp8?

Furkan Gözükara SECourses•10/28/24, 12:04 AM

we cant train fp8

Furkan Gözükara SECourses•10/28/24, 12:04 AM

all trainings are done at bf16

Furkan Gözükara SECourses•10/28/24, 12:04 AM

kohya doesnt know how to do fp8 training :d

wardensc2•10/28/24, 12:28 AM

new Kohya with Torch 2.5 speed increase about 20% - 25%

wardensc2•10/28/24, 12:28 AM

The only way I've gotten it to work close to the way I want it to is using the flux gym on default s

Similar Threads