Software Engineering Courses (SECourses)•16mo ago

<@205854764540362752> , any news on Flux Dreambooth finetuning recommended number of steps? The 1750

@Furkan Gözükara SECourses , any news on Flux Dreambooth finetuning recommended number of steps? The 17500 steps (175 training images) training I ran the other night is disappointing… I trained on one person and the ohwx person in generated images only bears a passing resemblance…

Mmacba <@205854764540362752> , any news on Flux Dreambooth finetuning recommended numbe...

Furkan Gözükara SECourses•9/27/24, 9:26 PM

weird

Furkan Gözükara SECourses•9/27/24, 9:26 PM

it shound resonable steps

Furkan Gözükara SECourses•9/27/24, 9:26 PM

currently i am training myself with 256 images

Furkan Gözükara SECourses•9/27/24, 9:26 PM

also working on batch size 7 config

Furkan Gözükara SECourses•9/27/24, 9:26 PM

almost ready

Furkan Gözükara SECourses•9/27/24, 9:26 PM

40 epoch is amazing

FFurkan Gözükara SECourses 40 epoch is amazing

macbaOP•9/27/24, 9:27 PM

Can you detail how many repeats, epochs, total steps and batch size please?

Mmacba Can you detail how many repeats, epochs, total steps and batch size please?

Furkan Gözükara SECourses•9/27/24, 9:27 PM

256 images, batch size 7, epoch 40 = 256 * 40 / 7 steps = 1462

Furkan Gözükara SECourses•9/27/24, 9:28 PM

fine tuned on RTX A6000

Furkan Gözükara SECourses•9/27/24, 9:28 PM

2128-closeshot20photo20of20ohwx20man20walking20thro-FT_256_images_BS7_5e_01_xFormers-000040-1003905837.png

FFurkan Gözükara SECourses fine tuned on RTX A6000

macbaOP•9/27/24, 9:28 PM

This is Dreambooth finetuning on Kohya, right?

Mmacba This is Dreambooth finetuning on Kohya, right?

Furkan Gözükara SECourses•9/27/24, 9:29 PM

dreambooth in kohya for flux

Furkan Gözükara SECourses•9/27/24, 9:29 PM

256 images

Furkan Gözükara SECourses•9/27/24, 9:29 PM

256 images is a total overkill can be reduced a lot

macbaOP•9/27/24, 9:30 PM

You didn't mention repeats, so your folder was 1_ohwx man, right?

Mmacba You didn't mention repeats, so your folder was 1_ohwx man, right?

Furkan Gözükara SECourses•9/27/24, 9:30 PM

always 1 repeat

Furkan Gözükara SECourses•9/27/24, 9:30 PM

for flux

macbaOP•9/27/24, 9:31 PM

Well ,maybe that's where I went wrong, I did use repeats

Furkan Gözükara SECourses•9/27/24, 9:31 PM

2130-photo20of20ohwx20man20riding20a20galloping20hor-FT_256_images_BS7_5e_01_xFormers-000040-1059077534.png

Mmacba Well ,maybe that's where I went wrong, I did use repeats

Furkan Gözükara SECourses•9/27/24, 9:31 PM

why?

Andrew•9/27/24, 9:31 PM

Has anyone had issues with the vae when trying to finetune in kohya? It looks like it's loading the full flux dev checkpoint as the vae rather than the vae I'm pointing it to in the config...and so it fails to generate latents. I think I can work around this by just not caching to disk and by turning off "use latent files".

Just wondering if anyone has seen this. kohya_ss is all up to date.

macbaOP•9/27/24, 9:32 PM

I thought I was using your settings, but maybe I increased the repeats in addition to the epochs to get more steps? I can't recall 100% but I guess it was a mistake on my part

AAndrew Has anyone had issues with the vae when trying to finetune in kohya? It looks li...

Furkan Gözükara SECourses•9/27/24, 9:33 PM

what do you train?

Furkan Gözükara SECourses•9/27/24, 9:33 PM

flux_?

Mmacba I thought I was using your settings, but maybe I increased the repeats in additi...

Furkan Gözükara SECourses•9/27/24, 9:33 PM

repeat always 1

Andrew•9/27/24, 9:33 PM

Yes, Flux using one of your presets on 24gb,

AAndrew Yes, Flux using one of your presets on 24gb,

Furkan Gözükara SECourses•9/27/24, 9:34 PM

then you need to give vae path

Furkan Gözükara SECourses•9/27/24, 9:34 PM

from your pc

FFurkan Gözükara SECourses then you need to give vae path

Andrew•9/27/24, 9:37 PM

Yep, I am, and I can see that it's in the .toml file under ae=.

FFurkan Gözükara SECourses from your pc

Andrew•9/27/24, 9:37 PM

FFurkan Gözükara SECourses then you need to give vae path

Andrew•9/27/24, 9:38 PM

AAndrew Click to see attachment

Furkan Gözükara SECourses•9/27/24, 9:38 PM

your vae is inaccurate

Furkan Gözükara SECourses•9/27/24, 9:38 PM

use my downloader downloaded vae

Andrew•9/27/24, 9:39 PM

I have a few in that directory, I also have ae.safetensors which is straight from huggingface

AAndrew I have a few in that directory, I also have ae.safetensors which is straight fro...

Furkan Gözükara SECourses•9/27/24, 9:39 PM

try mine

Andrew•9/27/24, 9:39 PM

Running the downloader now just to be sure though!

Furkan Gözükara SECourses•9/27/24, 9:39 PM

if something not working use mine

FFurkan Gözükara SECourses if something not working use mine 😄

Andrew•9/27/24, 9:43 PM

This is the issue I'm seeing...I'm pointing it to your vae now, but when kohya runs you can see in this output that it keeps trying to use the flux checkpoint as the vae. For some reason it's not use the vae in the gui or in the toml

AAndrew This is the issue I'm seeing...I'm pointing it to your vae now, but when kohya r...

Furkan Gözükara SECourses•9/27/24, 9:44 PM

show me gui screenshot please

FFurkan Gözükara SECourses show me gui screenshot please

Andrew•9/27/24, 9:45 PM

Furkan Gözükara SECourses•9/27/24, 9:45 PM

also did you install kohya via stability matrix?

AAndrew Click to see attachment

Furkan Gözükara SECourses•9/27/24, 9:45 PM

this is loading flux dev model as vae

Furkan Gözükara SECourses•9/27/24, 9:45 PM

Furkan Gözükara SECourses•9/27/24, 9:46 PM

get fresh config

Furkan Gözükara SECourses•9/27/24, 9:46 PM

from zip file

Furkan Gözükara SECourses•9/27/24, 9:46 PM

put itno c

Andrew•9/27/24, 9:51 PM

Kohya was installed via your scripts, my flux models just live under stability matrix. I just updated it to point to the flux model from your downloader but same thing, it's still setting the vae path to the full model. I'll try a git hard reset just to make sure kohya isn't stuck on an old commit

<@205854764540362752> , any news on Flux Dreambooth finetuning recommended number of steps? The 1750

Similar Threads