Software Engineering Courses (SECourses)•15mo ago

<@205854764540362752> Just finished my flux finetune, very happy with the results. Dora left, finet

@Furkan Gözükara SECourses Just finished my flux finetune, very happy with the results.
Dora left, finetune right.

VigilenceOP•10/18/24, 6:39 PM

@Carlos Don't forget to change image repeat to 1. The default learning rate in the config was good for me, and 200 epoch is recommended.

CCarlos you mean that for each epoch you save you create all the samples in 28_Realism_...

Furkan Gözükara SECourses•10/18/24, 6:39 PM

yes

VVigilence <@205854764540362752> Just finished my flux finetune, very happy with the result...

Furkan Gözükara SECourses•10/18/24, 6:39 PM

nice

VigilenceOP•10/18/24, 6:40 PM

Gonna extract lora later and compare all 3.

VVigilence Gonna extract lora later and compare all 3.

Furkan Gözükara SECourses•10/18/24, 6:45 PM

awesome

VigilenceOP•10/18/24, 6:59 PM

@Furkan Gözükara SECourses Have you tried kohya LyCORIS yet?

VigilenceOP•10/18/24, 7:00 PM

I want to see (Regular) Lora, DORA, Lycoris, Finetune, & Lora (Extracted from finetune).

VVigilence <@205854764540362752> Have you tried kohya LyCORIS yet?

Furkan Gözükara SECourses•10/18/24, 7:08 PM

not yet

VigilenceOP•10/18/24, 7:21 PM

@Furkan Gözükara SECourses What is new in the v8 finetune config?

VVigilence <@205854764540362752> What is new in the v8 finetune config?

Furkan Gözükara SECourses•10/18/24, 7:27 PM

configs are same

Furkan Gözükara SECourses•10/18/24, 7:28 PM

now hours of editing waiting me

Furkan Gözükara SECourses•10/18/24, 7:28 PM

FFurkan Gözükara SECourses Click to see attachment

SiggiSmilez•10/18/24, 7:34 PM

Will you cover how to half the size of the checkpoint too in this tutorial? It would be nice if we could use 12gb checkpoints instead of 24gb

VigilenceOP•10/18/24, 8:06 PM

@Furkan Gözükara SECourses The extract lora from the finetune only works on the base model I used to create the finetune from. Any image created with a different model using this lora is just static.

How do I fix this?

VigilenceOP•10/18/24, 8:08 PM

VigilenceOP•10/18/24, 8:25 PM

I fixed it, linked to wrong base model.

VigilenceOP•10/18/24, 8:30 PM

@Furkan Gözükara SECourses Extracted lora (left) vs Finetune (right).

VigilenceOP•10/18/24, 8:35 PM

The extracted lora is actually better than the finetune!

VVigilence The extracted lora is actually better than the finetune!

Furkan Gözükara SECourses•10/18/24, 10:02 PM

that means your model overtrained :d

SSiggiSmilez Will you cover how to half the size of the checkpoint too in this tutorial? It w...

Furkan Gözükara SECourses•10/18/24, 10:03 PM

it is ready already : https://www.patreon.com/posts/how-to-convert-114003125

Patreon

How To Convert 24 GB FP16 Fine Tuning / DreamBooth FLUX Checkpoints...

Get more from SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts on Patreon

VVigilence <@205854764540362752> The extract lora from the finetune only works on the base ...

Furkan Gözükara SECourses•10/18/24, 10:03 PM

different model what you mean?

Furkan Gözükara SECourses•10/18/24, 10:03 PM

which different model

FFurkan Gözükara SECourses which different model

VigilenceOP•10/18/24, 11:08 PM

I picked the wrong base model by accident.

FFurkan Gözükara SECourses that means your model overtrained :d

VigilenceOP•10/18/24, 11:12 PM

I mean the colors are nicer and the textures more pronounced over the trained model when using dev paired with lora.

VVigilence I mean the colors are nicer and the textures more pronounced over the trained mo...

Furkan Gözükara SECourses•10/18/24, 11:14 PM

yes it is very likely model was overtrained and LoRA extraction reduced this impact

VigilenceOP•10/18/24, 11:14 PM

Maybe so, I used the 200th epoch but at 150 the textures are slighly more pronounced.

VVigilence Maybe so, I used the 200th epoch but at 150 the textures are slighly more pronou...

Furkan Gözükara SECourses•10/18/24, 11:15 PM

i also find that epoch good for my 15 images dataset

VigilenceOP•10/18/24, 11:16 PM

Yeah it was nice with image prompt, composition, texture quality, layout and overall amount of detail (items placed nicely).

VigilenceOP•10/18/24, 11:19 PM

@Furkan Gözükara SECourses I asked bmatis and he added a feature to the gui that was in the code, the ability to set the max amount of save-state folders to what ever we want. If set to 1 it will be overwritten with the newest save-state made.

VVigilence <@205854764540362752> I asked bmatis and he added a feature to the gui that was ...

Furkan Gözükara SECourses•10/18/24, 11:22 PM

nice

ApathyJones•10/19/24, 12:44 AM

trying to train on a Flux model but getting this error with it... File "D:\kohya_ss\sd-scripts\library\flux_utils.py", line 81, in analyze_checkpoint_state
max_double_block_index = max(
ValueError: max() arg is an empty sequence

ApathyJones•10/19/24, 12:45 AM

It works fine with the default flux dev, but not this other finetuned dev ccheckpoint

VVigilence <@205854764540362752> I asked bmatis and he added a feature to the gui that was ...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•10/19/24, 7:54 AM

Does this mean we can now resume training where we left or if I want to train again with more epochs can I just add it and start from where it last trained?

AApathyJones It works fine with the default flux dev, but not this other finetuned dev ccheck...

Furkan Gözükara SECourses•10/19/24, 10:07 AM

you need to report to kohya

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 Does this mean we can now resume training where we left or if I want to train ag...

Furkan Gözükara SECourses•10/19/24, 10:07 AM

yes you can

Furkan Gözükara SECourses•10/19/24, 10:07 AM

you can also use latest checkpoint

FFurkan Gözükara SECourses nice

sergio_gonzo•10/19/24, 12:43 PM

dr Furkan i hope everything is ok , the full tutorial about make drambooth with flux is in process right?

Ssergio_gonzo dr Furkan i hope everything is ok , the full tutorial about make drambooth with...

Furkan Gözükara SECourses•10/19/24, 12:49 PM

yep editing

Furkan Gözükara SECourses•10/19/24, 12:49 PM

sergio_gonzo•10/19/24, 12:50 PM

how this process make dreambooth models intead of loral model make better models thna make the loras? only to undertand how is work

Ssergio_gonzo how this process make dreambooth models intead of loral model make better models...

Furkan Gözükara SECourses•10/19/24, 12:52 PM

fine tuning is training full model

Furkan Gözükara SECourses•10/19/24, 12:52 PM

lora is optimization

Furkan Gözükara SECourses•10/19/24, 12:52 PM

thus fine tuning better

dxqb•10/19/24, 2:13 PM

@Furkan Gözükara SECourses not sure if kohya and/or you still see this on a closed PR, so here too:

@bmaltais can we add this to gui so many people want to test

Specify a large value for --prior_loss_weight option (not dataset config). We recommend 10-1000.
Set the loss in the training without using the regularization image to be close to the loss in the training using DOP.

doubt that this is a good config recommendation.

all my proof-of-concept samples were at weight 1.

Yes, loss of reg steps is then very low compared to train steps, but this is a function of the reg step prediction already being very close to the target.

you can try at weight 10 or even 1000, but I'd expect that the regularization then overwhelms the training steps, and the model doesn't learn anything anymore.

Ddxqb <@205854764540362752> not sure if kohya and/or you still see this on a closed PR...

Vs12•10/19/24, 2:26 PM

nope it works, just tested it thoroughly, weight 10 works fine just takes longer to train

dxqb•10/19/24, 2:30 PM

even at 1 I think it dampens training of the concept you do want to change, so even if 10 works I'd be careful and/or try different values

dxqb•10/19/24, 2:31 PM

I was more thinking in the other direction, doing less reg steps than 1:1, because even at 1:1 with weight 1, regularisation is strong

dxqb•10/19/24, 2:32 PM

but currently working on sth else so I'd probably not get around to more tests any time soon

Ddxqb <@205854764540362752> not sure if kohya and/or you still see this on a closed PR...

Furkan Gözükara SECourses•10/19/24, 3:10 PM

i am waiting bmaltais to add

dxqb•10/19/24, 3:11 PM

it's merged in sd3 branch

<@205854764540362752> Just finished my flux finetune, very happy with the results. Dora left, finet

Similar Threads

Similar Threads

Similar Threads