Software Engineering Courses (SECourses)•15mo ago

Does this mean we can now resume training where we left or if I want to train again with more epochs

Does this mean we can now resume training where we left or if I want to train again with more epochs can I just add it and start from where it last trained?

AApathyJones It works fine with the default flux dev, but not this other finetuned dev ccheck...

Furkan Gözükara SECourses•10/19/24, 10:07 AM

you need to report to kohya

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 Does this mean we can now resume training where we left or if I want to train ag...

Furkan Gözükara SECourses•10/19/24, 10:07 AM

yes you can

Furkan Gözükara SECourses•10/19/24, 10:07 AM

you can also use latest checkpoint

FFurkan Gözükara SECourses nice

sergio_gonzo•10/19/24, 12:43 PM

dr Furkan i hope everything is ok , the full tutorial about make drambooth with flux is in process right?

Ssergio_gonzo dr Furkan i hope everything is ok , the full tutorial about make drambooth with...

Furkan Gözükara SECourses•10/19/24, 12:49 PM

yep editing

Furkan Gözükara SECourses•10/19/24, 12:49 PM

sergio_gonzo•10/19/24, 12:50 PM

how this process make dreambooth models intead of loral model make better models thna make the loras? only to undertand how is work

Ssergio_gonzo how this process make dreambooth models intead of loral model make better models...

Furkan Gözükara SECourses•10/19/24, 12:52 PM

fine tuning is training full model

Furkan Gözükara SECourses•10/19/24, 12:52 PM

lora is optimization

Furkan Gözükara SECourses•10/19/24, 12:52 PM

thus fine tuning better

dxqb•10/19/24, 2:13 PM

@Furkan Gözükara SECourses not sure if kohya and/or you still see this on a closed PR, so here too:

@bmaltais can we add this to gui so many people want to test

Specify a large value for --prior_loss_weight option (not dataset config). We recommend 10-1000.
Set the loss in the training without using the regularization image to be close to the loss in the training using DOP.

doubt that this is a good config recommendation.

all my proof-of-concept samples were at weight 1.

Yes, loss of reg steps is then very low compared to train steps, but this is a function of the reg step prediction already being very close to the target.

you can try at weight 10 or even 1000, but I'd expect that the regularization then overwhelms the training steps, and the model doesn't learn anything anymore.

Ddxqb <@205854764540362752> not sure if kohya and/or you still see this on a closed PR...

Vs12•10/19/24, 2:26 PM

nope it works, just tested it thoroughly, weight 10 works fine just takes longer to train

dxqb•10/19/24, 2:30 PM

even at 1 I think it dampens training of the concept you do want to change, so even if 10 works I'd be careful and/or try different values

dxqb•10/19/24, 2:31 PM

I was more thinking in the other direction, doing less reg steps than 1:1, because even at 1:1 with weight 1, regularisation is strong

dxqb•10/19/24, 2:32 PM

but currently working on sth else so I'd probably not get around to more tests any time soon

Ddxqb <@205854764540362752> not sure if kohya and/or you still see this on a closed PR...

Furkan Gözükara SECourses•10/19/24, 3:10 PM

i am waiting bmaltais to add

dxqb•10/19/24, 3:11 PM

it's merged in sd3 branch

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 Does this mean we can now resume training where we left or if I want to train ag...

Vigilence•10/19/24, 3:22 PM

You could always do this if you used the save-state options. You would then paste the path of the folder in the resume from state box. However, the issue is that if you trained for 100 epochs, and the setting was set for 200 epochs, resuming from the trained state of 100 epochs will then train for another 200 epochs, so 300 in total. The epochs in the setting would have to be adjusted if you want max 200.

The new setting is to change the maximum amount of save-state folders you can have. Normally it would save either at the end, which is not great if something bad happens, or at every time you save a copy of the model. This can be a lot of big files, so with this option you can have it set to say a max saved-state amount of 1, so that each new saved-state folder overwrites the older one. Great for saving HD space.

wardensc2•10/21/24, 5:33 AM

Hi @Furkan Gözükara SECourses I try to use your Quality_1_23100MB_14_12_Second_IT.json to train checkpoint but it's very difficult to get 23.1 GB Vram. Windows mostly eat 1.2 - 1.3 GB VRam. How do you limit VRAM use by windows. Since I have 24gb VRAM choosing Quality_1_15500MB_32_Second_IT.json is double the training times and not ultilize my VRAM.

Carlos•10/21/24, 11:58 AM

Hello, I want to try to finetune flux dev on a style rather than a character? Any advice on what is different? For example the captioning, I only captioned with my trigger word + class for the character, is that the same for style? If you have any documentation or training (even if not from you) that's be very much appreciated!! love

CCarlos Hello, I want to try to finetune flux dev on a style rather than a character? An...

Vigilence•10/21/24, 4:12 PM

For styles you can either go with a trigger word for the entire image, fully caption everything, or no captions. Characters require captions for everything except the things about the character, like their hair, clothing etc. Things that are captioned can be changed later, things not captioned are static and will be reproduced when prompted.

Wwardensc2 Hi <@205854764540362752> I try to use your Quality_1_23100MB_14_12_Second_IT.jso...

Furkan Gözükara SECourses•10/21/24, 10:09 PM

yes in that case

Furkan Gözükara SECourses•10/21/24, 10:09 PM

just increase number of block swaps

Furkan Gözükara SECourses•10/21/24, 10:09 PM

shown in coming video

CCarlos Hello, I want to try to finetune flux dev on a style rather than a character? An...

Furkan Gözükara SECourses•10/21/24, 10:10 PM

yes i have a full guide and research

Furkan Gözükara SECourses•10/21/24, 10:10 PM

https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX

MonsterMMORPG/3D-Cartoon-Style-FLUX · Hugging Face

Furkan Gözükara SECourses•10/21/24, 10:10 PM

please read fully

FFurkan Gözükara SECourses yes i have a full guide and research

Carlos•10/21/24, 11:16 PM

Thanks mate

FFurkan Gözükara SECourses https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX

SiggiSmilez•10/22/24, 6:24 AM

hi, do you know when the Fine Tune tutorial video will be online?

SSiggiSmilez hi, do you know when the Fine Tune tutorial video will be online?

Furkan Gözükara SECourses•10/22/24, 9:00 AM

hopefully today

Furkan Gözükara SECourses•10/22/24, 9:00 AM

currently generating subtitles

Furkan Gözükara SECourses•10/22/24, 9:01 AM

FFurkan Gözükara SECourses currently generating subtitles

cyberbol•10/22/24, 12:14 PM

cant wait, already prepared 4 sets of photos for training

FFurkan Gözükara SECourses hopefully today

sergio_gonzo•10/22/24, 12:24 PM

Dr Furkan do you have some flux base model favorites for training?

Ssergio_gonzo Dr Furkan do you have some flux base model favorites for training?

Furkan Gözükara SECourses•10/22/24, 1:12 PM

nope

Vigilence•10/22/24, 3:52 PM

@Furkan Gözükara SECourses Are you gonna do SD3.5 research next?

FFurkan Gözükara SECourses nope

sergio_gonzo•10/22/24, 4:03 PM

dr Furkan do you planing to do a titorial about trainiga style? i just saw the last video what i must change for a trining of a style?

sergio_gonzo•10/22/24, 5:06 PM

sorry dr furkan you already mentioned in your last video my quesiton about style

VVigilence <@205854764540362752> Are you gonna do SD3.5 research next?

Furkan Gözükara SECourses•10/22/24, 6:12 PM

yes hopefully

Ssergio_gonzo dr Furkan do you planing to do a titorial about trainiga style? i just saw the l...

Furkan Gözükara SECourses•10/22/24, 6:12 PM

we hjave it already

Furkan Gözükara SECourses•10/22/24, 6:12 PM

read here please : https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX

MonsterMMORPG/3D-Cartoon-Style-FLUX · Hugging Face

FFurkan Gözükara SECourses we hjave it already

Vigilence•10/22/24, 6:13 PM

Style will be your most popular video. I recommend doing a walkthrough on it. You can pick an art style that is copyright free if that was your concern.

Vigilence•10/22/24, 6:15 PM

https://www.arthistoryproject.com/about/copyright-information/public-domain/

Obelisk Art History

Public Domain

As much as possible, Obelisk Art History uses images of artworks and writings that are in the public domain. Works in the public domain are those whose...

VVigilence Style will be your most popular video. I recommend doing a walkthrough on it. ...

Furkan Gözükara SECourses•10/22/24, 6:16 PM

we literally have it there

Furkan Gözükara SECourses•10/22/24, 6:16 PM

https://huggingface.co/MonsterMMORPG/3D-Cartoon-Style-FLUX

MonsterMMORPG/3D-Cartoon-Style-FLUX · Hugging Face