Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

macba•9/13/24, 3:37 PM

I haven't looked at the training dataset--as far as you can tell, does it look like Flux understand 100% of facial expressions? 50%?

Mmacba I haven't looked at the training dataset--as far as you can tell, does it look l...

Furkan Gözükara SECourses•9/13/24, 3:37 PM

it understand alls

Furkan Gözükara SECourses•9/13/24, 3:37 PM

i shared dataset too

Furkan Gözükara SECourses•9/13/24, 3:37 PM

but lower res

macba•9/13/24, 3:39 PM

Everything like "anxious"? Like, if you put in a picture of yourself looking worried about something (dunno if you're that good of an actor

), do you think the model would pick it up and be able to reproduce it when the prompt asks for it?

Mmacba Everything like "anxious"? Like, if you put in a picture of yourself looking wor...

Furkan Gözükara SECourses•9/13/24, 3:59 PM

yep

Furkan Gözükara SECourses•9/13/24, 3:59 PM

model has great internal captioning system

FFurkan Gözükara SECourses what do you train sdxl?

Xcorpion•9/13/24, 7:05 PM

yeah yeah, anime style lora

XXcorpion yeah yeah, anime style lora

Furkan Gözükara SECourses•9/13/24, 9:05 PM

i dont have a very good config for sdxl lora atm

Furkan Gözükara SECourses•9/13/24, 9:05 PM

but training sdxl dreambooth / fine tuning and extracting lora works great

dxqb•9/14/24, 7:47 AM

what are they offering here?

Ddxqb what are they offering here?

Furkan Gözükara SECourses•9/14/24, 12:32 PM

something very inferior i guess

Furkan Gözükara SECourses•9/14/24, 12:32 PM

probably high batch size, high LR low step

dxqb•9/14/24, 12:34 PM

even if all that and even if they train only some layers of the model, 5 min and only 1 epoch seems extreme. They must have found something new?

Ddxqb even if all that and even if they train only some layers of the model, 5 min and...

Furkan Gözükara SECourses•9/14/24, 12:34 PM

i doubt that

dxqb•9/14/24, 12:35 PM

we'll see if civitai gets flooded with sh** flux loras soon

Furkan Gözükara SECourses•9/14/24, 12:35 PM

high batch, high LR, single layer makes sense

Ddxqb we'll see if civitai gets flooded with sh** flux loras soon

Furkan Gözükara SECourses•9/14/24, 12:35 PM

yep

dxqb•9/14/24, 12:36 PM

the fine print says 1 epoch. so it isn't high batch or massive parallelization, it's just 1 epoch.

dxqb•9/14/24, 12:36 PM

I don't have any of their tokens to try, but would be interested if someone her has

dxqb•9/14/24, 12:36 PM

*here

Ddxqb the fine print says 1 epoch. so it isn't high batch or massive parallelization, ...

Furkan Gözükara SECourses•9/14/24, 12:45 PM

1 epoch but how many repeats

dxqb•9/14/24, 12:49 PM

repeats are a kohya thing, 1 epoch in the general context of ML usually means going once through your dataset. And look here, 2,5 minutes. Even if you used multiple GPUs, it cannot mean much more than going through your dataset once with the s/it I have seen so far on flux

dxqb•9/14/24, 12:55 PM

that being said, I share your doubts

Ddxqb repeats are a kohya thing, 1 epoch in the general context of ML usually means go...

Furkan Gözükara SECourses•9/14/24, 1:31 PM

i know but civitai already uses kohya repeating

when i first trained they were at least

Ddxqb repeats are a kohya thing, 1 epoch in the general context of ML usually means go...

Furkan Gözükara SECourses•9/14/24, 1:32 PM

their description i think means that you dont get checkpoints not necessarly 1 repeat

Yog-Sototh•9/14/24, 2:41 PM

I have question about training and captions please : How many images you think, for a Pose lora including 2 or multiple characters should be in the folder, and repeats ? And also my captionning, can I send one here with the related image ? It is Sfw but may contain violence, soo i prefer to ask ^^

YYog-Sototh I have question about training and captions please : How many images you think, ...

Furkan Gözükara SECourses•9/14/24, 2:44 PM

you can dm me

novsky•9/14/24, 4:04 PM

sooo...I've tried some lora trainings recently. What can I say. Sometimes results are pretty good on 70-80 epochs (once on 50 epochs) and sometimes 200 epochs are not good enough. I guess it all depends on dataset.

novsky•9/14/24, 4:06 PM

and training on realistic dataset will not give you any cartoonish (comics) style output. Because it's too overtrained on realistic images. I did sample check every 40 epochs (5 checks during training) and after 80th epoch cartoon style becomes realistic

wardensc2•9/15/24, 10:38 AM

Hi @Furkan Gözükara SECourses can you create another train preset using 24gb Vram to train fp16 Lora. I trained using Rank_3_18950MB. The lora is fp8 compare with fp16 training in your Rank 1 or Rank 2 presets, the prompt understanding of the fp8 lora is reduce and the result of fp8 is so far not satisfy my need

wardensc2•9/15/24, 10:38 AM

Thank you in advance

wardensc2•9/15/24, 10:39 AM

Maybe you can create new preset taking longer time to train but still use only 24gb Vram

dxqb•9/15/24, 10:51 AM

I have just started with Flux, but using onetrainer and bf16 I am below 12 GB vram...

how about training time on a A6000 - what should one expect for a 15 person picture Lora with your c

Similar Threads

Similar Threads

Similar Threads