Software Engineering Courses (SECourses)•13mo ago

is it possible to build up a finetuned or LoRA model - i.e. pictures of me, wife kids etc?

QQM is it possible to build up a finetuned or LoRA model - i.e. pictures of me, wife...

Furkan Gözükara SECourses•12/15/24, 1:38 AM

yes

Furkan Gözükara SECourses•12/15/24, 1:38 AM

have all of you in same pictures as well during training

Furkan Gözükara SECourses•12/15/24, 1:38 AM

and caption them

QMOP•12/15/24, 1:38 AM

have a good night

Furkan Gözükara SECourses•12/15/24, 1:40 AM

like ohwx man bbuk woman qwxx kid

Furkan Gözükara SECourses•12/15/24, 1:40 AM

i didnt test this but logic is like this

Furkan Gözükara SECourses•12/15/24, 1:40 AM

FFurkan Gözükara SECourses like ohwx man bbuk woman qwxx kid

QMOP•12/15/24, 1:40 AM

thank you

FFurkan Gözükara SECourses but you can do 6 parallel training 😄

QMOP•12/15/24, 1:54 AM

I am curious to maximise the PCs ability - with 6x 4090 and 512 DDR5 RAM (PCIe 5) - to train models faster

FFurkan Gözükara SECourses you can do multi step to get what you want 🙂

Sipriyani•12/15/24, 1:57 AM

doctor what exactly you mean with multi step?

Sipriyani•12/15/24, 1:59 AM

also another question, can I re-finetune, a flux model file which is already fine tuned?

dsienra•12/15/24, 3:54 AM

https://civitai.com/models/1034630/hunyuan-video-arnold-schwarzenegger-lora?modelVersionId=1160430 Great hunyuan lora trained only with 15 images, this video model generalize very well. very promising

QQM I am curious to maximise the PCs ability - with 6x 4090 and 512 DDR5 RAM (PCIe 5...

XCogni•12/15/24, 10:16 AM

sell the 6 4090s, buy 2 6000adas, or wait for the new blackwell chips coming out

FFurkan Gözükara SECourses like few seconds

Timson•12/15/24, 11:24 AM

and what is you time for swapping fine-tuned full checkpoints in SwarmUI? Mine like 120s per switch

There is this lines in debug log during model switch are they ok? clip_l is loaded and working during generation, and it says something about casting although I'm saving checkpoints as fp16

FFurkan Gözükara SECourses published : https://www.patreon.com/posts/117990364

J2_Nedo•12/15/24, 12:14 PM

thanx this is really good for our own made videos

QQM I am curious to maximise the PCs ability - with 6x 4090 and 512 DDR5 RAM (PCIe 5...

Furkan Gözükara SECourses•12/15/24, 2:27 PM

maybe multi gpu lora but i am not much hopeful

SSipriyani doctor what exactly you mean with multi step?

Furkan Gözükara SECourses•12/15/24, 2:28 PM

like train 1 time generate pictures pick good ones train another time

SSipriyani also another question, can I re-finetune, a flux model file which is already fin...

Furkan Gözükara SECourses•12/15/24, 2:28 PM

i wouldnt recommend

Furkan Gözükara SECourses•12/15/24, 2:28 PM

flux already very prone to overfit

Renzo•12/15/24, 2:51 PM

@Dr. Furkan Gözükara, in which cases do you use YOLOv9? I have observed that you add it to some prompts and I wonder what makes you decide to add it.

RRenzo @Dr. Furkan Gözükara, in which cases do you use YOLOv9? I have observed that you...

Timson•12/15/24, 2:53 PM

the cases where character face is likely to be small in the image composition

Timson•12/15/24, 2:57 PM

I'm experimenting with fine-tuned models and so far I'm not entirly convinced they are better than loras in all cases, especially without additional inpainting techniques.
Maybe they are still under-trained, but I tested 1800, 2000, 2500 training steps on different training images set sizes (17, 25, 40) with mixed results, some seeds yield good likeness but some miss completely with the same prompts.