Software Engineering Courses (SECourses)•17mo ago

what the hell could be the problem

FFurkan Gözükara SECourses I can try prompt what is it exactly?

it was "ohwx woman as snow white" but i guess you can try maybe "[trigger] man as Aladdin" instead since your Lora would be male.
If its a photoreal image, add "cartoon image of [trigger] man as Aladdin"

FFurkan Gözükara SECourses haha 200 epoch high LR completely memorized

Haashim•8/20/24, 9:03 PM

How did you caption the images?

Ddaroth what the hell could be the problem

clarkcheekykent•8/20/24, 9:04 PM

did you already click submit? just refresh page on the training page it should start. I had trained one lora already.

darothOP•8/20/24, 9:04 PM

I managed to resubmit it with the default training params. not sure how well dim2 will work to be honest

HHaashim How did you caption the images?

Furkan Gözükara SECourses•8/20/24, 9:05 PM

Ohwx man

Cclarkcheekykent it was "ohwx woman as snow white" but i guess you can try maybe "[trigger] man a...

Furkan Gözükara SECourses•8/20/24, 9:05 PM

But this prompt doesn't make sense

darothOP•8/20/24, 9:06 PM

just ohwx man? I thought flux likes natural language caps

FFurkan Gözükara SECourses But this prompt doesn't make sense 🙂

clarkcheekykent•8/20/24, 9:11 PM

i meant "ohwx man as Aladdin", why does it not make sense?

for example here is "Joe Biden as Aladdin"

Dazzastrous [4090]•8/20/24, 9:11 PM

hahha

Dazzastrous [4090]•8/20/24, 9:11 PM

and wheres the Aladdin version?

clarkcheekykent•8/20/24, 9:12 PM

It attempted to at least generate Joe Biden in Aladdin cartoon style with some features lke the colors similar to Aladdin style. What I'm seeing with my Lora is it just creates snow white exactly as she is in cartoons instead of with my persons likeness

Dazzastrous [4090]•8/20/24, 9:14 PM

have you seen five below zero's lora training quite informative too but hes a comfyui

clarkcheekykent•8/20/24, 9:14 PM

it works with "Hilary Clinton as Snow White"

Dazzastrous [4090]•8/20/24, 9:14 PM

very good

Dazzastrous [4090]•8/20/24, 9:15 PM

now we get to see what bill sees behind closed doors

Dazzastrous [4090]•8/20/24, 9:15 PM

take a bite yeh enjoy that appleeee

Dazzastrous [4090]•8/20/24, 9:16 PM

still im glad you cropped him out bending over

dxqb•8/20/24, 9:23 PM

what the best UI currently to try out flux?

Cclarkcheekykent it works with "Hilary Clinton as Snow White"

Furkan Gözükara SECourses•8/20/24, 9:29 PM

2127-photo20of20ohwx20man20as20aladdinsegmentfac-flux1-dev-1241851401.png

Furkan Gözükara SECourses•8/20/24, 9:29 PM

here me as aladdin

Ddxqb what the best UI currently to try out flux?

Furkan Gözükara SECourses•8/20/24, 9:29 PM

swarm

FFurkan Gözükara SECourses Click to see attachment

Dazzastrous [4090]•8/20/24, 9:30 PM

hehehe

sexyboi•8/20/24, 9:30 PM

@Dr. Furkan Gözükara what are your current impressions on the necessary training time of flux vs sdxl?

Ssexyboi @Dr. Furkan Gözükara what are your current impressions on the necessary training...

Furkan Gözükara SECourses•8/20/24, 9:30 PM

i am testing same atm same dataset

Furkan Gözükara SECourses•8/20/24, 9:30 PM

still in research

Dazzastrous [4090]•8/20/24, 9:30 PM

you want quality you gotta wait a lil longer

DDazzastrous [4090]you want quality you gotta wait a lil longer

Furkan Gözükara SECourses•8/20/24, 9:31 PM

fine tuning will have better quality

Furkan Gözükara SECourses•8/20/24, 9:31 PM

this is lora

Furkan Gözükara SECourses•8/20/24, 9:31 PM

i will next research fine tuning

Dazzastrous [4090]•8/20/24, 9:32 PM

although Ive seen some train lora on flux with around 13 epochs

Dazzastrous [4090]•8/20/24, 9:32 PM

11 to 13 seems the sweet spot

FFurkan Gözükara SECourses fine tuning will have better quality

Dazzastrous [4090]•8/20/24, 9:33 PM

looks pretty good to me alrteady Doc

FFurkan Gözükara SECourses fine tuning will have better quality

dxqb•8/20/24, 9:34 PM

OneTrainer dev is making the claim that you can have finetuning quality when using Dora-Loras, that they have recently implemented and I think Kohya had for a while

dxqb•8/20/24, 9:34 PM

I've not tested it, just might be something interesting for you

Dazzastrous [4090]•8/20/24, 9:35 PM

Dora Loras hehe just rolls of the tongue

dxqb•8/20/24, 9:35 PM

it's only called DoRA, I just added LoRA to make clear that it's just another type of lora

Dazzastrous [4090]•8/20/24, 9:36 PM

All we need is Sora Dora Loras

DDazzastrous [4090]All we need is Sora Dora Loras

dxqb•8/20/24, 9:37 PM

paper by Liu, Wang, Yin andChen

dxqb•8/20/24, 9:37 PM

https://arxiv.org/abs/2402.09353

arXiv.org

DoRA: Weight-Decomposed Low-Rank Adaptation

Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these methods and full fine-tuning (FT). In this work, we first introduce a novel weight decomposition analysis t...

dxqb•8/20/24, 9:37 PM

future of AI seems Chinese when you look at the authors of so many papers

FFurkan Gözükara SECourses swarm

cap10•8/20/24, 9:44 PM

can you use flux loras in swarm ?

DDazzastrous [4090]looks pretty good to me alrteady Doc

Furkan Gözükara SECourses•8/20/24, 10:17 PM

yep

Ddxqb OneTrainer dev is making the claim that you can have finetuning quality when usi...

Furkan Gözükara SECourses•8/20/24, 10:17 PM

dora is supposed to be

Ccap10 can you use flux loras in swarm ?

Furkan Gözükara SECourses•8/20/24, 10:17 PM

yep i am using

Furkan Gözükara SECourses•8/20/24, 10:17 PM

right now

Furkan Gözükara SECourses•8/20/24, 10:18 PM

Ddxqb https://arxiv.org/abs/2402.09353

Furkan Gözükara SECourses•8/20/24, 10:18 PM

supir is chinese model

dxqb•8/20/24, 10:24 PM

just installed some old hdd to have more space for .safetensors. damn this is slow. don't switch from NVMe to HDD

FFurkan Gözükara SECourses Click to see attachment

clarkcheekykent•8/20/24, 10:33 PM

It works on photo real images, because model replaces all photo real men with the trained data.

But it doesnt learn what 'ohwx' tag means. So try adding "Cartoon image of ohwx man as Aladdin" see if it still keeps some of the ohwx features

Ddxqb just installed some old hdd to have more space for .safetensors. damn this is sl...

Furkan Gözükara SECourses•8/20/24, 10:37 PM

it is painful

what the hell could be the problem

Similar Threads