Software Engineering Courses (SECourses)•16mo ago

@Dr. Furkan Gözükara Can I set the weight of lora used during generating samples while it's training

@Dr. Furkan Gözükara Can I set the weight of lora used during generating samples while it's training or anyway to know what weight it used to generate those samples?

FFurkan Gözükara SECourses why dont you use kohya?

AiMan1993•9/13/24, 11:04 AM

Sure I can give try

AiMan1993•9/13/24, 11:04 AM

I want to replicate a meme actually - naming Kwen

AiMan1993•9/13/24, 11:05 AM

For e.g. this character

AiMan1993•9/13/24, 11:05 AM

AiMan1993•9/13/24, 11:05 AM

I took this from net but lets assume this is not there in the net

AiMan1993•9/13/24, 11:05 AM

and the model havent seen the character at all

AiMan1993•9/13/24, 11:06 AM

so what configuarations will give me the best results

AiMan1993•9/13/24, 11:06 AM

How many pictures I will need

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 @Dr. Furkan Gözükara Can I set the weight of lora used during generating samples...

Furkan Gözükara SECourses•9/13/24, 11:07 AM

i dont use samples usually not working

Furkan Gözükara SECourses•9/13/24, 11:07 AM

or breaking training :d

AiMan1993•9/13/24, 11:07 AM

So model has no information about Kwen it doesnt know anything but I want to generate such that it hangs out with Mickey Mouse

AAiMan1993 So model has no information about Kwen it doesnt know anything but I want to gen...

Furkan Gözükara SECourses•9/13/24, 11:07 AM

with dataset you can make

AiMan1993•9/13/24, 11:08 AM

So how many pictures will I need? LoRA ranking? Captioning of image? There is florence 2 built in with ai toolkit but isnt great at captioning

AAiMan1993 So how many pictures will I need? LoRA ranking? Captioning of image? There is fl...

Furkan Gözükara SECourses•9/13/24, 11:20 AM

more better

Furkan Gözükara SECourses•9/13/24, 11:20 AM

we have full configs on patreon use according to your vram

Furkan Gözükara SECourses•9/13/24, 11:20 AM

i dont suggeest captions

AiMan1993•9/13/24, 12:08 PM

yes I have subscribed to your patreon

AiMan1993•9/13/24, 12:34 PM

Will I be able to use it with ComfyUI?

AiMan1993•9/13/24, 12:34 PM

after fine tuning with Kohya?

AAiMan1993 after fine tuning with Kohya?

Furkan Gözükara SECourses•9/13/24, 12:46 PM

of course

Furkan Gözükara SECourses•9/13/24, 12:46 PM

i use with swarmui it uses comfyui as back end

AiMan1993•9/13/24, 12:47 PM

Nice!

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮OP•9/13/24, 1:05 PM

@Dr. Furkan Gözükara What to do about bleeding? I have tried lower network and lower learning rates but can't stop bleeding

TTOPUI If my current image size is 16:9 and the resolution is 1024X576, is this how the...

Kallamamran•9/13/24, 1:18 PM

No. You only specify one value for vertical AND horizontal resolution. The training is on square images. You should specify 1024 in your case. The images will be bucketed if they ar not square or if they are a different (higher) resolution than what's being trained.

Kallamamran•9/13/24, 1:19 PM

@Dr. Furkan Gözükara https://huggingface.co/blog/MonsterMMORPG/ultimate-flux-lora-training-tutorial <- Is 404

FFurkan Gözükara SECourses yes dataset is king

sergio_gonzo•9/13/24, 1:30 PM

Dr Furkan there is new settinsg that improve the velocity of trianing for a 4070 ti super 16 vram actualli is 10 its i don rmeember the nomenclaure in rank 5

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 @Dr. Furkan Gözükara What to do about bleeding? I have tried lower network and l...

Furkan Gözükara SECourses•9/13/24, 1:44 PM

i couıldnt stop yet either

KKallamamran @Dr. Furkan Gözükara https://huggingface.co/blog/MonsterMMORPG/ultimate-flux-lo...

Furkan Gözükara SECourses•9/13/24, 1:45 PM

ye they silently

Furkan Gözükara SECourses•9/13/24, 1:45 PM

deleted

Furkan Gözükara SECourses•9/13/24, 1:45 PM

here https://medium.com/@furkangozukara/ultimate-flux-lora-training-tutorial-windows-and-cloud-deployment-abb72f21cbf8

Medium

Ultimate FLUX LoRA Training Tutorial: Windows and Cloud Deployment

I have done total 104 different LoRA trainings and compared each one of them to find the very best hyper parameters and the workflow for…

Ssergio_gonzo Dr Furkan there is new settinsg that improve the velocity of trianing for a 4070...

Furkan Gözükara SECourses•9/13/24, 1:45 PM

10 second / it not bad

FFurkan Gözükara SECourses i couıldnt stop yet either

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮OP•9/13/24, 1:46 PM

Saw people talking about trainning lokr in simpletuner and that completly stops bleeding. Is it available in kohya and does swarm ui support lokr?

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 Saw people talking about trainning lokr in simpletuner and that completly stops ...

Furkan Gözükara SECourses•9/13/24, 1:47 PM

i think not

Furkan Gözükara SECourses•9/13/24, 1:47 PM

also their quality was subpar

Furkan Gözükara SECourses•9/13/24, 1:47 PM

if lokr fixes it probably fine tuning will too

FFurkan Gözükara SECourses i think not

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮OP•9/13/24, 1:48 PM

Your khoya installer and swarm ui installer for Runpod updates them automatically?

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 Your khoya installer and swarm ui installer for Runpod updates them automaticall...

Furkan Gözükara SECourses•9/13/24, 1:49 PM

kohya doesnt have lokr

Furkan Gözükara SECourses•9/13/24, 1:49 PM

i think it is also not supported yet

Furkan Gözükara SECourses•9/13/24, 1:50 PM

dont know though

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮OP•9/13/24, 1:50 PM

@Dr. Furkan Gözükara I mean your khoya installer and swarm ui installer for Runpod updates both of them automatically or do we have to update manually?

Kallamamran•9/13/24, 1:53 PM

Shit! I something have happened with my computer. Generating the same image with the same settings on my 4090 at work takes 26 sec. On my 3090 at home it never finishes because the VRAM-usage spikes

Kallamamran•9/13/24, 1:54 PM

At work it uses 13GB VRAM and about 23GB RAM. At home it uses all 24GB VRAM and then starts with the shared memory