Software Engineering Courses (SECourses)•17mo ago

I saw these instructions, but I haven't gotten around to messing with this yet `1. git clone the lin

I saw these instructions, but I haven't gotten around to messing with this yet

1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
    
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
    
3. edit app.py to remove all the gradio and spaces junk
    
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
    
5. print(stream_chat(Image.open("/path/to/boobas.png")))
    
6. ???
    
7. profit

1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
    
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
    
3. edit app.py to remove all the gradio and spaces junk
    
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
    
5. print(stream_chat(Image.open("/path/to/boobas.png")))
    
6. ???
    
7. profit

1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
    
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
    
3. edit app.py to remove all the gradio and spaces junk
    
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
    
5. print(stream_chat(Image.open("/path/to/boobas.png")))
    
6. ???
    
7. profit

1. git clone the linked repo, it has the trained clip-to-llama thingamajig included already
    
2. setup the venv, or if you are lazy like me, use an existing venv from one of the other billion projects with a superset of this one's requirements.txt
    
3. edit app.py to remove all the gradio and spaces junk
    
4. replace "meta-llama/Meta-Llama-3.1-8B" with "unsloth/Meta-Llama-3.1-8B-bnb-4bit" to save space and not have to authenticate with hf
    
5. print(stream_chat(Image.open("/path/to/boobas.png")))
    
6. ???
    
7. profit

Furkan Gözükara SECourses•8/20/24, 8:00 PM

looks like a good caption

Furkan Gözükara SECourses•8/20/24, 8:00 PM

i can make local installer

�𝔸𝖨ΞӾ I saw these instructions, but I haven't gotten around to messing with this yet `...

vp•8/20/24, 8:01 PM

ok not bad, its using a hot llama 3.1 for captioning. that's acceptable and meets the requirements.

�𝔸𝖨ΞӾ I saw these instructions, but I haven't gotten around to messing with this yet `...

vp•8/20/24, 8:02 PM

I'll set it up in the next few days and chime in on findings

FFurkan Gözükara SECourses looks like a good caption

vp•8/20/24, 8:06 PM

Damn, thats on point

vp•8/20/24, 8:08 PM

The only thing that's missing is it saying, "It features the well-known ai tutelage professor Dr. Furkan Gözükara of github and youtube fame'

Furkan Gözükara SECourses•8/20/24, 8:14 PM

New test results starting to arrive

Results are really good however I had to train 200 epochs

I wonder if I can reduce number of epochs necessity

Furkan Gözükara SECourses•8/20/24, 8:21 PM

thread updated more configs and grids and results added : https://www.patreon.com/posts/110293257

Patreon

Kohya FLUX LoRA and Fine Tuning Training Full Tutorial For Local Wi...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Neuromasters•8/20/24, 8:29 PM

identical models

FFurkan Gözükara SECourses it still make sense according to the situation

clarkcheekykent•8/20/24, 8:31 PM

I'm wondering if its even doing anything. Because for example i tried "ohwx womas as snow white" and the lora is not even activated, just creates a cartoon image of snow white exactly how snow white is despite lora weight 100% and photo real images on same lora result in very close likeness.

It seems like the lora is only activating on photo real images, and at that point adding ohwx does nothing to change the image,

so the flux loras right now just seems to work by replace all men/women with trained person when its generating photo real image with a man/woman.

Darth Teethius•8/20/24, 8:33 PM

I read on reddit there are parameters realized by kohya that bring lora flux training under 12gb vram. I cant find anything of the like. Anyone seen these alleged parameters?

Cclarkcheekykent I'm wondering if its even doing anything. Because for example i tried "ohwx woma...

Furkan Gözükara SECourses•8/20/24, 8:47 PM

I can try prompt what is it exactly?

DDarth Teethius I read on reddit there are parameters realized by kohya that bring lora flux tra...

Furkan Gözükara SECourses•8/20/24, 8:47 PM

Those param Currently using 18gb instead of 12 I have reported

daroth•8/20/24, 8:50 PM

any of you tried out the civitai onsite trainer for flux?

daroth•8/20/24, 8:54 PM

what the hell could be the problem

FFurkan Gözükara SECourses I can try prompt what is it exactly?

clarkcheekykent•8/20/24, 8:58 PM

it was "ohwx woman as snow white" but i guess you can try maybe "[trigger] man as Aladdin" instead since your Lora would be male.
If its a photoreal image, add "cartoon image of [trigger] man as Aladdin"

FFurkan Gözükara SECourses haha 200 epoch high LR completely memorized

Haashim•8/20/24, 9:03 PM

How did you caption the images?

Ddaroth what the hell could be the problem

clarkcheekykent•8/20/24, 9:04 PM

did you already click submit? just refresh page on the training page it should start. I had trained one lora already.

daroth•8/20/24, 9:04 PM

I managed to resubmit it with the default training params. not sure how well dim2 will work to be honest

HHaashim How did you caption the images?

Furkan Gözükara SECourses•8/20/24, 9:05 PM

Ohwx man

Cclarkcheekykent it was "ohwx woman as snow white" but i guess you can try maybe "[trigger] man a...

Furkan Gözükara SECourses•8/20/24, 9:05 PM

But this prompt doesn't make sense

daroth•8/20/24, 9:06 PM

just ohwx man? I thought flux likes natural language caps

FFurkan Gözükara SECourses But this prompt doesn't make sense 🙂

clarkcheekykent•8/20/24, 9:11 PM

i meant "ohwx man as Aladdin", why does it not make sense?

for example here is "Joe Biden as Aladdin"

Dazzastrous [4090]•8/20/24, 9:11 PM

hahha

Dazzastrous [4090]•8/20/24, 9:11 PM

and wheres the Aladdin version?

clarkcheekykent•8/20/24, 9:12 PM

It attempted to at least generate Joe Biden in Aladdin cartoon style with some features lke the colors similar to Aladdin style. What I'm seeing with my Lora is it just creates snow white exactly as she is in cartoons instead of with my persons likeness

Dazzastrous [4090]•8/20/24, 9:14 PM

have you seen five below zero's lora training quite informative too but hes a comfyui

clarkcheekykent•8/20/24, 9:14 PM

it works with "Hilary Clinton as Snow White"

Dazzastrous [4090]•8/20/24, 9:14 PM

very good

Dazzastrous [4090]•8/20/24, 9:15 PM

now we get to see what bill sees behind closed doors

Dazzastrous [4090]•8/20/24, 9:15 PM

take a bite yeh enjoy that appleeee

Dazzastrous [4090]•8/20/24, 9:16 PM

still im glad you cropped him out bending over

dxqb•8/20/24, 9:23 PM

what the best UI currently to try out flux?

Cclarkcheekykent it works with "Hilary Clinton as Snow White"

Furkan Gözükara SECourses•8/20/24, 9:29 PM

2127-photo20of20ohwx20man20as20aladdinsegmentfac-flux1-dev-1241851401.png

Furkan Gözükara SECourses•8/20/24, 9:29 PM

here me as aladdin

Ddxqb what the best UI currently to try out flux?

Furkan Gözükara SECourses•8/20/24, 9:29 PM

swarm

FFurkan Gözükara SECourses Click to see attachment

Dazzastrous [4090]•8/20/24, 9:30 PM

hehehe

sexyboi•8/20/24, 9:30 PM

@Dr. Furkan Gözükara what are your current impressions on the necessary training time of flux vs sdxl?

Ssexyboi @Dr. Furkan Gözükara what are your current impressions on the necessary training...

Furkan Gözükara SECourses•8/20/24, 9:30 PM

i am testing same atm same dataset

Furkan Gözükara SECourses•8/20/24, 9:30 PM

still in research

Dazzastrous [4090]•8/20/24, 9:30 PM

you want quality you gotta wait a lil longer

DDazzastrous [4090]you want quality you gotta wait a lil longer

Furkan Gözükara SECourses•8/20/24, 9:31 PM

fine tuning will have better quality

Furkan Gözükara SECourses•8/20/24, 9:31 PM

this is lora

Furkan Gözükara SECourses•8/20/24, 9:31 PM

i will next research fine tuning

Dazzastrous [4090]•8/20/24, 9:32 PM

although Ive seen some train lora on flux with around 13 epochs

Dazzastrous [4090]•8/20/24, 9:32 PM

11 to 13 seems the sweet spot

FFurkan Gözükara SECourses fine tuning will have better quality

Dazzastrous [4090]•8/20/24, 9:33 PM

looks pretty good to me alrteady Doc

FFurkan Gözükara SECourses fine tuning will have better quality

dxqb•8/20/24, 9:34 PM

OneTrainer dev is making the claim that you can have finetuning quality when using Dora-Loras, that they have recently implemented and I think Kohya had for a while

dxqb•8/20/24, 9:34 PM

I've not tested it, just might be something interesting for you

Dazzastrous [4090]•8/20/24, 9:35 PM

Dora Loras hehe just rolls of the tongue

I saw these instructions, but I haven't gotten around to messing with this yet `1. git clone the lin

Similar Threads