Software Engineering Courses (SECourses)•16mo ago

what does flow shift do? OT doesn't have that

mikemenders•9/20/24, 11:40 AM

While experimenting with Flux, I'm looking at the Pony models because the realistic models are getting better. However, not all models like Lora's and they are unstable.
I have trained a few Lora's on the ponyRealism_v21VAE model, and it seems most realistic Pony models can use the Lora trained on this model.
I have a total of 23 Pony-based models in my system. I have checked 6 seeds on each of them with the same prompt and three different samplers (Euler_a, DPM++ 2M Karras and DPM++ 3M SDE Karras) to see which one best reproduces the original face. I used a CompreFace script to check the final result against the image I used to train the model.
The best models was realDream_pony10 with DPM++ 2M Karras and cyberrealisticPony_v63 with Euler_a. This also gave me a result of 0.95, but I got results above 0.9 instead, and that too in 50% of the cases (so 3 out of 6 seeds were above 0.9).
So it's really hard to train a good person Lora for Pony models, but it's not impossible, and even if I don't get as good results with it as I did with SD 1.5 (where I often had 0.98-0.99 identity!), I'm slowly getting the results I've been looking for. The plain SDXL and Flux are out of the question for now, because I need the NSFW pose and camera knowledge of the Pony in these models, which they don't have at the moment. They take nice pictures, but they are dumb in NSFW. And when I use stacked Lora, the face is distorted in most cases.
As a bonus, here's a prompt that I've used to achieve a nearly similar effect on models weaker than Flux if you want to take nice photos:
'cinematic film still, shallow depth of field, vignette, highly detailed, high budget, bokeh, cinemascope, moody, epic, gorgeous, film grain, grainy'

druhl•9/20/24, 12:47 PM

Do you guys still check the 'bucketing' option? I don't see it being checked in the configs. Also, do you guys try to maintain aspect ratio in style training as well or dataset* images with varying aspect ratios are acceptable with Flux?

SnicksterJay•9/20/24, 2:12 PM

this is a very noob question but I downloaded the flux safetensors to do flux training. I see the safetensors in my file explorer, but once I try to select them within Kohya GUI i can't find it for the life of me. It doesn't even show up when i browse within GUI. It is the flux1-dev safetensors you download using the patreon one click. What can i do that will get Kohya GUI to recognize or see the flux model safetensors?

SSnicksterJay this is a very noob question but I downloaded the flux safetensors to do flux tr...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•9/20/24, 2:15 PM

make sure all file type is selected at the bottom right when you are in the file browsing window

Ddruhl Do you guys still check the 'bucketing' option? I don't see it being checked in ...

dxqbOP•9/20/24, 2:40 PM

sure. bucketing just got a lot more interesting, because Flux is able to learn from low resolutions well

druhl•9/20/24, 3:49 PM

Well, I do have tons of low res images on the subject lol

Alittle Snack•9/20/24, 4:18 PM

What LoRA file sizes are folks getting with Dim/Alpha 128/128 - mine are coming in somewhat huge at almost 3Gb - is this just a Flux thing? any way to reduce them down to something more readably sharable?

mikemenders•9/20/24, 4:47 PM

I am trying JoyCaption. I see this error message in the console after opening the image:
"Too little data for declared Content-Length"
What's my problem?

AAlittle Snack What LoRA file sizes are folks getting with Dim/Alpha 128/128 - mine are coming ...

JohnDopamine•9/20/24, 4:48 PM

64 or 32 work well enough in my experience.....don't think you can compress them after the fact though.....

JohnDopamine•9/20/24, 4:49 PM

Pretty sure Ostris's AI-toolkit defaulted to 16 even when he first enabled Flux training

JJohnDopamine 64 or 32 work well enough in my experience.....don't think you can compress them...

Alittle Snack•9/20/24, 4:53 PM

I'll try a bit lower. I had tried 96/96 but it didn't seem to change the filesize at all

Alittle Snack•9/20/24, 4:55 PM

My case is a but unusual since I don't actually want 100% likeness. I'm training using 3D render images that I want to look realistic - I had great success with this in SD1.5 and Pony so trying to get the same with Flux - it's working but the speed and sizes are all just exponentially worse

SSnicksterJay this is a very noob question but I downloaded the flux safetensors to do flux tr...

Error-404-unknown•9/20/24, 5:41 PM

Where did you save it to? Is it still in your downloads? I load mine from my models folder in comfy but if you try to find it in kohya it doesn't show, instead you need to find it in windows explorer and then copy/pate the file path (left click on the safetensor and choose copy as path) don't forget to delete the " " after you paste. Hope this helps.

xlads•9/20/24, 6:04 PM

FFurkan Gözükara SECourses kohya doesnt have dora as far as i know

dxqbOP•9/20/24, 6:15 PM

I'd be interesting in a comparison with your full finetune

Punkxy•9/20/24, 7:25 PM

Hello!
I have a question about training a lora for flux using kohya_ss:
In this video:
https://youtu.be/nySGu12Y05k?si=RTyjp8IjxfQ5GRXn

Dr. Furkan used some .bat files to install kohya_ss and a different .bat file to install torch afterwards, and on top of that, wrote in text in the video that there will be some update for it in the patreon files and that it works slow right now on Windows, and then he edited the video bringing newer info that a newer version came out... anyways I got confused there and I wanted to ask what are the most updated and relevant requirements to train flux in kohya on windows?

What if I have Kohya_ss latest version installed (24.1.7)(Installed it last week on 10.9.24 on a new pc with 4090), but it seems like it installed along with it torch 2.1.2+cu118, and in the video of Dr. Furkan, it appears that he's using another version.
Do I nees to update something?
Just wanna know if I need to install it all over again or what I got installed is good to go/update the relevant things.

And one last thing, it seems that my Kohya_ss interface doesn't have those checkboxes for "SDXL, SD3, Flux.1", I wonder why am missing those even though this is the latest kohya version?

Thanks for everyone who got so far reading this

I hope I'll get it all sorted out ASAP and get starting on making some fun loras, I'm excited

YouTubeSECourses

FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI ...

Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...

Punkxy•9/20/24, 7:26 PM

I'm talking about those checkboxes btw

МИШАНЯ•9/20/24, 7:35 PM

Friends. Forge, flux. Very long time began to generate images - 4 images are generated in the area of 20 minutes (I have a 3070ti) I generate at a resolution of 896x1125

PPunkxy Hello! I have a question about training a lora for flux using kohya_ss: In this ...

Error-404-unknown•9/20/24, 8:07 PM

Hi Punkyxy, yes you need the SD3 branch of Kohya the regular branch won't work for Flux, you can find the zip file and instructions from Dr Furkan here https://www.patreon.com/posts/110879657?utm_campaign=postshare_fan&utm_content=android_share

Patreon

Kohya FLUX LoRA Training Full Tutorial For Local Windows and Cloud ...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

ММИШАНЯ Friends. Forge, flux. Very long time began to generate images - 4 images are gen...

Error-404-unknown•9/20/24, 8:16 PM

Hi Misha, are you trying to generate a batch of 4 images at one time? If yes then maybe you can try to lower the batch to 1. It sounds like you are using too much VRAM which is causing the system to use RAM which is very very slow. Also have you disabled System fallback in the CUDA settings on your Nvida settings? https://support.cognex.com/docs/deep-learning_330/web/EN/deep-learning/Content/deep-learning-Topics/optimization/gpu-disable-shared.htm?TocPath=Optimization%20Guidelines%7CNVIDIA%C2%AE%20GPU%20Guidelines%7C_____6#:~:text=Open%20the%20NVIDIA%20Control%20Panel,from%20the%20drop%2Ddown%20menu.

EError-404-unknown Hi Misha, are you trying to generate a batch of 4 images at one time? If yes the...

МИШАНЯ•9/20/24, 8:17 PM

I've already figured it out, thanks, the thing was that I cfg set 1.1 and entered negative promt, I was told to set the value to 1 and remove the negative promt - it helped me a lot.

МИШАНЯ•9/20/24, 8:18 PM

Could you please tell me what is known about ControlNet for flux? Or are there currently alternative ways to transfer the appearance? (Besides Lora, of course)

ММИШАНЯ Could you please tell me what is known about ControlNet for flux? Or are there c...

Error-404-unknown•9/20/24, 8:20 PM

I haven't tried it yet but I've seen they have INSTANTID for Flux now, it is similar to Ipadapter faceID. Maybe you could give that ago.

EError-404-unknown I haven't tried it yet but I've seen they have INSTANTID for Flux now, it is si...

МИШАНЯ•9/20/24, 8:21 PM

https://huggingface.co/InstantX/InstantID Is that what you're talking about?

InstantX/InstantID · Hugging Face

МИШАНЯ•9/20/24, 8:30 PM

@Error-404-unknown Am I doing something wrong? Why is my model not showing up?...?

МИШАНЯ•9/20/24, 8:30 PM

Punkxy•9/20/24, 8:32 PM

Probably just click on the refresh button to the right of the model tab and it should appear then

PPunkxy Probably just click on the refresh button to the right of the model tab and it s...

МИШАНЯ•9/20/24, 8:33 PM

I clicked and restarted Forge - didn't help

Punkxy•9/20/24, 8:33 PM

Or alternatively check Instand-ID instead of All

Punkxy•9/20/24, 8:34 PM

Oh wait what model did u download though

МИШАНЯ•9/20/24, 8:34 PM

diffusion_pytorch_model
https://huggingface.co/InstantX/InstantID/tree/main/ControlNetModel

InstantX/InstantID at main

ММИШАНЯ https://huggingface.co/InstantX/InstantID Is that what you're talking about?

Error-404-unknown•9/20/24, 8:34 PM

Yes this is it, I saw a guy on reddit was using it but he didn't include a workflow and I've just had a quick look around but can't see instructions for Flux yet.

ММИШАНЯ diffusion_pytorch_model https://huggingface.co/InstantX/InstantID/tree/main/Cont...

МИШАНЯ•9/20/24, 8:35 PM

Did I do something wrong?

Punkxy•9/20/24, 8:37 PM

Ok then all I think of is check Instand-ID
and click the blue refresh button to the right of the model, and see if the model appears in the tab list (do not restart forge)

Punkxy•9/20/24, 8:38 PM

If u try it for flux no idea then

PPunkxy Ok then all I think of is check Instand-ID and click the blue refresh button to ...

МИШАНЯ•9/20/24, 8:38 PM

I checked all these models by updating via the blue button - it didn't show up

PPunkxy If u try it for flux no idea then

МИШАНЯ•9/20/24, 8:38 PM

Yeah for flux, it doesn't work?

Punkxy•9/20/24, 8:39 PM

Ah I dunno then

МИШАНЯ•9/20/24, 8:39 PM

(((

PPunkxy Ah I dunno then

МИШАНЯ•9/20/24, 8:39 PM

Forge\webui\extensions\sd-webui-controlnet\models
Is this the right way?

ММИШАНЯ Forge\webui\extensions\sd-webui-controlnet\models Is this the right way?

Error-404-unknown•9/20/24, 8:48 PM

Sorry but I don't use forge, only comfy/swarm and Fooocus.

EError-404-unknown Sorry but I don't use forge, only comfy/swarm and Fooocus.

МИШАНЯ•9/20/24, 8:50 PM

What's the swarm ?) First time I've heard of it. I tried to work in Comfy, honestly I didn't like it, I switched to Forge with AUTO1111 because of flux support, but the fact that I can't transfer faces makes me very sad....

ММИШАНЯ What's the swarm ?) First time I've heard of it. I tried to work in Comfy, hones...

Error-404-unknown•9/20/24, 8:55 PM

SwarmUI (formerly StabilitySwarm) is basically comfyui but with an a1111/forge style front end. It made by the same team as comfyui but is considered more user friendly.

EError-404-unknown SwarmUI (formerly StabilitySwarm) is basically comfyui but with an a1111/forge s...

МИШАНЯ•9/20/24, 8:57 PM

Ah well, read it, saw it, thank you. If I can't get it to activate in Forge, I'll try Swarm

МИШАНЯ•9/20/24, 8:57 PM

Swarm supports flux, doesn't it?

ММИШАНЯ What's the swarm ?) First time I've heard of it. I tried to work in Comfy, hones...

Error-404-unknown•9/20/24, 8:58 PM

The other option is to generate your image in flux without faceswap, then transfer to img2img and then use reactor or roop-unleashed to swap the face using SDXL

EError-404-unknown The other option is to generate your image in flux without faceswap, then transf...

МИШАНЯ•9/20/24, 8:59 PM

I would like to use flux only..But as I understand it...at this stage it is not feasible?

ММИШАНЯ I would like to use flux only..But as I understand it...at this stage it is not ...

Error-404-unknown•9/20/24, 9:02 PM

This guy showed some pictures but didn't really say how he did it https://www.reddit.com/r/StableDiffusion/s/D3UXxZF6np

From the StableDiffusion community on Reddit: Flux.1 + InstantID

Explore this post and more from the StableDiffusion community