Hello everyone. I am Dr. Furkan Gözükara. PhD Computer Engineer. SECourses is a dedicated YouTube channel for the following topics : Tech, AI, News, Science, Robotics, Singularity, ComfyUI, SwarmUI, ML, Artificial Intelligence, Humanoid Robots, Wan 2.2, FLUX, Krea, Qwen Image, VLMs, Stable Diffusion
Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon
@Dr. Furkan Gözükara 20 epochs 0 resemblance to the training characters (multiple people) using regularization class person (people of all ages and genders) TE and unet lr 1e-4, Epoch 45 I'm getting some resemblance, so I increased now lr of the TE to 9e-4, lets see
Yes I did, mixed faces, I'm playing with the TE lr to see its effects, I want to know if something fix or minimize the bleeding, also I'm not using class on my characters
Also, does anybody have a Comfy workflow for FLUX + LORAs optimized for RTX 3090? I'm getting 15.79s/it, which strikes me as there's something wrong with my workflow/configuration.
Thanks for sharing your findings. I finished with my first character Flux Lora training today. I want to try out product lora next. Do you think it would be different from your style lora experiment? Why did you remove the word style from the target trained folder name? Does that impact the final quality?
I removed it from the Class prompt textbox in the kohya GUI as well after I clicked 'prepare training data' and 'copy info to respective fields' and renamed the folder (not sure that textbox is used outside of preparing\copying, just wanted to be sure). I removed it because of the convos around here about training on just 'ohwx' instead of 'ohwx man'. In comparing the 25 epoch from both trainings I did, I preferred the second one that only had the instance prompt and no captions.
yeah that def seems high... here's what I'm getting in SwarmUI (which of course uses Comfy as its backend) for 30 steps per 1024x1024 image in Swarm with a 2GB LoRA I trained myself...
definitely agree on captioning being tedious! I decided to try without after hearing some people say it didn't help or even hurt character likeness, and that flux apparently has its own internal captioning somehow when training?