Software Engineering Courses (SECourses)•7mo ago

Can someone help me diagnose this issue. Images from my recent fine tuned model are coming out with

Can someone help me diagnose this issue. Images from my recent fine tuned model are coming out with strange patterns particularly noticable on skin but also just overall in the image. Is it due to over training or could it be from particular grainy images in dataset?

Screenshot_2025-06-11_at_12.48.16_PM.png

JamiewheltonOP•6/11/25, 4:50 AM

is like specky-ness everywhere. I think it only happens after refining.

Screenshot_2025-06-11_at_12.50.23_PM.png

JamiewheltonOP•6/11/25, 4:53 AM

I think it might be due to the lack of distant photos I trained with... as I used mostly high detailed mostly selfies.

JJamiewhelton Can someone help me diagnose this issue. Images from my recent fine tuned model ...

mlado•6/11/25, 7:32 AM

I am also curious why this is happening

JJamiewhelton Can someone help me diagnose this issue. Images from my recent fine tuned model ...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•6/11/25, 8:53 AM

if your dataset has grainy images than it's because of that. If not then your learning rate is high. If your images are grainy try reducing the lora rank and re train

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 if your dataset has grainy images than it's because of that. If not then your le...

JamiewheltonOP•6/11/25, 9:05 AM

I will try that thank you

JJamiewhelton Can someone help me diagnose this issue. Images from my recent fine tuned model ...

Furkan Gözükara SECourses•6/11/25, 11:25 AM

could be dataset

mlado•6/11/25, 8:09 PM

may I ask why it says that the total amount of epochs will be 195 by the end of the training, I am sure that I selected 200

mlado•6/11/25, 8:10 PM

this happened yesterday too when I trained another fine-tuned model, I selected 200 epochs but it did 181 I think if I remember correctly

Mmlado may I ask why it says that the total amount of epochs will be 195 by the end of ...

Furkan Gözükara SECourses•6/11/25, 8:17 PM

batch size number of images

Furkan Gözükara SECourses•6/11/25, 8:17 PM

dont worry

mlado•6/11/25, 8:18 PM

Okay then

Dario•6/12/25, 5:52 PM

Hi @Furkan Gözükara SECourses, I cannot get either SDPA nor xformers to work with koyha_ss on my 5090. I have used both your install and also another method recommended by Bmaltais himself 2 weeks ago (https://github.com/bmaltais/kohya_ss/issues/3096#issuecomment-2730229439).

The installation of pytorch + xformers is successful. When I check in the .venv, the xformers are indeed installed.
However during training, the CrossAttention settings simply get ignored, both if I set it to xformers and to SDPA.
No mention of CrossAttention is shown in the training logs, and I notice on the VRAM usage that this is not being enabled.
I have all the requirements on my pc (python 3.10, cuda 12.8 etc).

Do you have any advice? Are the cross attention settings working in your koyha_ss install with your 5090, xformers in particular?
Thank you in advance.

GitHub

Is there any way to run kohya ss gui on RTX5090? · Issue #3096 · ...

Currently when I start kohya ss gui on RTX5090, I get the following error and cannot learn Lora. Maybe I should wait for an update, but is there any way to learn Lora using RTX5090? UserWarning: NV...

DDario Hi <@205854764540362752>, I cannot get either SDPA nor xformers to work with koy...

Furkan Gözükara SECourses•6/12/25, 7:18 PM

do you have python 3.10.11 installed?

Furkan Gözükara SECourses•6/12/25, 7:18 PM

i am able to use both with my installer

Furkan Gözükara SECourses•6/12/25, 7:18 PM

maybe not displaying on cmd?

Furkan Gözükara SECourses•6/12/25, 7:18 PM

did you check your speed_? which config you used?

FFurkan Gözükara SECourses do you have python 3.10.11 installed?

Dario•6/13/25, 8:24 AM

Thank you for your reply. Yes I have python 3.10.11, I am using the latest config "48GB_GPU_28200MB_6.3_second_it_Tier_1".
Speed is around 3.85s/it.
Perhaps it is indeed working but I find it strange there is no menion of this in the cmd windows. I remember the use of xformers was shown here on older installs (when using a 4090).
Do you see this in your koyha cmd windows when training?

FFurkan Gözükara SECourses do you have python 3.10.11 installed?

Dario•6/13/25, 8:28 AM

Further more, I am getting the exact same 3.85s/it speed and 27.7 GB VRAM used when I set CrossAttention to "none" in tge Koyha GUI, as when I set it to "xformers".
So that shows that there is no cross attention happening.

JJamiewhelton is like specky-ness everywhere. I think it only happens after refining.

Timson•6/13/25, 10:00 AM

my first guesst would be - some compression artefacts trained in with dataset. Another potential issue - you are trying to generate at much larger resolution than you training set

Timson•6/13/25, 10:01 AM

I was able to partially work aroung models trained on subpar datasets by doing img2img from donor image of high quality and fairly large creativity

Timson•6/13/25, 10:03 AM

It would be cool if someone found prompting techniques to improve quality (the obvious ones like "hi res image", "high quality image" have almost no effect on the generation)

DDario Further more, I am getting the exact same 3.85s/it speed and 27.7 GB VRAM used w...

Furkan Gözükara SECourses•6/13/25, 11:14 AM

3.85 is accurate

Furkan Gözükara SECourses•6/13/25, 11:14 AM

it is working

Furkan Gözükara SECourses•6/13/25, 11:14 AM

also SPDA and xFormers are same speed recently

FFurkan Gözükara SECourses 3.85 is accurate

Dario•6/13/25, 11:29 AM

Okay but if I set cross attention to "none" I get the sane speed and VRAM. That and the missing mention of this in the cmd window makes me very suspicious if this is actually working.

DDario Okay but if I set cross attention to "none" I get the sane speed and VRAM. That ...

Furkan Gözükara SECourses•6/13/25, 11:50 AM

ah i think you should report it

Furkan Gözükara SECourses•6/13/25, 11:50 AM

because that shouldnt happen

FFurkan Gözükara SECourses ah i think you should report it

Dario•6/13/25, 12:06 PM

Okay I will do that, thanks.

DDario Okay I will do that, thanks.

Dario•6/13/25, 1:33 PM

Just to cross off all posibilities; which nvidia driver do you have installed?

JamiewheltonOP•6/13/25, 2:46 PM

can I train at higher resolution than 1024x1024 with this setup... dreambooth flux

JJamiewhelton can I train at higher resolution than 1024x1024 with this setup... dreambooth fl...

Furkan Gözükara SECourses•6/13/25, 10:00 PM

yes but i didnt see much benefit

Original message was deleted

Furkan Gözükara SECourses•6/13/25, 10:00 PM

removing it from dataset

Furkan Gözükara SECourses•6/13/25, 10:01 PM

or in prompt after training try to prompt carefully that would generate different side eye

Punceka•6/14/25, 9:20 AM

Is there any way to resume LoRa training after the overnight automatic Windows update that restarted my PC?

LukeJoseph•6/14/25, 6:51 PM

Hi all - followed the Flux training Lora guide/tutorial. Does my speeds seem correct for a 3090? It’s roughly 9 it/s using the level 2 workflow.

I keep seeing references to a “massive speed increase” with torch 2.5, but the 1 click installer has I believe installs 2.7? So I imagine that’s already implemented.

FluxGym is substantially faster, around 2 it/s, if memory serves me. But as I am just learning about all this, is a bit difficult for me to compare apples to apples/settings to settings. FluxGym while easy to use, doesn’t have the most friendly of interfaces when digging into additional settings.