Software Engineering Courses (SECourses)•10mo ago

I am following your extracted LoRA tutorial. However getting an error. I have tried all save percisi

I am following your extracted LoRA tutorial. However getting an error. I have tried all save percisions and network rank sizes. I have checked V2 and unchecked it. Can seem to get past this error. Happening to 3 different finetunes. So I know it's got to be something I am not seeing.

new_checkpoint["time_embedding.linear_1.weight"] = unet_state_dict["time_embed.0.weight"]
KeyError: 'time_embed.0.weight'

Screenshot_2025-03-23_at_10.55.28_AM.png

JJoshua A I am following your extracted LoRA tutorial. However getting an error. I have tr...

Furkan Gözükara SECourses•3/23/25, 2:58 PM

use this

FFurkan Gözükara SECourses use this

Joshua AOP•3/23/25, 3:13 PM

Xcorpion•3/23/25, 6:59 PM

how to make a lokr like this? with that net dim, usually kohya only allow to put 100000, https://civitai.com/models/292553?modelVersionId=1568463 (this is the lokr and the creator).

XXcorpion how to make a lokr like this? with that net dim, usually kohya only allow to put...

EClipX•3/23/25, 9:44 PM

you can add it in as an extra argument

EClipX•3/23/25, 9:44 PM

or modify the gui

EEClipX you can add it in as an extra argument

Xcorpion•3/23/25, 10:10 PM

guidance please

EClipX•3/23/25, 10:13 PM

here i updated the file for you, replace it before starting the gui

you should be able to change the values of lokr now

the file to replace is in kohya_gui

lora_gui.py93.35KB

EEClipX here i updated the file for you, replace it before starting the gui you should ...

Xcorpion•3/23/25, 10:23 PM

I did replace, tho it's the same

EClipX•3/23/25, 10:29 PM

did you restart your gui? are you sure you replaced the right file?

EClipX•3/23/25, 10:30 PM

see in that file there is this

)
with gr.Row() as network_row:
network_dim = gr.Slider(
minimum=1,
maximum=9999999999,
label="Network Rank (Dimension)",
value=8,
step=1,
interactive=True,
)
network_alpha = gr.Slider(
minimum=0.00001,
maximum=9999999999,
label="Network Alpha",
value=1,
step=0.00001,
interactive=True,
info="alpha for LoRA weight scaling",
)
with gr.Row(visible=False) as convolution_row:
# locon= gr.Checkbox(label='Train a LoCon instead of a general LoRA (does not support v2 base models) (may not be able to some utilities now)', value=False)
conv_dim = gr.Slider(
minimum=0,
maximum=9999999999,
value=1,
step=1,
label="Convolution Rank (Dimension)",
)
conv_alpha = gr.Slider(
minimum=0,
maximum=9999999999,
value=1,
step=1,
label="Convolution Alpha",
)

EEClipX did you restart your gui? are you sure you replaced the right file?

Xcorpion•3/23/25, 10:52 PM

probably, "kohya_ss\kohya_gui\lora_gui.py" this one right?

Xcorpion•3/23/25, 10:55 PM

https://github.com/KohakuBlueleaf/LyCORIS. I tried to do this, but it gives me errors

Furkan Gözükara SECourses•3/23/25, 10:55 PM

i trained LyCORIS. it is lower quality but has better multi concept training

Furkan Gözükara SECourses•3/23/25, 10:55 PM

you can change our lora config LyCORIS however it may require some additional parameters which i dont remember

FFurkan Gözükara SECourses i trained LyCORIS. it is lower quality but has better multi concept training

Xcorpion•3/23/25, 10:58 PM

I see, Im seeing this 76mb LyCORIS everywhere and at least for me they perform well, like creators use few number of images and get decent quality with strong flexibility

XXcorpion https://github.com/KohakuBlueleaf/LyCORIS. I tried to do this, but it gives me e...

EClipX•3/23/25, 11:11 PM

did you git checkout sd3 flux 1?

EClipX•3/23/25, 11:11 PM

do a fresh install and replace it

Kaiden Quinart•3/24/25, 11:39 AM

Hello there I need your help here.I am training a character Lora with one trainer Is there Any math to find epochs based on dataset size? I have a dataset with 31 pictures of a character. How many epochs should I use?

Kaiden Quinart•3/24/25, 11:40 AM

I am keeping repeats value to 1
I am using onetrainer

KKaiden Quinart Hello there I need your help here.I am training a character Lora with one traine...

Furkan Gözükara SECourses•3/24/25, 1:30 PM

do up to 200

Furkan Gözükara SECourses•3/24/25, 1:30 PM

yes onetrainer has better reg images usage support

FFurkan Gözükara SECourses yes onetrainer has better reg images usage support

Kaiden Quinart•3/24/25, 1:31 PM

I am doing Just like your video sir. I am puting it like that , repeat = number of dataset/ number of reg images

KKaiden Quinart I am doing Just like your video sir. I am puting it like that , repeat = number ...

Furkan Gözükara SECourses•3/24/25, 1:31 PM

yes true way

Furkan Gözükara SECourses•3/24/25, 1:31 PM

so you should see number of steps = 200 x 31 x 2

FFurkan Gözükara SECourses do up to 200

Kaiden Quinart•3/24/25, 1:32 PM

FFurkan Gözükara SECourses so you should see number of steps = 200 x 31 x 2

Kaiden Quinart•3/24/25, 1:32 PM

what is 2 here?

Kaiden Quinart•3/24/25, 1:33 PM

I am using 4 batch value is this okay? I mean how can we find the aproximate epochs value? Is this all trial and error process. there is no pattern?

Kaiden Quinart•3/24/25, 1:34 PM

sorry I am so beginer

KKaiden Quinart what is 2 here?

Furkan Gözükara SECourses•3/24/25, 1:36 PM

2x from reg images if you use

Furkan Gözükara SECourses•3/24/25, 1:36 PM

if you use batch size 4 use square root 4 LR

Furkan Gözükara SECourses•3/24/25, 1:36 PM

which means 2x LR

Kaiden Quinart•3/24/25, 1:37 PM

that means learning rate should be 2 times ?

KKaiden Quinart that means learning rate should be 2 times ?

Furkan Gözükara SECourses•3/24/25, 1:38 PM

yep

Kaiden Quinart•3/24/25, 1:40 PM

2 times default = 0.0003 x 2=0.0006

Kaiden Quinart•3/24/25, 1:40 PM

I see, and how do you get the approximate epoch value?

KKaiden Quinart I see, and how do you get the approximate epoch value?

Furkan Gözükara SECourses•3/24/25, 1:41 PM

yes

Kaiden Quinart•3/24/25, 1:41 PM

I mean how to find the epochs value?

Kaiden Quinart•3/24/25, 1:42 PM

and isnt it very high learning rate?

KKaiden Quinart and isnt it very high learning rate?

Furkan Gözükara SECourses•3/24/25, 1:44 PM

well you can use my preset it has all

EEClipX did you git checkout sd3 flux 1?

Xcorpion•3/24/25, 1:44 PM

eh whats that?

KKaiden Quinart and isnt it very high learning rate?

Furkan Gözükara SECourses•3/24/25, 1:50 PM

use the shown values in tutorial they are working great

EEClipX see in that file there is this ) with gr.Row(...

Xcorpion•3/24/25, 1:52 PM

yeah I edited it, but it just wont change in UI, tried restart and install

ChillPanda•3/24/25, 5:37 PM

Could someone help me with SDXL lora training?

CChillPanda Could someone help me with SDXL lora training?

Furkan Gözükara SECourses•3/24/25, 6:11 PM

i recommend dreambooth

ChillPanda•3/24/25, 6:13 PM

I want to make fanvue AI model. Can you send me a link to your best video from this topic?

CChillPanda I want to make fanvue AI model. Can you send me a link to your best video from t...

Furkan Gözükara SECourses•3/24/25, 6:18 PM

i dont know fanvue AI . i can give you video for flux dreambooth highest quality

Furkan Gözükara SECourses•3/24/25, 6:18 PM

https://youtu.be/FvpWy1x5etM

YouTubeSECourses

FLUX Full Fine-Tuning / DreamBooth Training Master Tutorial for Win...

If you want to train FLUX with maximum possible quality, this is the tutorial looking for. In this comprehensive tutorial, you will learn how to install Kohya GUI and use it to fully Fine-Tune / DreamBooth FLUX model. After that how to use SwarmUI to compare generated checkpoints / models and find the very best one to generate most amazing image...

ChillPanda•3/24/25, 6:19 PM

Thanks

ProRost•3/25/25, 12:25 PM

Hi friends

Tell me who can do FLUX Full Fine-Tuning as shown in this video

@Furkan Gözükara SECourses How much would such a service cost? Dataset 91 photos.

PProRost Hi friends 👋 Tell me who can do FLUX Full Fine-Tuning as shown in this video☝️...

Furkan Gözükara SECourses•3/25/25, 12:27 PM

hello

I am following your extracted LoRA tutorial. However getting an error. I have tried all save percisi

Similar Threads