Software Engineering Courses (SECourses)•17mo ago

does this mean i missed updating something? thought text encoder was supposed to work now? 024-08-2

does this mean i missed updating something? thought text encoder was supposed to work now?

024-08-28 09:54:18 INFO text_encoder is not needed for training. deleting to save memory. train_network.py:1013
INFO unet dtype: torch.float8_e4m3fn, device: cuda:0 train_network.py:1030

Nnicearoni does this mean i missed updating something? thought text encoder was supposed to...

Furkan Gözükara SECourses•8/28/24, 1:56 PM

i didnt update text encoder configs yet

Furkan Gözükara SECourses•8/28/24, 1:56 PM

i am still researching

Furkan Gözükara SECourses•8/28/24, 1:56 PM

will announce once made update

Furkan Gözükara SECourses•8/28/24, 1:56 PM

but you can copy pate unet LR to text encoder

Furkan Gözükara SECourses•8/28/24, 1:56 PM

and it works

Furkan Gözükara SECourses•8/28/24, 1:57 PM

are you using latest speed boost?=

Furkan Gözükara SECourses•8/28/24, 1:57 PM

we need to verify it works :d

nicearoniOP•8/28/24, 2:01 PM

i am, but testing something at 512 so can't compare speed to my 1024 runs

Nnicearoni i am, but testing something at 512 so can't compare speed to my 1024 runs

Furkan Gözükara SECourses•8/28/24, 2:01 PM

FFurkan Gözükara SECourses it will give huge boost

novsky•8/28/24, 3:05 PM

rank 5 with updated torch (I guess updated, but I did update)...1024, without t5 att masking

Nnovsky rank 5 with updated torch (I guess updated, but I did update)...1024, without t5...

Furkan Gözükara SECourses•8/28/24, 3:08 PM

nicer

Furkan Gözükara SECourses•8/28/24, 3:08 PM

i hope it works perfect

Furkan Gözükara SECourses•8/28/24, 3:08 PM

i will be able to test only during night

novsky•8/28/24, 3:10 PM

I will not finish this training, so I can't tell you result. But maybe I will try to start training at night. So could be some results tomorrow...or not)

Nnovsky I will not finish this training, so I can't tell you result. But maybe I will tr...

Furkan Gözükara SECourses•8/28/24, 3:38 PM

i will do same :d

macba•8/28/24, 7:43 PM

Hello everyone, quick question: what does this script do?

https://huggingface.co/MonsterMMORPG/Generative-AI/resolve/main/kohua_gui_pass_update.sh

As far as I understand, it replaces kohya_ss's gui.shgui.shwhen you use Furkan's kohya installer script (at least on Linux). What's the advantage? Thanks…

daroth•8/28/24, 7:45 PM

okay, lets see the local flux kohya training

Mmacba Hello everyone, quick question: what does this script do? https://huggingface.c...

nicearoniOP•8/28/24, 7:46 PM

I think updates a few libraries to newer versions, then patches original gui to not roll them back? not sure though.

daroth•8/28/24, 7:46 PM

do we still need to use the kohya training folder structure? even with the folder name #_name_class?

Ddaroth do we still need to use the kohya training folder structure? even with the folde...

nicearoniOP•8/28/24, 7:47 PM

that's what kohya is still expecting as of now (space between name and class though, not _ )

FFurkan Gözükara SECourses nicer

sergio_gonzo•8/28/24, 9:06 PM

Dr Furkan i hope everyting is ok, wich is your estimate tha could be a video tutorial of FLUX Lora step by steps? wonderfull work

Mmacba Hello everyone, quick question: what does this script do? https://huggingface.c...

Furkan Gözükara SECourses•8/28/24, 10:57 PM

it prevents kohya to revert back requirements

Furkan Gözükara SECourses•8/28/24, 10:58 PM

so our custom torch installation remains

Ssergio_gonzo Dr Furkan i hope everyting is ok, wich is your estimate tha could be a video tut...

Furkan Gözükara SECourses•8/28/24, 10:58 PM

thank you. still editing video

Evivrus•8/29/24, 3:02 AM

Has anyone gotten a slider Lora training working for Flux yet? I have seen a few sliders on Civit but I don't think they are trained the same way SD sliders were trained.

Anyone seen anything? I tried modifying the ai-toolkit code to get it to work but it didn't work out ;P

Furkan Gözükara SECourses•8/29/24, 3:49 AM

nope i didnt see yet

daroth•8/29/24, 9:02 AM

when the trained person should be blonde but her last name is "Blue"

novsky•8/29/24, 3:33 PM

what is better to have more epochs or more repeats?

Nnovsky what is better to have more epochs or more repeats?

Furkan Gözükara SECourses•8/29/24, 4:34 PM

they have different purposes

Furkan Gözükara SECourses•8/29/24, 4:34 PM

explained in video :d

Furkan Gözükara SECourses•8/29/24, 4:34 PM

normally you dont need repeat

novsky•8/29/24, 4:34 PM

I'm in a middle of watching))

Sandstormleader•8/29/24, 9:27 PM

@Furkan Gözükara SECourses how long is the new flux training take?

SSandstormleader <@205854764540362752> how long is the new flux training take?

Furkan Gözükara SECourses•8/29/24, 9:29 PM

totally depends on your total steps and gpu

Furkan Gözükara SECourses•8/29/24, 9:29 PM

but rtx 3090 can get amazing model within 5 hours

Furkan Gözükara SECourses•8/29/24, 9:29 PM

rtx 4090 likely to with like 2 hours 2.5 hours

daroth•8/29/24, 9:31 PM

2-2.5 hours for the 4090 is correct

Sandstormleader•8/29/24, 9:34 PM

Nice I'll have to check it out. I have a 4090

Ddaroth 2-2.5 hours for the 4090 is correct

Furkan Gözükara SECourses•8/29/24, 9:50 PM

yep

SSandstormleader Nice I'll have to check it out. I have a 4090

Furkan Gözükara SECourses•8/29/24, 9:50 PM

great

Furkan Gözükara SECourses•8/29/24, 9:50 PM

use torch 2.5 to have best speed on windows

Sandstormleader•8/29/24, 10:57 PM

i have like 60 more models to merge but i want to check it out this weekend for sure

Sandstormleader•8/29/24, 11:07 PM

Sandstormleader•8/29/24, 11:07 PM

fine tuning and adding flexibility to this 1.5 model

Sandstormleader•8/29/24, 11:09 PM

while keeping the most accuracy

Sandstormleader•8/29/24, 11:18 PM

i wish i knew the science behind how merging works but i just mix them up and hope for the best

SSandstormleader i wish i knew the science behind how merging works but i just mix them up and ho...

Sharinel•8/30/24, 9:14 AM

This man Sciences

SSandstormleader i wish i knew the science behind how merging works but i just mix them up and ho...

Furkan Gözükara SECourses•8/30/24, 9:30 AM

there is no science

it averages neural network weights and you expect to work

Sandstormleader•8/30/24, 11:56 AM

hahah well i just mean in a basic sense, like if i do 50% + 50% of one model and then merge that with another at 50% does it equal out to be 25% +25% +50% or what lol

Sandstormleader•8/30/24, 11:57 AM

or am i actually losing any data or does other data just cover it up to where i can bring other data forward by adjusting weights of tokens and what not

does this mean i missed updating something? thought text encoder was supposed to work now? 024-08-2

Similar Threads