Software Engineering Courses (SECourses)•16mo ago

https://github.com/comfyanonymous/ComfyUI/issues/4695 there have been some issues reported with l

https://github.com/comfyanonymous/ComfyUI/issues/4695 there have been some issues reported with loading DoRA files trained with OneTrainer in other tools like ComfyUI

GitHub

Load OneTrainer Flux LoRas and DoRas · Issue #4695 · comfyanonymous...

Feature Idea It looks like the Flux branch for OneTrainer is nearing completion - and the results are looking great! However, it seems as though ComfyUI cannot load the resulting .safetensors file....

Zono50•9/9/24, 5:34 PM

if we have 12GB of vram, do we simply run the rank5 or 4 inside of kohya? do we still use flux dev considering that is a much bigger model? @Dr. Furkan Gözükara

DDreamer@TDFilmStudio https://github.com/comfyanonymous/ComfyUI/issues/4695 there have been some is...

Furkan Gözükara SECourses•9/9/24, 5:34 PM

i think he fixed already?

ZZono50 if we have 12GB of vram, do we simply run the rank5 or 4 inside of kohya? do we ...

Furkan Gözükara SECourses•9/9/24, 5:34 PM

you have to use rank 5 or below

Furkan Gözükara SECourses•9/9/24, 5:34 PM

use dev model it auto cast

Furkan Gözükara SECourses•9/9/24, 5:34 PM

make sure you have virtual RAM

Zono50•9/9/24, 5:35 PM

oh ok gotcha, i have 12 GB of vram and 64 GB of system ram, i am watching your video right now and about to start training. I went outside and took some better pictures with the natural lighting outside

Zono50•9/9/24, 5:37 PM

Thank you

FFurkan Gözükara SECourses you have to use rank 5 or below

Dreamer@TDFilmStudioOP•9/9/24, 6:09 PM

How much is quality loss in the Rank 4 fast version, compared to Rank 3 slow version?

Zono50•9/9/24, 6:37 PM

@Dr. Furkan Gözükara I'm still getting OOM errors when trying to train a lora on 12GB, i'm all the way down to rank 8, i have 11.2 GB of Vram available and still getting it

TheToday•9/9/24, 6:55 PM

Anyone else having trouble with Forge? I'm using the same old thing in Flux and I get OutOfMemory error in Massedcompute with the 48gb

TheToday•9/9/24, 7:06 PM

I think it's when patching Lora, but it worked perfectly a few days ago

Zono50•9/9/24, 7:38 PM

can we use our lora with gguf quantized models of dev?

TheToday•9/9/24, 8:21 PM

the problem is with --always-gpu @Dr. Furkan Gözükara

Zono50•9/9/24, 8:22 PM

what's the recommended way to run inference with low gpu cards? we can't use flux1.dev

Kallamamran•9/9/24, 8:33 PM

Trained a lora with AI-toolkit and the outputs look good, but when I try to run it in Forge it doesn't at all look like the results in Ia-toolkit :/

Kallamamran•9/9/24, 8:33 PM

What am I missing

Kallamamran•9/9/24, 8:34 PM

I have trained on fp16 dev and are usiing dev nf4 in forge. Is that why?

Kallamamran•9/9/24, 8:34 PM

Can't trained LORA's be run in Forge? -

ZZono50 oh ok gotcha, i have 12 GB of vram and 64 GB of system ram, i am watching your v...

Furkan Gözükara SECourses•9/9/24, 8:43 PM

awesome

ZZono50 @Dr. Furkan Gözükara I'm still getting OOM errors when trying to train a lora o...

Furkan Gözükara SECourses•9/9/24, 8:43 PM

which config you using?

ZZono50 can we use our lora with gguf quantized models of dev?

Furkan Gözükara SECourses•9/9/24, 8:44 PM

i havent tried yet

Furkan Gözükara SECourses•9/9/24, 8:44 PM

but swarm ui should work out of box with fp8

KKallamamran I have trained on fp16 dev and are usiing dev nf4 in forge. Is that why?

Furkan Gözükara SECourses•9/9/24, 8:44 PM

nf4 is the problem

ZZono50 what's the recommended way to run inference with low gpu cards? we can't use flu...

Furkan Gözükara SECourses•9/9/24, 8:44 PM

swarmui

Furkan Gözükara SECourses•9/9/24, 8:44 PM

most optimized

rafraf•9/9/24, 8:46 PM

hey @Dr. Furkan Gözükara using swarmui grid generator, if run a grid gen with two params, and you rerun the same params but add an extra value, does it overwrite the entire previous gen? I was under the impression that simply adding a value in an existing param, just inserts the extra gens into the existing grid

Rrafraf hey @Dr. Furkan Gözükara using swarmui grid generator, if run a grid gen with tw...

Furkan Gözükara SECourses•9/9/24, 8:46 PM

i am not sure

Furkan Gözükara SECourses•9/9/24, 8:46 PM

i think it has mixed behaviour

rafraf•9/9/24, 8:47 PM

its really comfusing. using on runpod. ive tested on smalll images to see the mechanism, and it seems sometimes erratic, unpredictable. i am almost sure this the case

rafraf•9/9/24, 8:59 PM

but one thing i d like to know is, if i interrupt the grid genartion, can i re-run it? wi ll it skip already generated images? Or does the interruptioon corrupt the files? Surely you've tested and experienced the behavior?

Rrafraf but one thing i d like to know is, if i interrupt the grid genartion, can i re-r...

Furkan Gözükara SECourses•9/9/24, 9:00 PM

YES

Furkan Gözükara SECourses•9/9/24, 9:00 PM

it can resume

Zono50•9/9/24, 9:00 PM

@Dr. Furkan Gözükara in kohya can we puase and resume traininngs?

ZZono50 @Dr. Furkan Gözükara in kohya can we puase and resume traininngs?

Furkan Gözükara SECourses•9/9/24, 9:03 PM

currently it doesnt work i think

Furkan Gözükara SECourses•9/9/24, 9:03 PM

with fine tuning

Furkan Gözükara SECourses•9/9/24, 9:03 PM

you can use last check point but people said

FFurkan Gözükara SECourses nf4 is the problem

Kallamamran•9/9/24, 9:03 PM

Noticed

Furkan Gözükara SECourses•9/9/24, 9:03 PM

lora doesnt work

Furkan Gözükara SECourses•9/9/24, 9:03 PM

i didnt test

Zono50•9/9/24, 9:03 PM

ah ok

Furkan Gözükara SECourses•9/9/24, 10:26 PM

time to make some image show :d

Furkan Gözükara SECourses•9/9/24, 10:59 PM

40 images posted here : https://medium.com/@furkangozukara/ultimate-flux-lora-training-tutorial-windows-and-cloud-deployment-abb72f21cbf8

Medium

Ultimate FLUX LoRA Training Tutorial: Windows and Cloud Deployment

I have done total 104 different LoRA trainings and compared each one of them to find the very best hyper parameters and the workflow for…

Phuong Bui•9/9/24, 11:10 PM

How to emphasize keywords that need training in the prompt? Would it be more emphasized if I caplock the keyword or put it in ""?

PPhuong Bui How to emphasize keywords that need training in the prompt? Would it be more emp...

Furkan Gözükara SECourses•9/9/24, 11:11 PM

you mean improve their importance?

Furkan Gözükara SECourses•9/9/24, 11:11 PM

i think you can write multiple times

Furkan Gözükara SECourses•9/9/24, 11:11 PM

but it depends on model

Furkan Gözükara SECourses•9/9/24, 11:11 PM

for flux it has internal captioning works amazing

FFurkan Gözükara SECourses i think you can write multiple times

Phuong Bui•9/9/24, 11:14 PM

That's right, I want to increase the importance of keywords. I'm training on flux to see if capping or leaving it in "" is effective. Or just need each image to have a keyword?

PPhuong Bui That's right, I want to increase the importance of keywords. I'm training on flu...

Furkan Gözükara SECourses•9/9/24, 11:18 PM

good question sadly i didnt test

Furkan Gözükara SECourses•9/9/24, 11:18 PM

flux doesnt have a research paper

https://github.com/comfyanonymous/ComfyUI/issues/4695 there have been some issues reported with l

Similar Threads