but nothing good as supir
but nothing good as supir
WUsing the flux swarmui provided, normal flux generates an image using dev-fp8 in 20 seconds. If I add a lora, trained on flux.dev it takes several minutes per 5 steps. Any idea what causes this or if a full dev Lora can be quantized to work faster with the fp8 model?
Thanks!
Thanks!
Nwhat GPU do you have? maybe adding lora causes you to have to use shared vram?
Fnot it doesnt have to be
Fwhat is your gpu
W4090
Flora may be overloading your vram
Fcan you see how much vram it uses with lora?
WYes. I am not at home yet but when I get there in about 30 mins I will check.
WSo the version a Lora is trained on doesn’t matter?
Fyou need to use fp16 as base model during training
Fyou can use lora on fp16 or fp8 base model after trained
MHey @Dr. Furkan Gözükara can i follow your instructions to runpod and use aws instead ?
Mcreate a notebook there and just follow the rest of the instructions ?
Fif your aws has python 3.10 cuda and c++ yes
Fand nvidia drivers
Mthanks
Mit just started crashing
Mmaybe its the port
Mill try setting the port
M@Dr. Furkan Gözükara bmaltis is updated now
Mtext encoder training works
Mvram is using much less now
Fnice let me check
VSuccesfully trained a model with clip l text encoder, results are better now and so are prompting
Fvram usage shouldnt be changed
Fawesome
Fyou used same LR?
Vyou can use the fp8 t5
Vuse half learning rate for text encoder
Vor else you will cook your model
Fthis shouldnt make difference
Fi think it auto cast
Fand we train only clip L
Vim getting less vram than before so im not sure whats changed
Flet me check vram too
Fi will still record video waiting clip l training results would delay further 
Vit may be this
VIn FLUX.1 LoRA training, when
--fp8_base is specified, the FLUX.1 model file with fp8 (float8_e4m3fn type) can be loaded directly. Also, in flux_minimal_inference.py, it is possible to load it by specifying fp8 (float8_e4m3fn) in --flux_dtype.Fye it just let you load fp8
Ffp16 was still casted to fp8
Vi used this here --fp8_base_unet
Vand clip is trained at bf16
Vim using sd scripts directly
Fkk
Fon windows or linux?
Vlinux
Vdont bother with windows
Fok. if i can lower LR + clip L
Fit can lesser overfit
V7e-05 for unet
