cool, who made the announcement?
cool, who made the announcement?
Fkohya
Dwhere? sorry for my ignorance but where the last news are published?
Don github I suppose but were
Fi follow github discussions and his tiwtter
D?
Fyes
Dthanks
Dwe have to wait then... I'll be waiting your first CLIP_L tests
PIs anyone aware of a quality video upscaler?
Fcovers most of the ai models
FGitHub
Video, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, I...
Fbut nothing good as supir
WUsing the flux swarmui provided, normal flux generates an image using dev-fp8 in 20 seconds. If I add a lora, trained on flux.dev it takes several minutes per 5 steps. Any idea what causes this or if a full dev Lora can be quantized to work faster with the fp8 model?
Thanks!
Thanks!
Nwhat GPU do you have? maybe adding lora causes you to have to use shared vram?
Fnot it doesnt have to be
Fwhat is your gpu
W4090
Flora may be overloading your vram
Fcan you see how much vram it uses with lora?
WYes. I am not at home yet but when I get there in about 30 mins I will check.
WSo the version a Lora is trained on doesn’t matter?
Fyou need to use fp16 as base model during training
Fyou can use lora on fp16 or fp8 base model after trained
MHey @Dr. Furkan Gözükara can i follow your instructions to runpod and use aws instead ?
Mcreate a notebook there and just follow the rest of the instructions ?
Fif your aws has python 3.10 cuda and c++ yes
Fand nvidia drivers
Mthanks
Mit just started crashing
Mmaybe its the port
Mill try setting the port
M@Dr. Furkan Gözükara bmaltis is updated now
Mtext encoder training works
Mvram is using much less now
Fnice let me check
VSuccesfully trained a model with clip l text encoder, results are better now and so are prompting
Fvram usage shouldnt be changed
Fyou used same LR?
Vyou can use the fp8 t5
Vuse half learning rate for text encoder
Vor else you will cook your model
Fthis shouldnt make difference
Fi think it auto cast
Fand we train only clip L
Vim getting less vram than before so im not sure whats changed
Flet me check vram too
Fi will still record video waiting clip l training results would delay further 
Vit may be this
VIn FLUX.1 LoRA training, when
--fp8_base is specified, the FLUX.1 model file with fp8 (float8_e4m3fn type) can be loaded directly. Also, in flux_minimal_inference.py, it is possible to load it by specifying fp8 (float8_e4m3fn) in --flux_dtype.