Hello everyone. I am Dr. Furkan Gözükara. PhD Computer Engineer. SECourses is a dedicated YouTube channel for the following topics : Tech, AI, News, Science, Robotics, Singularity, ComfyUI, SwarmUI, ML, Artificial Intelligence, Humanoid Robots, Wan 2.2, FLUX, Krea, Qwen Image, VLMs, Stable Diffusion
Yes, 5e-5 looks low compared to typical SDXL LoRAs. But for Flux1 it’s the standard recommendation (e.g. Furkan’s config). It trains slower, but keeps things stable since Flux is more sensitive than SDXL/1.5. But maybe I'm wrong.
try to find out if you can generate images while it's training (that means , the training algorithm stops for a moment to generate an image based on a prompt set)
have you tried creating character checkpoints from krea? I'm at 10000 steps and the model is clearly ruined by now: all stylized outputs became blurry mangled and photorealistic
ok i'll do krea next for comparison. doing my first fine tune locally, done loads on massedcompute. got 5090 and 128gb ram. went with the 24gb config. 25 pics, 200 epochs looks like its going to be around 6h.
hey @Dr. Furkan Gözükara, could you give me some advice i have a big checkpoint to train (220 epochs with 300+ images) and it would take 88hours with a L40S. Is there a gpu I can rent what would significantly speed up the training (without going multi gpu, i read here that it impacts the quality of the training) ? Thanks