Hello everyone. I am Dr. Furkan Gözükara. PhD Computer Engineer. SECourses is a dedicated YouTube channel for the following topics : Tech, AI, News, Science, Robotics, Singularity, ComfyUI, SwarmUI, ML, Artificial Intelligence, Humanoid Robots, Wan 2.2, FLUX, Krea, Qwen Image, VLMs, Stable Diffusion
There was so much fuss about the GGUF models/ people running out of VRAM/ Flux being too large, that I spent the entire day today with my home PC (12GB 4070 Super) & ComfyUI, trying various models. To my surprise, I found:
1) ComfyUI could load and generate with the original 23GB Flux Dev Model (reasonable speed) on my PC & FP8 T5XXL. I do not understand how people are running out of VRAM? It seems both swarm UI and comfy ui have some resource management going on inside which lets you use the dev model. Am I missing something? Since it was working, I loaded Florence2 and SAM2 as well, ended up generating + inpainting with relative ease.
2) As for the GGUF models, I actually found that they took much, much longer than the 23GB model to generate images!! I tried Q6_K and Q8_O and was able to do the above operations with them as well. The quality was good, but obviously not better than the full size dev model.
3) I found that Swarm UI is somehow doing a much better job at generating with the LoRAs+Img2Img. On the other hand, it seems SwarmUI can't work with Controlnets+LoRAs at all. The results are laughable tbh. The inpainting on ComfyUI is the best!
So I am pulling my hair out (and I am already bald). I really appreciate all the work put in to the tutorials and I have followed each step. I am now getting an error that shows "13:11:50-486153 ERROR LoRA type must be set to 'Flux1' or 'Flux1 OFT' if Flux1 checkbox is checked." Flux is auto checked as the model is in there and loaded. Please let me know what I can do to fix this.
Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...
One odd thing - I was using ComfyUI to generate some 2048 x 768 banners, and I started to get some fine vertical lines appearing in the imagery, which disappears if I reduce the resolution.