Hello everyone. I am Dr. Furkan Gözükara. PhD Computer Engineer. SECourses is a dedicated YouTube channel for the following topics : Tech, AI, News, Science, Robotics, Singularity, ComfyUI, SwarmUI, ML, Artificial Intelligence, Humanoid Robots, Wan 2.2, FLUX, Krea, Qwen Image, VLMs, Stable Diffusion
Best Stable Diffusion and AI Tutorials, Guides, News, Tips and Tricks - GitHub - FurkanGozukara/Stable-Diffusion: Best Stable Diffusion and AI Tutorials, Guides, News, Tips and Tricks
me: i don't really understand truncation error with regards to image diffusion samplers. can you lay it out in eli5 terms for me?
ChatGPT said: Sure! Let's say you're baking cookies and the recipe calls for 1/3 cup of sugar. But your measuring cups only have 1/4 cup and 1/2 cup.
If you use the 1/4 cup, you won't be adding enough sugar. If you use the 1/2 cup, it will be too much. So, you decide to fill the 1/4 cup and add a little bit more, hoping it's about 1/3 cup.
The difference between the amount of sugar you actually added and the exact 1/3 cup the recipe called for is like the truncation error. It's a small error that comes from having to stop (or "truncate") your measuring because you don't have the exact tool (in this case, the right measuring cup) to get the precise amount.
In the case of the image diffusion, the "sampling steps" are like the measuring cups. If you could do an infinite number of steps, you could get the exact, perfect result. But in reality, you have to stop at some point (just like you can't keep adding sugar forever), and this results in a small error. Increasing the number of steps is like adding a bit more sugar to the 1/4 cup to try and get closer to the exact 1/3 cup you need.
Databricks’ #Dolly v2 is a free, open source, commercially useable ChatGPT-style #AI model. Dolly 2.0 could spark a new wave of fully open source LLMs similar to #ChatGPT . Open source community working hardest to bring up a model that can compete with GPT4. Our discord: https://bit.ly/SECoursesDiscord
Was wondering if there is any way to instruct SD (A1111) within prompt to only apply lora to specific subjects? Say I have a lora that generates specific person, if I put few subjects it will usually apply lora to them to all, is there a way to limit lora's influence to only one specific subject without having to use regional prompt or other similar extensions?
the bottom right image is the latent couple mask, the colors are arranged in order that they'll fill out in the form underneath, white being the general prompt for scene with left to right in color being each character. you can do it with loras. there was a bug for a bit using loras in prompts, but i think tehy fixed it? so if you were to make an openpose control net and latent couple each pose similar to how my masking was done, your prompt would read: generral scene of scene-like things and such BREAK AND <lora A:0.6> BREAK AND <lora B:0.6> BREAK AND <lora C:0.6> BREAK AND <lora D:0.6>
Yes. I love the feature of defining a mask as it allows. I've not tried regional prompter or whatever it's called, I looked at it and it seemed to be a step backwards in function
Total power over generations between latent couple and control net, tho to fully utilize latent couple, requires some skill with Photoshop or similar for precision. The control net segment preprocessor might have some potential too. I've not tried it just considered it.
Personally cosine and polynomial have given me good results. Seems to be a matter of just finding settings. There's a write up in discussions for dreambooth on GitHub that has a very thorough fleshing out of how to do your settings according to a formula. https://github.com/d8ahazard/sd_dreambooth_extension/discussions/547
NEW UPDATE Updated formulas for calculating frame resolutions. Also updates with permissions were carried out in the table with mathematics. The custom lr_scheduler has been moved to a separate doc...
@ashleyk I would not presume to know better than the good doctor.
I am mobile at this time and cannot access my dreambooth settings. The advantage I like of any scheduler on a curve is that it greatly helps with avoiding over fitting. Lots of ways to preserve the model you train on.
It's 6am here and bed time, but as I need to get back into training this weekend, ty for the link. I will definitely watch. I've been bookmarking several of your courses for references.
I plan to. His courses are fantastic. This weekend I have a lot of work I need to get done, so I'll be training to his spec and looking forward to the results
@Furkan Gözükara SECourses I'm trying to do dreambooth training using the Inkpunk model to get the same style but I'm having a few errors. Using 1 x A100 80GB 24 vCPU 125 GB RAM on Runpod.
I installed dreambooth manually, changed the requirements, but when training I get this error: AssertionError: from user code: File "/workspace/venv/lib/python3.10/site-packages/torch/random.py", line 23, in get_rng_state return default_generator.get_state() Set torch._dynamo.config.verbose=True for more information