@Furkan Gözükara SECourses when choose lion optimizer , what is the best setting for batch size ,gr
@Furkan Gözükara SECourses when choose lion optimizer , what is the best setting for batch size ,gradient accumulation steps ,learning rate
MIs it possible to create such an image with stable diffusion? What tips are needed to make it?
MI've just seen the Video to Anime tutorial and now I wonder, would it be possible/feasible to apply this to something other than a person? Specifically I'm thinking about taking footage of me cooking (no person in frame, only hands/food/tools) and style change it to anime style.
If it's doable, would I have to do the training for each new recipe/video or could I just do the training with a few videos and then use the same training data for more?
If it's doable, would I have to do the training for each new recipe/video or could I just do the training with a few videos and then use the same training data for more?
Fwow i am having so many meetings with companies recently
Fdid you try to train with dreambooth?
Fi think it works better
Fwe use automatic1111 for inference. kohya for training
Fyou need to add more memory optimization
Fthere are advanced settings
Fgradient checkpoint memory attention xformers
Fit still works. are you using dev version of the atuomatic1111? try with dev branch. i tested the video workflow on runpod few days ago for a patreon subscriber. it worked very well
FI havent tested them but i believe most optimized script is the dreambooth extension of the automatic1111
Fi think they will take money and get disappeared :d
Fbest for training person is batch size 1, gradient 1, 1e-7 lr for lion
F100% possible but i dont know what prompt can be used
Fyou can do training only 1 time, train your visible body parts that will be used in video, and follow the logic
Fit should work very well
Fi am also working on an easier way that can also be used for your purpose
ACan we have a meeting with you too? 
Fsure i am open to private consultation
DYes im training with dreambooth but i trained on rev animated which i guess is a merge of soo many models so that's why not good
Fyes some models may not work good for training
Ffor example realistic vision works good
DWould you know a way to know which ones would or is it just trial and error?
Ftrial and error
DAlso have you ever tried stylizing your images using control net before training and then using them as training images
DIf you want a specific stylized look
DWouldn't that mean the model welcomes these training images better because they look like the same style as the model you train them on
AI also didn't have much success with revAnimated, made the person look like a doll or something
Hfor style what is the best settings
A1e-7 for both learning rate and text encoder learning rate?
HSome version of dreambooth ,when check lora,there is no text input filed for learning rate. Only Lora Unet learning rate and Tex encoder
BHey, what is the current best solution for this task? Thanks!
Finpainting
BAnd should I use separate models? Or merge them after training?
DAfter training, i am converting it to ckpt but then I can't download from g drive idk what's happening it keeps saying error when it's almost done, so i have downloaded the weights how do i convert them to ckpt?
DNo don't merge you will lose both, try to train the persons face and then a lora for clothes
DThen try to prompt them together
DYou can also do this with controlnet and inpainting but that's if the model and the clothes are already in a pose you need
KYouTubeTroubleChute
Nvidia has announced HUGE news: 2x improvement in speed for Stable Diffusion and more with the latest driver. Using it is a little more complicated, but the speed boost is there! Exciting things coming in the future of AI. This video covers installing and using the new ONNX/Olive models and converter, as well as converting models, generating ima...
Nthese?
Nstill not working :\
Bhi everyone! wanted to share a demo of running A1111 with a fal-serverless backend. The idea here is that you just run the UI locally but the GPU parts happen in the cloud. So instead of having a machine on all the time, you would only have a machine running when you are generating images which should save some $. Here is a video of it in action: https://www.youtube.com/watch?v=EIxF7TKk6wg
I am looking for feedback. Would you want to use this?
I am looking for feedback. Would you want to use this?
YouTubeFeatures and Labels
In this video we demonstrate a version of AUTOMATIC1111 StableDiffusion UI that runs in a serverless manner using fal-serverless.
AThis is really cool, will be nice if you can implement all the other tabs and especially add support for Dreambooth
Fnever tried
Ftrain cloth. train person. make cloth image. in paint person face
BCan do for sure
BWill start working on the other tabs, but wanted to see if there is enough interest in it first
ADefinitely, it will be very useful for people like me who run a Mac and don't have a proper GPU, I am using cloud services already anyway.
Ffrom video i dont see he managed to make it work am i mistaken?
F- gradient checkpoint