Software Engineering Courses (SECourses)•3y ago

https://youtu.be/ot5GkaxHPzk Ideally I could stand up something like this behind an API

https://youtu.be/ot5GkaxHPzk

Ideally I could stand up something like this behind an API

Stable Diffusion Now Has The Photoshop Generative Fill Feature With...

Adobe changed the game forever with Firefly Photoshop Generative Fill feature. However, Adobe subscription is extremely expensive. As of today, Stable Diffusion Automatic1111 Web UI ControlNet extension has the same generative fill feature. In this video, I will show you how you can use Mikubill ControlNet generative fill like Photoshop has for ...

MmonsieurBoutte https://youtu.be/ot5GkaxHPzk Ideally I could stand up something like this behin...

Furkan Gözükara SECourses•7/15/23, 12:32 AM

auto1111 has roop extension

Furkan Gözükara SECourses•7/15/23, 12:32 AM

and api support

EyeSpyBekoAI•7/15/23, 1:18 AM

Hey there SD community. I had a hopefully somewhat quick question for you I'm guessing one of you can answer without an issue!
I was wondering if you guys know a way to put a generated image from SD, infront of a pure white background. An example is below. I am able to do this right now by first uploading a pure white background into inpaint, mask an area, and then generate an image. Which works well enough, but if I want to use the shape of a specific image and get control net involved, the quality takes a big hit, and then the pure white background disappears. Do any of you know a way I can do this in a much more straightforward fashion? Any help would be great. An example is below. Thanks!

weimaraner-dog-pure-white-background-cute-young-33321196.png

EyeSpyBekoAI•7/15/23, 1:23 AM

Oh and if it helps, I have the rembg extension installed and can remove the background of a generated picture if needed. It’s then a question of how to replace it with a pure white background.

EEyeSpyBekoAI Oh and if it helps, I have the rembg extension installed and can remove the back...

Furkan Gözükara SECourses•7/15/23, 1:29 AM

as far as i know there is no way

Furkan Gözükara SECourses•7/15/23, 1:30 AM

except if you train object

Furkan Gözükara SECourses•7/15/23, 1:30 AM

you are already doing background remove

FFurkan Gözükara SECourses as far as i know there is no way

EyeSpyBekoAI•7/15/23, 1:31 AM

So train the objects with pure white backgrounds?
I tried training on no backgrounds, and it had really bad results SD got really confused.

EEyeSpyBekoAI So train the objects with pure white backgrounds? I tried training on no backgro...

Furkan Gözükara SECourses•7/15/23, 1:35 AM

stable diffusion dont have transparent layer

Furkan Gözükara SECourses•7/15/23, 1:35 AM

it is parsed as white or black

Furkan Gözükara SECourses•7/15/23, 1:36 AM

https://www.linkedin.com/posts/furkangozukara_testing-different-sdxl-lora-trainings-different-activity-7085794214491435008-2iTN?utm_source=share&utm_medium=member_desktop

Furkan Gözükara on LinkedIn: Testing different SDXL LoRA trainings ...

Testing different SDXL LoRA trainings (different configurations & checkpoints) for hopefully upcoming amazing tutorial

Full workflow will be hopefully…

Furkan Gözükara SECourses•7/15/23, 1:38 AM

https://www.reddit.com/r/StableDiffusion/comments/14zyhy1/testing_different_sdxl_lora_trainings_different/

r/StableDiffusion - Testing different SDXL LoRA trainings (differen...

0 votes and 0 comments so far on Reddit

EyeSpyBekoAI•7/15/23, 1:45 AM

Thank you! I’ll keep researching and refer to the links.

Furkan Gözükara SECourses•7/15/23, 1:56 AM

almost perfect

Furkan Gözükara SECourses•7/15/23, 1:57 AM

i am going to sleep hopefully see you tomorrow

EyeSpyBekoAI•7/15/23, 2:03 AM

wow, it's hard to believe this is Lora!!!???

EEyeSpyBekoAI Hey there SD community. I had a hopefully somewhat quick question for you I'm gu...

Khang•7/15/23, 4:17 AM

I don't really understand your question so I'm not sure but I found an extension that may be related to your needs https://github.com/limithit/Mask2Background

GitHub

GitHub - limithit/Mask2Background: Mask2Background for Stable Diffu...

Mask2Background for Stable Diffusion Web UI. Contribute to limithit/Mask2Background development by creating an account on GitHub.

EyeSpyBekoAI•7/15/23, 5:14 AM

@Khang Yup, that's definitely the idea. I'm running a similar workflow but unfortunately SD is not the best at generating flat white backgrounds it seems, so I was wondering if there's a way where I can provide the background (just pure white in this case), and have SD generate directly on that background. Similar to what open pose editor does with control net, but do it for non-human objects

EEyeSpyBekoAI @Khang Yup, that's definitely the idea. I'm running a similar workflow but unfor...

Khang•7/15/23, 6:56 AM

I'm not sure if LORA/TI can help that. How about collecting 30 high-quality images of random things (different animals, logos, anime characters, 3d stuff) on a complete pure white background and train a LORA to see what happens?

Aashley Thanks for letting me know, my apologies, should have tested it better, I've rev...

Khang•7/15/23, 7:01 AM

It's working now thank you very much Ashleyk. There is a strange bug though I can't "copy path" of an individual file, it will just download the file. I can copy path of folders, but not files (JSON, PNG images, TXT, etc)

KKhang It's working now thank you very much Ashleyk. There is a strange bug though I ca...

ashley•7/15/23, 9:10 AM

Is this in Jupyter lab?

EEyeSpyBekoAI wow, it's hard to believe this is Lora!!!???

Furkan Gözükara SECourses•7/15/23, 10:13 AM

yep lora

Furkan Gözükara SECourses•7/15/23, 10:13 AM

Furkan Gözükara SECourses•7/15/23, 10:13 AM

i should record this video hopefully today

Furkan Gözükara SECourses•7/15/23, 10:32 AM

Narva•7/15/23, 10:33 AM

It's amazing, you can combine lora + previously trained face checkpoint and the results are incredible

Furkan Gözükara SECourses•7/15/23, 10:46 AM

NNarva It's amazing, you can combine lora + previously trained face checkpoint and the ...

Jehex•7/15/23, 10:52 AM

wdym by previously trained face checkpoint

FFurkan Gözükara SECourses Click to see attachment

Jehex•7/15/23, 10:52 AM

nice

JJehex wdym by previously trained face checkpoint 🙂

Furkan Gözükara SECourses•7/15/23, 10:54 AM

it could be dreambooth training

Furkan Gözükara SECourses•7/15/23, 10:54 AM

by the way the images i posted from SDXL

Furkan Gözükara SECourses•7/15/23, 10:54 AM

preparing workflow

FFurkan Gözükara SECourses by the way the images i posted from SDXL

Jehex•7/15/23, 10:55 AM

awesome, cannot wait

Aashley Is this in Jupyter lab?

Khang•7/15/23, 11:10 AM

Yes in Jupyter Lab. Also have you tried this tool Ashleyk? I noticed that you have installed Roop in your template, and it's a great tool for realistic models. I think this tool might also be helpful; it's almost similar to Roop but could potentially work with cartoon, 3D, and anime models too. I don't know how to install and use it so I can't test it though https://www.reddit.com/r/StableDiffusion/comments/13qculk/new_method_to_train_a_character_with_one_image/

r/StableDiffusion - NEW Method to train a character with ONE image ...

294 votes and 91 comments so far on Reddit

KKhang Yes in Jupyter Lab. Also have you tried this tool Ashleyk? I noticed that you ha...

ashley•7/15/23, 11:12 AM

I am not going to bother trying it, when people can't even be bothered to enter a proper commit message, it shows that they are grossy incompetent and I don't want to even THINK about going anywhere near their project and it also hasn't been updated in 2 months so it is utter garbage.

Monosnap_drboogProFusion_Code_for_Enhancing_Detail_Preservation_for_Customized_Text-to-Image_Generation_A_Regularization-Free_Approach_2023-07-15_13-11-15.png

Aashley I am not going to bother trying it, when people can't even be bothered to enter ...

Furkan Gözükara SECourses•7/15/23, 11:58 AM

i feel you

Aashley I am not going to bother trying it, when people can't even be bothered to enter ...

Khang•7/15/23, 12:17 PM

So sad I'm waiting for new method to quickly inject real face into any model

Khang•7/15/23, 12:18 PM

@Dr. Furkan Gözükara good news everyone https://www.reddit.com/r/StableDiffusion/comments/14zndzm/comfyui_extension_tab_for_a1111_released/

r/StableDiffusion - ComfyUI extension tab for A1111 released!

321 votes and 122 comments so far on Reddit

KKhang So sad I'm waiting for new method to quickly inject real face into any model 😭

ashley•7/15/23, 12:18 PM

Use A1111 roop extension

Khang•7/15/23, 12:19 PM

I used it (thank to your template) it's good but when I use Anime or 3D models it won't work well with them. It just add a real face on a 3D body

Aashley Use A1111 roop extension

ashley•7/15/23, 12:24 PM

Yeah it needs a real face for face detection to work

ashley•7/15/23, 12:25 PM

I made a RunPod endpoint to do it

felixsanz•7/15/23, 12:42 PM

@Dr. Furkan Gözükara do you like comfyui more than a1111?

Tianlai•7/15/23, 12:51 PM

@Dr. Furkan Gözükara Dear Dr., I am following your video tutorial of "Generate Studio Quality Realistic Photos By Kohya LoRA Stable Diffusion Training - Full Tutorial", Can I do it with intel chip Macbook pro?

Tianlai•7/15/23, 12:53 PM

I am wondering whether I can following all your youtube stable diffusion tutorials with Macbook pro?