Software Engineering Courses (SECourses)•3y ago

hi everyone! wanted to share a demo of running A1111 with a fal-serverless backend. The idea here is

hi everyone! wanted to share a demo of running A1111 with a fal-serverless backend. The idea here is that you just run the UI locally but the GPU parts happen in the cloud. So instead of having a machine on all the time, you would only have a machine running when you are generating images which should save some $. Here is a video of it in action: https://www.youtube.com/watch?v=EIxF7TKk6wg

I am looking for feedback. Would you want to use this?

YouTubeFeatures and Labels

Serverless AUTOMATIC1111

In this video we demonstrate a version of AUTOMATIC1111 StableDiffusion UI that runs in a serverless manner using fal-serverless.

Bbigbird - ビッグバード (fal.ai)hi everyone! wanted to share a demo of running A1111 with a fal-serverless backe...

ashley•5/25/23, 2:13 PM

This is really cool, will be nice if you can implement all the other tabs and especially add support for Dreambooth

DDawood Also have you ever tried stylizing your images using control net before training...

Furkan Gözükara SECourses•5/25/23, 2:14 PM

never tried

Bbrenkhof Hey, what is the current best solution for this task? Thanks!

Furkan Gözükara SECourses•5/25/23, 2:14 PM

train cloth. train person. make cloth image. in paint person face

Aashley This is really cool, will be nice if you can implement all the other tabs and es...

bigbird - ビッグバード (fal.ai)OP•5/25/23, 2:15 PM

Can do for sure

bigbird - ビッグバード (fal.ai)OP•5/25/23, 2:16 PM

Will start working on the other tabs, but wanted to see if there is enough interest in it first

Bbigbird - ビッグバード (fal.ai)Can do for sure

ashley•5/25/23, 2:17 PM

Definitely, it will be very useful for people like me who run a Mac and don't have a proper GPU, I am using cloud services already anyway.

KKallamamran I think we need a tutorial for this -> https://www.youtube.com/watch?v=r-ZYOlZTL...

Furkan Gözükara SECourses•5/25/23, 2:17 PM

from video i dont see he managed to make it work am i mistaken?

NNull these?

Furkan Gözükara SECourses•5/25/23, 2:17 PM

gradient checkpoint

FFurkan Gözükara SECourses + gradient checkpoint

Null•5/25/23, 2:19 PM

tried, still same ;-;

Null•5/25/23, 2:19 PM

NNull tried, still same ;-;

Furkan Gözükara SECourses•5/25/23, 2:19 PM

you must be making error

Furkan Gözükara SECourses•5/25/23, 2:20 PM

i just made it work like yesterday on a patreon supporter pc

Furkan Gözükara SECourses•5/25/23, 2:20 PM

gtx 1080

Furkan Gözükara SECourses•5/25/23, 2:20 PM

batch size is 1 right?

Null•5/25/23, 2:20 PM

i'm also a patreon supporter

NNull i'm also a patreon supporter 🥲

Furkan Gözükara SECourses•5/25/23, 2:20 PM

messaging you

FFurkan Gözükara SECourses batch size is 1 right?

Null•5/25/23, 2:21 PM

yes

Null•5/25/23, 2:21 PM

pat._.fenis•5/25/23, 2:26 PM

I am getting the same error message with LDSR as I was having with controlnet, [urllib.error:urlopen error ssl certificate verify failed] I did not see any outgoing request through my firewall that was being blocked so I am not sure how to fix the issue. This is a fresh Windows 10 install with fresh Python 3.10.6 and freshAutomatic1111 dev build install on an Auros Master z590 with a 4090, 11700@4.9ghz, 128gb 3200 ram and a 2tb gen 4.0 NVME.

Ppat._.fenis I am getting the same error message with LDSR as I was having with controlnet, [...

Null•5/25/23, 2:35 PM

which?

pat._.fenis•5/25/23, 2:35 PM

urllib.error:urlopen error ssl certificate verify failed

pat._.fenis•5/25/23, 2:36 PM

That's the last line of it in cmd prompt

Ppat._.fenis urllib.error:urlopen error ssl certificate verify failed

Null•5/25/23, 2:40 PM

hmm i think its the websites issue

pat._.fenis•5/25/23, 3:11 PM

Fixed it, for now.

The certifi certificate bundle for python 3:10 was outdated.

pat._.fenis•5/25/23, 3:13 PM

Save a new python file as test.py with the code from https://gist.github.com/marschhuynh/31c9375fc34a3e20c2d3b9eb8131d8f3

Gist

Install Certificates.command

GitHub Gist: instantly share code, notes, and snippets.

pat._.fenis•5/25/23, 3:14 PM

Create C:\Program Files\Common Files\ssl
Open cmd prompt as admin, navigate to the location you saved the test.py, (cd your test.py file location) then run python test.py.

felixsanz•5/25/23, 3:15 PM

what could happen if i'm getting Couldn't find VAE named vae-ft-mse-840000-ema-pruned.safetensors; using None insteadCouldn't find VAE named vae-ft-mse-840000-ema-pruned.safetensors; using None instead on load

felixsanz•5/25/23, 3:16 PM

but then i go settings, i select vae: "none", apply settings; then vae: "vae-ft-mse...", apply settings. and ...

Loading VAE weights specified in settings: /mnt/lexar/ai/automatic1111/models/VAE/vae-ft-mse-840000-ema-pruned.safetensors
Applying optimization: xformers
VAE weights loaded.

Loading VAE weights specified in settings: /mnt/lexar/ai/automatic1111/models/VAE/vae-ft-mse-840000-ema-pruned.safetensors
Applying optimization: xformers
VAE weights loaded.

felixsanz•5/25/23, 3:16 PM

i can select it in the settings but it's always giving error on starting

pat._.fenis•5/25/23, 3:21 PM

Dose anything happen that is problematic?

pat._.fenis•5/25/23, 3:25 PM

load this link https://huggingface.co/stabilityai/sd-vae-ft-mse-original/resolve/main/vae-ft-mse-840000-ema-pruned.safetensors
place the file downloaded from it in
\stable-diffusion-webui\models\VAE

felixsanz•5/25/23, 3:26 PM

yeah i have that file there

felixsanz•5/25/23, 3:26 PM

that's why i can load it with the settings, selecting it

felixsanz•5/25/23, 3:26 PM

but if I restart a1111, it gives me the error over and over again

felixsanz•5/25/23, 3:28 PM

automatic loading at start:

Couldn't find VAE named vae-ft-mse-840000-ema-pruned.safetensors; using None instead

Couldn't find VAE named vae-ft-mse-840000-ema-pruned.safetensors; using None instead

manual load via settings:

Loading VAE weights specified in settings: /mnt/lexar/ai/automatic1111/models/VAE/vae-ft-mse-840000-ema-pruned.safetensors
Applying optimization: xformers
VAE weights loaded.

Loading VAE weights specified in settings: /mnt/lexar/ai/automatic1111/models/VAE/vae-ft-mse-840000-ema-pruned.safetensors
Applying optimization: xformers
VAE weights loaded.

felixsanz•5/25/23, 3:29 PM

it doesn't make any sense xD

pat._.fenis•5/25/23, 3:29 PM

I don't even have that VAE, is that for a specific model you have?

Ppat._.fenis load this link https://huggingface.co/stabilityai/sd-vae-ft-mse-original/resolve...

felixsanz•5/25/23, 3:30 PM

it's this one, you linked it

felixsanz•5/25/23, 3:31 PM

it's the generic vae from stabilityai

pat._.fenis•5/25/23, 3:32 PM

So you have a model that stated it requires it?
If not, it is not necessary for it to exist in the VAE folder.

pat._.fenis•5/25/23, 3:34 PM