Template issues
1. I'm aware these are community templates, so let's be real i know i'm not going to get refunds LOL
2. I'm just passing the frustration along as i'm not sure there's any real support for these...
3. Sadly i haven't used runpod in al ong time and other services work differently (am not complaining, just ... haven't really been on your service in a while)
ok so..
I haven't NOTICED IF THIS IS ONLY Runpod, and am testing another service as we speak.
Really extensive expensive bug here.
.... Can generate images from huggingface models.
(SDXL/Illust etc)
Cannot from anything downloaded from Civitai.
INcluding my own, and inclusive of loras.
Disabled nancheck, blacksquares lol - reenabled it? Same issue, won't work.
it's not vae, it's unet.
Now the hard call is, I tried the same model on another pod - older template, similar to the one i borrow for another service.
THAT MODEL WORKS, the only issue is:
A1111's so outdated on that oen i. can't use supermerger.
Can't load Embedding merge lol.
I realize that one of these days i'm jusit gonna have to make my own docker container XD
Test complete:
Somehow the Auto1111 template that exists using the most RECENT pull of Auto isn't ... well the civitai unets arent' working somehow after download.
The OLD Auto template WORKED but i couldn't get extensions in (lol my fault i'l take that)
Other service with WebUI Forge:
....scarily i've never used forge but the browser works, and one of my models works entirely!
I'm NOT sure what was up.
API • Github • Gradio • Startup profile • Reload UI
version: v1.10.1 • python: 3.10.12 • torch: 2.6.0+cu124 • xformers: 0.0.29.post3 • gradio: 3.41.2 • checkpoint: be7386c21a
That was my setup, i deleted it already because i'm sadly not made of green paper, but maybe if i would have picked a different container it would've worked better?
Solution:Jump to solution
Update: Swapped to forge regular and the models are working, inclusive of the ones that are merged.. I copied everything over from the old forge install - sincei t's network volume..
And suddenly BANG it works.
I think there's some weird thing where a code mixes itself up--
Like i dont know whats weirder .....
9 Replies
tried https://www.runpod.io/console/explore/l0augaikfv ?
about civitai is mostly issues about them as now they require api token to download 99% of things
Well i'm a long time civitai user, and i have put my API keys in -- but the civitai issues are not related to API keys your API key won't fix broken UNET lol.
Basically if it was Civitai downloaded it'd keep the same hash, the same size, but esentially it'd corrupt the UNET and produce nans.
I didn't try that one YET i still have a good chunk of credits even though i snuck back to vast last night -
One of my problems usually is making sure i have a template that 'll let me install extensions -- i'm one of those "not quite a power user but an idiot that will probably brick a bare metal" XD
I've got no clue how to make my own docker yet
And Forge isnt' A111. lol.
I tried forge last night, not bad 😛
It's similar yes, but it's not A111.
I'm ok with that.
But if anything i didn't realize that not ALL extensions were 100% compatibile.
my poor embedding merge extension i love wouodln't work on forge lastn ight -
Not your issue, the template i used wasn't from runpod and that wasnt' my runpod pod 😛
It was both runs of A111 sadly that broke.
this one should work all fine recomend using network storage if you plan long term setup
Ouu, i like there's no models included.
its barebone for you to customize
Yea no that's actually nice, i won't be going in TODAY to test it - but i have about 10 bucks in credits still left, so this is a really nice answer, sure it didn't FIX a problem but it gave a good solution! 🙂
Currently experiencing the same problem weirdly on models that aren't from Civitai, i'll be honest i didn't think it was gonna cause it because i got it all up and running , extensions ran really easily -- but it's Nans all over the place, i'll check back in on this i'm using the template you sent
Yea no scarily it's still doing this:
NansException: A tensor with NaNs was produced in Unet. This could be either because there's not enough precision to represent the picture, or because your video card does not support half type. Try setting the "Upcast cross attention layer to float32" option in Settings > Stable Diffusion or using the --no-half commandline argument to fix this. Use --disable-nan-check commandline argument to disable this check.
I dont understand why though, like i'm on a 4090.
And trust me: SOME of the models aren't actually from civitai and are on huggingface.
Solution
Update: Swapped to forge regular and the models are working, inclusive of the ones that are merged.. I copied everything over from the old forge install - sincei t's network volume..
And suddenly BANG it works.
I think there's some weird thing where a code mixes itself up--
Like i dont know whats weirder ..
Or i'm breaking it by installing things?
I'll have to test the other image later again because that one had way less to it, less things -- Vast must have a similar setup to the runpod one because the imagei 'm using right now is like the one i used the otehr day
OH LORD LMAO
Ok even more funny updates:
FIXED THE NAN ERROR
but supermerger failed.
Question for the OTHER TEMPLATE:
1. Why Nans
2. Was it reforge?