serverless container disk storage size vs network volume
When I add a Serverless endpoint, it defaults to 5GB container disk. I tried to change it to a crazy high number like 50000GB, and it seems to be ok with it??
I'm confused, is this disk storage physically attached to the GPU machine? there a limit of this storage size? Does it cost any extra money? My ComfyUI docker image needs to download many different models, which can be hundreds of GB in total, what would happen if it exceeds the storage limit?
If I choose to attach a network volume, does it mean my docker image (contains many different models) will be deploy to store in the network volume? And the deployed volume need to communicate with the GPU via network requests?? So it will be slower?
If I have 4 GPU workers running in parallel, can they share the same network volume?
6 Replies
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
Another way is: you can store just the models in some path in the network volume, that way it will be faster. and i think network volumes are meant to be for storing models. the docker image is from the templates only.ohh this makes sense!! Good idea to only store models. I do see people storing the entire a111 in network volume and use it from there: https://github.com/ashleykleynhans/runpod-worker-a1111
GitHub
GitHub - ashleykleynhans/runpod-worker-a1111: RunPod Serverless Wor...
RunPod Serverless Worker for the Automatic1111 Stable Diffusion API - ashleykleynhans/runpod-worker-a1111
Well, if it exceeds the storage limit (it cant)im curious what's the storage limit look like, I see some pod has around 40GB disk size. in serverless machine I assume its about the same? that means i have to store my models in network volume, 40G is not enough for many models
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
I see! Thanks. But I assume it couldn’t be too large? Curious about the limit. If I were to guess, I guess it would be under 100gb
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View