How to use a volume with serverless endpoints?
Hello All, We have multiple serverless endpoints that downloads the model and generate the inference. Is there is a way to mount a common volume to all the serverless endpoint system. We don't want to down the model every time endpoint boots up.
It would be nice if you can please share a concrete example
5 Replies
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
In my case it is not a Pod but a serverless endpoint. Also, is there sample code pointing to similar use case.
Unknown User•16mo ago
Message Not Public
Sign In & Join Server To View
Manage Endpoints | RunPod Documentation
Learn to create, edit, and manage Serverless Endpoints, including adding network volumes and setting GPU prioritization, with step-by-step guides and tutorials.
