Question about Network Volumes
Hi!
Just a quick 2 questions about network volumes working in tandem with Serverless endpoints:
- Does it reduce the cold start time or availability of the serverless gpus? I want to store AI models inside a network volume and access it with a serverless gpu endpoint, I would like to know the issues I may run into as cold starts and availability are pretty important to me.
- What's the file path to a network volume if I want to set up my serverless container to use stuff in it?
Thanks all!
Just a quick 2 questions about network volumes working in tandem with Serverless endpoints:
- Does it reduce the cold start time or availability of the serverless gpus? I want to store AI models inside a network volume and access it with a serverless gpu endpoint, I would like to know the issues I may run into as cold starts and availability are pretty important to me.
- What's the file path to a network volume if I want to set up my serverless container to use stuff in it?
Thanks all!
