question about the data structure of a serverless endpoint
I have a question about the data structure of a serverless endpoint.
I need to build a container with more than 1 model on it, it'll have a network volume with all data.
The question is: Where should I store the virtual environments, package dependencies (pyenv and pipenv) and caches ?
Storing them on the docker image or the network volume? which will bring better results in terms of performance and execution time ?
I need to build a container with more than 1 model on it, it'll have a network volume with all data.
The question is: Where should I store the virtual environments, package dependencies (pyenv and pipenv) and caches ?
Storing them on the docker image or the network volume? which will bring better results in terms of performance and execution time ?
