How to manage frequent redownloads of large docker images ?
Hello I am trying to use a serverless endpoint for a large docker image that is being redownloaded every time I make a request, but it can take 5+ minutes to finish, so zero of my requests are coming through.
I understand that serverless pods are not gaurenteed to hit but surely there is something I can do other than making my image smaller? Otherwise my service is unusable
Continue the conversation
Join the Discord to ask follow-up questions and connect with the community
R
Runpod
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!