How to increase the idle time >3600s?
I want to run the serverless docket image. its starts but after the idle it starts the inicialisation again. In my install process I need to download waights and after the idle the process dowloading starts again and again
1 Reply
If I understand correctly, your container works fine, but you don't want to re-download the models needed for inference on each cold start. Is that correct?
If so, you have two options. Either bake the models right into the container image (best performance) or use network volume and load them from there (more dynamic option).