Cold start issue
I stuck with cold start issue,that make the response very slow when make a new request after a longtime. Are there anyways to solve this issues ?
2 Replies
That very depends on the thing you're starting
I also raised this issue a while back as I have the same problem when running a comfyui workflow. It takes a while for the worker to load the models into the VRAM I believe. The only way to solve it would be for the worker to do this when it's assigned.
Someone from the runpod team said they were working on this and were even trialling it but haven't heard anything for months. Perhaps someone on the team can provide an update?