Error with the pre-built serverless docker image
Hi
completely random, because sometimes it works smoothly, using the runpod serverless VLLM the machine gets stuck on
Using model weights format ['*.safetensors']
and I have to manually terminate the worker and restart it.
Do you have any suggestions? (attached my current envs)
Thank you
completely random, because sometimes it works smoothly, using the runpod serverless VLLM the machine gets stuck on
Using model weights format ['*.safetensors']
and I have to manually terminate the worker and restart it.
Do you have any suggestions? (attached my current envs)
Thank you
