Random 404 errors thrown by runpod secure cloud instance
We are running a llm in production 24/7 and we have a heartbeat detector that checks the vllm health endpoint /health and we’ve noticed seemingly random 404 errors returned when we hit the runpod instance. Can someone from runpod comment on what might be causing these errors? We only hit every 5 minutes and we have been averaging 3-4 404’s the last few days. Our pod is in data center CA-1
2 Replies