Random 404 errors thrown by runpod secure cloud instance
We are running a llm in production 24/7 and we have a heartbeat detector that checks the vllm health endpoint /health and we’ve noticed seemingly random 404 errors returned when we hit the runpod instance. Can someone from runpod comment on what might be causing these errors? We only hit every 5 minutes and we have been averaging 3-4 404’s the last few days. Our pod is in data center CA-1
4 Replies
@joe
Escalated To Zendesk
The thread has been escalated to Zendesk!
Unknown User•8mo ago
Message Not Public
Sign In & Join Server To View
@joe Hi, have you resolved your issue yet? I also ran a health check on the pod in the CA datacenter and did see a 404. Just wanted to ask if your problem has been fixed already?
this is a persistent issue, it's been going on for months. I've just been retrying requests. I dunno if it's a cloudflare issue or what, but I can say that the requests aren't showing up in my ollama logs (which log all hits including 404s).