Pod loses connection/reconnects periodically
Hey everyone, what I've noticed is that secure cloud pod drops connection and after couple of minutes reconnects.
Not sure what causes that, could it be related to server load? It's handling a lot of requests but not sure why that would cause server to disconnect.
Vllm logs don't display anything unusual. It feels like proxy is failing and starting again.
4 Replies
I see a small uptick in error logs from a few minutes before you sent this message. Let me check to see if they could be related.
Can you share your pod id?
uvvmvdvrda6p63
It looks like our connection to your Pod is timing out?
yes 502 or 503 bad gateway was displayed on cloudflare