How to avoid Cloudflare timeouts on pods?
I saw a previous post mentionning using the public IP but it doesn't seem to work for me?
I'm using runpod to host a vLLM server (the serverless endpoint doesn't work for me).
I'm running batch workloads and those timeout (cloudflare)
How to avoid that please?
5 Replies
Use tcp or ssh tunnel
Understood for ssh tunnel, but I don't understand for tcp, would it still accept https connection?
Unknown User•15mo ago
Message Not Public
Sign In & Join Server To View
I tried with the NousHermes model llama 3.1 8b and it doesn't work out of the box
the requests hang for ever
Unknown User•15mo ago
Message Not Public
Sign In & Join Server To View