Serverless SGLang spent credits on phantom requests
I deployed a serverless endpoint (id
However, looking a the logs, there are lots of requests like this:
I'm assuming that's what kept the workers alive, spending the credits in vain.
I'm assuming the addresses in the log are source addresses of the request - would that be some runpod process trying to get the list of models?
Any clue on how to resolve this and prevent it from happening in the future?
ua6ui6kfksdocnHowever, looking a the logs, there are lots of requests like this:
I'm assuming that's what kept the workers alive, spending the credits in vain.
I'm assuming the addresses in the log are source addresses of the request - would that be some runpod process trying to get the list of models?
Any clue on how to resolve this and prevent it from happening in the future?
