VLLM repo not available in serverless
Hello! I am not able to select vllm as repo for serverless, It was there yesterday and the day before but did not work prolly cuz of outage, but right now It is not listed in avaliable repos, how can I fix this?
10 Replies
I dont even see it here
and there is no button here
last realease failed, maybe this is the reason
Do you know when will it be fixed?
I dont, also all of our services that runs vLLM stop working and are in state of initializing. This is huge problem for our services.
So far no answers...
Is this true for all vLLM services, or only for Runpod? I have a script running on a separate server and it’s been laggy today.
XD