Model no Intializing anymore?
Did no changes (been using this container for several months) and now it is stuck during intializing. It say worker is ready in the container logs..but not progressing for hours
3 Replies
Plus I literally joined the discord group to report/ask the same thing haha
The release for the vLLM repos in the hub for serverless deployment has crashed or something, so they removed it completely. So your endpoints are stuck initializing state. I am in the same situation.