vLLM Startup Failure

Well folks it's been ...days...
Tonight the last running worker from my 1.9.6 endpoints crashed. And nothing would boot. As the screen shot shows even the new release for whatever reason fails the worker can't find or won't even boot the image. This has been both 1.9.6 and now 2.11

EID: 9dnfvmmf5mkpbk

This a known issue @Dj and @Jason ?
image.png
Solution
We believe this specific issue hasbeen fixed.
Was this page helpful?