SGLang

SGLang works very well in pod but impossible to run in serverless.
the api route stay => error 404
i use the exact same config (docker, command line, port) in pod and serverless.

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

SGLang - Runpod

Runpod•2y ago•

119 replies

Thibaud

SGLang

SGLang works very well in pod but impossible to run in serverless.
the api route stay => error 404
i use the exact same config (docker, command line, port) in pod and serverless.