SGLang worker (similar to worker-vllm)
Recently, some progress has been made for efficiently deploying LLMs and LMMs. SGLang is up to 5x faster than vLLM. @Alpay Ariyak could we port the worker-vllm setup to SGLang?
https://github.com/sgl-project/sglang
https://lmsys.org/blog/2024-01-17-sglang/
https://github.com/sgl-project/sglang
https://lmsys.org/blog/2024-01-17-sglang/
