SGLANG load LLM Model
I am trying to load LLM model using Pods by using sglang template.
Here is my config:
When I start the pod, it did not loading the model instead the container log keep showing cuda things(license,version). May I know what is the reason?
Here is my config:
When I start the pod, it did not loading the model instead the container log keep showing cuda things(license,version). May I know what is the reason?
