Search
Star
Feedback
Setup for Free
© 2026 Hedgehog Software, LLC
Twitter
GitHub
Discord
System
Light
Dark
More
Communities
Docs
About
Terms
Privacy
SGLANG load LLM Model - Runpod
R
Runpod
•
16mo ago
•
2 replies
xxx
SGLANG load LLM Model
I am trying to load LLM model using Pods by using sglang template
.
Here is my config
:
When I start the pod
, it did not loading the model instead the container log keep showing cuda things
(license
,version
)
. May I know what is the reason
?
Runpod
Join
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!
21,202
Members
View on Discord
Resources
ModelContextProtocol
ModelContextProtocol
MCP Server
Similar Threads
Was this page helpful?
Yes
No
Similar Threads
SGLang DeepSeek-V3-0324
R
Runpod / ⛅|pods
10mo ago
TensorRT-LLM setup
R
Runpod / ⛅|pods
2y ago
2-3 hours for Pod to load OneTrainer and Flux model
R
Runpod / ⛅|pods
12mo ago
Cannot find any model weights with `/models/huggingface-cache/hub/models...`
R
Runpod / ⛅|pods
13mo ago