Search
Feedback
Setup for Free
R
Runpod
•
17mo ago
•
29 replies
Emad
LLAMA 3.1 8B Model Cold Start and Delay time very long
Hey
, our cold start time always reaches over a minute and same with delay
. For live running we need this to be quicker
. We have tried with network volume as well but it doesnt change anything
.
Runpod
Join
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!
20,940
Members
View on Discord
Resources
ModelContextProtocol
ModelContextProtocol
MCP Server
Recent Announcements
Similar Threads
Was this page helpful?
Yes
No
© 2026 Hedgehog Software, LLC
Twitter
GitHub
Discord
System
Light
Dark
More
Communities
Docs
About
Terms
Privacy
Similar Threads
meta-llama/Meta-Llama-3-8B-Instruct serverless
R
Runpod / ⚡|serverless
17mo ago
Cold Start Time is too long
R
Runpod / ⚡|serverless
2y ago
Length of output of serverless meta-llama/Llama-3.1-8B-Instruct
R
Runpod / ⚡|serverless
10mo ago
Cold start time
R
Runpod / ⚡|serverless
2y ago