Is there a way to scale pods?

I would like to scale up number of pods in order to meet demand. Is there a way to do that?
8 Replies
zkreutzjanz
zkreutzjanz10mo ago
use serverless
digigoblin
digigoblin10mo ago
Yep, pods can't scale up automatically, serverless is designed for scalability.
nerdylive
nerdylive10mo ago
well you can create a custom code that handles scaling like kubernetes using the graphql runpod api you can gather their load and check if you need to deploy another one
digigoblin
digigoblin10mo ago
I don't recommend doing that, using serverless is better.
nerdylive
nerdylive10mo ago
yeah easier too
digigoblin
digigoblin10mo ago
Easier and probably cheaper too.
ChueyChueykin
ChueyChueykinOP10mo ago
Problem is that serverless doesn't have H100 gpus
nerdylive
nerdylive10mo ago
Yeah that's currently high in demand

Did you find this page helpful?