Is there a way to scale pods?

I would like to scale up number of pods in order to meet demand. Is there a way to do that?
8 Replies
zkreutzjanz
zkreutzjanz2mo ago
use serverless
digigoblin
digigoblin2mo ago
Yep, pods can't scale up automatically, serverless is designed for scalability.
nerdylive
nerdylive2mo ago
well you can create a custom code that handles scaling like kubernetes using the graphql runpod api you can gather their load and check if you need to deploy another one
digigoblin
digigoblin2mo ago
I don't recommend doing that, using serverless is better.
nerdylive
nerdylive2mo ago
yeah easier too
digigoblin
digigoblin2mo ago
Easier and probably cheaper too.
ChueyChueykin
ChueyChueykin2mo ago
Problem is that serverless doesn't have H100 gpus
nerdylive
nerdylive2mo ago
Yeah that's currently high in demand