Serverless worker only handling one request at a time
How can i allow a single serverless worker to handle more than one job at a time? Ive set these up to handle around 5-10 requests on a single server but it seems to only process one at a time which is really Inefficient.
Continue the conversation
Join the Discord to ask follow-up questions and connect with the community
R
Runpod
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!