Multi-nodes Serverless Endpoint

Can I create a serverless deployment for two or more nodes? For example DeepSeek R1 671b needs at least two nodes. Thanks.

1 Reply

Dj•4d ago

The most GPUs a single serverless worker can have is 8, did you need more than this?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

19KMembers