Multi-nodes Serverless Endpoint
Can I create a serverless deployment for two or more nodes? For example DeepSeek R1 671b needs at least two nodes.
Thanks.
2 Replies
The most GPUs a single serverless worker can have is 8, did you need more than this?
If you need more than 8 GPUs running at the same time, try our instant cluster