Runpod•4mo ago

Choosing GPU based on task data

Is there currently a way I can choose what Worker configuration is chosen for a request? I have a serverless instance that supports both Video and Image generation. However since Images need much less VRAM is there any way I can select what GPU to use per request?

2 Replies

blirdOP•4mo ago

Right now the only way to achieve this is setting up a second serverless endpoint with other gpus right?

3WaD•4mo ago

Yes. And if you're working with multiple models, it's a much better idea to have a separate endpoint for each, even if it's the same kind of task.

Gaming

Programming

Choosing GPU based on task data

Did you find this page helpful?