Missing 12.9 cuda version in Create pod API
Hi, I'm trying to create a pod with APIs with vllm 0.9.2 on A40/A6000 in EU-SE1 how can I force it to be created on an host with cuda 12.9? vllm 0.9.0+ requires cuda 12.8+ but the hosts with a40 there have a mix of 12.4, 12.7 and 12.9. If I don't set a cuda version it work when I'm lucky to get an host with 12.9 otherwise it won't work.
Is it possible to get the cuda version 12.9 added to the API options to create a new pod ?
2 Replies