R
RunPod•4mo ago
jp_smasher

cuda version filter

Hi team, wanted to check is the cuda filter on the page the minimum version that the hardware supports? Or does the cuda filter mean the only cuda version that the hardware supports? I was trying to run 2xL40 but had a weird cuda index assertion error whereas the exact same code ran fine on 4090's, hence that got me wondering if L40's only permitted cuda 12.0 (based on the page)
Solution:
So if a machine is 12.2, it supports images with 12.1, 11.8 and so on
Jump to solution
3 Replies
Alpay Ariyak
Alpay Ariyak•4mo ago
Its the max version that is supported
Solution
Alpay Ariyak
Alpay Ariyak•4mo ago
So if a machine is 12.2, it supports images with 12.1, 11.8 and so on
jp_smasher
jp_smasher•4mo ago
thanks!
Want results from more Discord servers?
Add your server
More Posts
Maximum length for value of environment variablesAs I set some environment variables via the GraphQL API while starting a pod, I was wondering what tEnquiry about pod ID oi3rnyumuzvp2sHello, is it possible to search the history for a pod ID? We can not see anything in the audit log aLLM inference on serverless solutionHi, need some suggestion on serving LLM model on serverless. I have several questions: 1. Is there aServerless PricingIs the delay time also included in the charges? Is there a way to know the total time the worker wBroken serverless worker - can't find GPUServerless worker qbw30nmknd6cmh is broken can't can't find the GPU. ```json { "dt":"2024-02-19 23GraphQL Cuda VersionHow do I make a GPU pod through graphql with a specified cuda version? https://graphql-spec.runpod.How does multiple priorities for GPUs assign to me workers?Wondering what is the algorithm behind selecting gpus when i have like 3 selected; and also if for eAny template with python 3.9.* or how to install itI wanna install https://www.kernl.ai/how-to-guides/get-started/#optimize-a-model and it required pytRunpod api npm doesn't workI'm following https://doc.runpod.io/reference/health-check to call runpod with npm api package ``` How do I expose my api key and use CORS instead?I want to make it so that all requests from a domain to my serverless endpoint are allowed. I suppos