RunpodR
Runpod8mo ago
Yobin

5090 error serverless

Does the vllm image have the old pytorch? im getting this

NVIDIA GeForce RTX 5090 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.
If you want to use the NVIDIA GeForce RTX 5090 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/
PyTorch
Set up PyTorch easily with local installation or supported cloud platforms.
Was this page helpful?