5090 error serverless
Does the vllm image have the old pytorch? im getting this
NVIDIA GeForce RTX 5090 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.
If you want to use the NVIDIA GeForce RTX 5090 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/
6 Replies
Unknown User•6mo ago
Message Not Public
Sign In & Join Server To View
oh ok hmmm should i just change the image? of the vllm provided by runpod or what
Unknown User•6mo ago
Message Not Public
Sign In & Join Server To View
fine w me can you link it?
oh wait there's no
aight aight
Unknown User•6mo ago
Message Not Public
Sign In & Join Server To View
Working on this :) I needed to spend some time on our containers repo this worker will start depending on