5090 error serverless
Does the vllm image have the old pytorch? im getting this
NVIDIA GeForce RTX 5090 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_70 sm_75 sm_80 sm_86 sm_90.
If you want to use the NVIDIA GeForce RTX 5090 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/
6 Replies
You should use newer pytorch yeah, it hasn't been updated I guess
oh ok hmmm should i just change the image? of the vllm provided by runpod or what
I'm not sure if there is any
Let me help check
i think there is no image for cuda 12.8, you need to build it on your own
fine w me can you link it?
oh wait there's no
aight aight
i hope they build it soon
Working on this :) I needed to spend some time on our containers repo this worker will start depending on