RTX-5090
when will we see the RTX-5090 in serverless? currently it doesn't work because the vLLM version still doesn't support, will the runpod team gives a nightly build of the container that runs on the RTX-5090?
7 Replies
@wiki
also very interested in this @here
I dont have the vLLM problem, just HF Transformers necessary
you can actually install pytorch nightly
if you can make your own image
https://canary.discord.com/channels/912829806415085598/948767517332107274/1364325738626416692
like from this
yeah i mean I just need the 5090 available on serverless
oh ya* sorry i thought it was already available
This should be rolling today
Done.
