RunpodR
Runpod11mo ago
2 replies
leduyson2603

VLLM problem in A100 instance

Hi everyone, right now i'm having problem when trying to deploy runpod into A100 instances. I have tried many of A100 in different region but it always showing error "OSError: [Errno 98] Address already in use". I'm using VLLM version 0.6.3post1, it works fine for the last month but recently it not work anymore and if i deploy to another instance like A40 or RTX6000, it just works fine. Does anyone know the problem?
Was this page helpful?