Requests stuck in IN_QUEUE status
We deployed a LLaVA-v1.6-34B model on 2xA100SXM infra as a serverless endpoint. When we send a request, we don't get a response. And the request is indefinitely in the
We've previously been successful deploying LLaVA-v1.5-13b. But again grateful for suggestions
IN_QUEUEWe've previously been successful deploying LLaVA-v1.5-13b. But again grateful for suggestions
