"IN QUEUE" and nothing happeneds
Hello everyone,
I'm currently running a TGI container (ghcr.io/huggingface/text-generation-inference:2.2.0) within a serverless environment, alongside my model from Hugging Face.
Issue: Although the status indicates "connected," there seems to be no further activity. The logs display various INFO and WARNING messages but do not show any errors. This has left me puzzled as to the root cause of the problem.
I have attached the relevant logs and screenshots for reference.
Any insights or suggestions to troubleshoot this issue would be greatly appreciated.
I'm currently running a TGI container (ghcr.io/huggingface/text-generation-inference:2.2.0) within a serverless environment, alongside my model from Hugging Face.
Issue: Although the status indicates "connected," there seems to be no further activity. The logs display various INFO and WARNING messages but do not show any errors. This has left me puzzled as to the root cause of the problem.
I have attached the relevant logs and screenshots for reference.
Any insights or suggestions to troubleshoot this issue would be greatly appreciated.
