R
RunPod•4mo ago
Haussar

HTTP service [PORT 7860] Not ready

Like the title says, the http service isn't ready for me to connect when I'm trying to run TheBloke Local LLMs One-Click UI template. I'm using the A100 GPU with 100GB Disk and 100GB pod volume. its usually lets me connect after a few minutes and its been more than this.
4 Replies
digigoblin
digigoblin•4mo ago
The template is broken, you can use this one instead.
No description
Haussar
Haussar•4mo ago
I try that one, i'm not having any luck with it
Tom
Tom•4mo ago
bump this.. same issue
digigoblin
digigoblin•4mo ago
TheBloke template is broken, he is the only one who can fix it, its not a RunPod issue. What do you mean you are not having any luck with it? it works fine for me.
Want results from more Discord servers?
Add your server
More Posts
I'd like to run a job that takes 8x GPUs.. any way I can increase the spend limit?I'd like to run a job that takes 8x GPUs.. any way I can increase the spend limit?Slow connection speedIm not sure what caused this slowSuddenly cannot boot SD Pod having trouble with "Could not load settings"full error message: 2024-04-20T12:41:36.193868880Z *** Could not load settings 2024-04-20T12:41:36.1stuck in "stale worker", new release with new image tag not deploying "latest worker"I've noticed this problem several times. Sometimes, I pushed a new containter image version, I click4xH100 pod is stuck -- can't restart or stopI am still connected with SSH, but the pod can't be used due to some network issues. RunPod UI also Can't open folder in Jupyter LabI've been generating some video in ComfyUI and now want to open the output folder in JupyterLab to duse auto1111 with my own sdxl-lightning modelsHi, I wanted to install the auto1111 sd serverless worker with my own custom model. What is the bestCan anyone help me setting up serverless endpoint?How can we test our runpod endpoint by runpod API. Any pthon script available?CPU seems extremely slowHello, I created a pod with an A40 and 16vCPU. I'm trying to train a deep learning model, however, Igetting a pod's port mapping..Is there any way to use an API to find out the port mappings of the externally exposed ports for a p