Runpod•2y ago

Trouble with Pod HTTP Service Port

First time user of runpod.io.

Went through the steps of creating a Pod, used TheBloke Local LLMs One-Click UI

When I click on "Connect" I am not able to connect to the HTTP Service Port. It reads "Not Ready".

How do I solve this issue? Thanks!

Jjustblake3911 First time user of runpod.io. Went through the steps of creating a Pod, used Th...

Jason•7/18/24, 5:11 AM

I think the template is unmaintaned

Jason•7/18/24, 5:11 AM

Try other templates or ui's

justblake3911OP•7/18/24, 2:19 PM

What TheBloke Local LLMs would be supported? Is their a list somewhere?

Marcus•7/18/24, 2:21 PM

None, he doesn't maintain it anymore so they are all broken

Marcus•7/18/24, 2:22 PM

You can try this one instead

justblake3911OP•7/18/24, 2:37 PM

OK, I will give this Template a try.

Most of the videos / tutorials i've watched have shown loading a model through the Interface.

Is their any good beginner tutorial you would recommend for loading models / parameters using the recommended template?

Thanks,

Marcus•7/18/24, 2:40 PM

You can load the model in the interface, it also uses oobabooga text generation webui, same as TheBloke template

Trouble with Pod HTTP Service Port

Similar Threads

Similar Threads

Similar Threads