R

Runpod•2y ago•

14 replies

Siamak

Run Lorax on Runpod (Serverless)

I created a docker image similar to (https://github.com/runpod-workers/worker-tgi/blob/main/src/entrypoint.sh) for Lorax, but inside of the docker image I am getting connection refused:


could you please check it?

runpod_issue.txt2.11KB

message.txt13.61KB

message.txt13.61KB

message.txt13.61KB

message.txt13.61KB

message.txt13.61KB

message.txt13.82KB

message.txt13.82KB

message.txt13.82KB

GitHub

worker-tgi/src/entrypoint.sh at main · runpod-workers/worker-tgi

The RunPod worker template for serving our large language model endpoints. Powered by Text Generation Inference. - runpod-workers/worker-tgi