Running serverless endpoint locally

Hi,
I'm trying to run locally, but can't find a solution in documentation. I tried running handler with docker and outside docker.
running with

--rp_serve_api

--rp_serve_api

ERROR:    [Errno 99] error while attempting to bind on address ('::1', 8000, 0, 0): cannot assign requested address

ERROR:    [Errno 99] error while attempting to bind on address ('::1', 8000, 0, 0): cannot assign requested address

running with

--rp_serve_api --rp_api_host='0.0.0.0'

--rp_serve_api --rp_api_host='0.0.0.0'

exits with error:

ERROR:    [Errno -2] Name or service not known

ERROR:    [Errno -2] Name or service not known

Is there some other sources I can look to solve this?

Have a nice day!
Mateusz

Solution

python3 -u rp_handler.py --rp_serve_api --rp_api_port 8010 --rp_api_host 0.0.0.0

python3 -u rp_handler.py --rp_serve_api --rp_api_port 8010 --rp_api_host 0.0.0.0

Runpod•2y ago•

28 replies

Hi,
I'm trying to run locally, but can't find a solution in documentation. I tried running handler with docker and outside docker.
running with

--rp_serve_api

--rp_serve_api

ERROR:    [Errno 99] error while attempting to bind on address ('::1', 8000, 0, 0): cannot assign requested address

ERROR:    [Errno 99] error while attempting to bind on address ('::1', 8000, 0, 0): cannot assign requested address

running with

--rp_serve_api --rp_api_host='0.0.0.0'

--rp_serve_api --rp_api_host='0.0.0.0'

exits with error:

ERROR:    [Errno -2] Name or service not known

ERROR:    [Errno -2] Name or service not known

Is there some other sources I can look to solve this?

Have a nice day!
Mateusz

Solution

python3 -u rp_handler.py --rp_serve_api --rp_api_port 8010 --rp_api_host 0.0.0.0

python3 -u rp_handler.py --rp_serve_api --rp_api_port 8010 --rp_api_host 0.0.0.0

Join the Discord to ask follow-up questions and connect with the community

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906 Members