Endpoints vs. Docker Images vs. Repos
Hi, I am new to both Docker and RunPod, so my apologies if this question is overly obvious.
I am trying to convert a FastAPI app into a RunPod serverless endpoint. My question is, given that my FastAPI app has many endpoints, how can I access all those endpoints from just one RunPod serverless endpoint? Does it make more sense to create a serverless endpoint for every RESTful endpoint in my FastAPI app? Would I then need to create a different docker image for each endpoint?
I've spent a good amount of time looking through the docs, and most of the examples seem to use only one endpoint. Any resources you could point me to would be greatly appreciated.
Thanks for your help!
4 Replies
Unknown User•14mo ago
Message Not Public
Sign In & Join Server To View
If it where me I would remove the FastAPI portion of your code as the RunPod handler will pass your function your posted JSON without having to run a web server at all. You can parse that JSON however you need so you can have as many virtual endpoints as you need. RunPod runs a web server for you. If you don't want to remove your FASTAPI for some reason then you will have to code your handler to proxy connections between that JSON and your FASTAPI (locally, 127.0.0.1). Doing so will significantly slow down your response time.
@nerdylive @Encyrption Oh okay, that makes a lot more sense. Thank you both for pointing me the right direction. I was totally lost before
Unknown User•14mo ago
Message Not Public
Sign In & Join Server To View