Handler not identified in repo

Creating a Hub instance for github.com/ivrit-ai/runpod-serverless. Handler script is not identified - tried naming is handler.py, rp_handler.py, infer.py. What's next?
No description
23 Replies
Dj
Dj•3mo ago
We're looking for handler.py in the .runpod or root dir iirc
BenderRodriguez
BenderRodriguezOP•3mo ago
Thanks! Can you verify this and provide a definitive answer? It is is not clear in the documentation, and forces me to do back-and-forth committing and recommitting into the GH repo until this works. Also, I definitely tried handler.py in the root dir, rather keep it there and not in .runpod if possible Added handler.py under .runpod, and linked it to infer.py - still not working.
Dj
Dj•3mo ago
Let me poke, I don't know a lot about the Hub validating backend (this service) Sorry, already a quick update - just looking at the UI we don't actually check. It doesn't look like it's wired to anything. I think you can just make a release 😛
BenderRodriguez
BenderRodriguezOP•3mo ago
yep, that seems to be it. Can you please document/fix this? Wouldn't be surprised if it's blocking many others. 🙂 Also, how do I run the tests for the Hub locally?
Dj
Dj•3mo ago
Do you think it would be clearer if I just updated this text to read: "Ensure your project [contains a handler script] for running on RunPod Serverless"?
No description
Dj
Dj•3mo ago
The text in brackets would be the same link to the docs. And to my knowledge, the tests you can just do yourself. Make a request to the endpoint running on your device or a testing serverless endpoint and verify the expected response. Long term it would be super cool if you could run the tests for stuff like CI blocking releases :thinkMan:
BenderRodriguez
BenderRodriguezOP•3mo ago
Remove it from the list at all. Instead, provide reference code in a GH repo that explains how this works.
BenderRodriguez
BenderRodriguezOP•3mo ago
OK, I'm able to get my model built. However: 1. Currently can't deploy it (only able to deploy "Dummy release take 4") 2. Don't know how to make it available to others via the hub.
No description
Unknown User
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View
BenderRodriguez
BenderRodriguezOP•3mo ago
Understood. Will it be publicly available for others to find when the look through the hub?
Unknown User
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View
BenderRodriguez
BenderRodriguezOP•3mo ago
Thanks. Does that mean I also can't deploy it for myself, for testing/canary? Unable to do that either. What's the typical time it takes to approve?
Unknown User
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View
BenderRodriguez
BenderRodriguezOP•3mo ago
It does not work. Clicking "deploy" does the following:
BenderRodriguez
BenderRodriguezOP•3mo ago
No description
BenderRodriguez
BenderRodriguezOP•3mo ago
No description
BenderRodriguez
BenderRodriguezOP•3mo ago
No description
BenderRodriguez
BenderRodriguezOP•3mo ago
Nothing gets deployed, it just returns to the original screen
Unknown User
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View
BenderRodriguez
BenderRodriguezOP•3mo ago
OK. Now model is approved and in the hub, but deploying it still does not work. I'd like to enable deploying it from the hub (not just serverless) so it's easier for others. Can you help root cause this?
Poddy
Poddy•3mo ago
@BenderRodriguez
Escalated To Zendesk
The thread has been escalated to Zendesk!
Ticket ID: #18724
Unknown User
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View
BenderRodriguez
BenderRodriguezOP•3mo ago
Many thanks.

Did you find this page helpful?