R
Runpod•4w ago
red_wolf

Configuring endpoints via API if publishing via Github integration

It seems that there's no way to create / update endpoints via the API, unless you host the images on a docker registry. Are there plans to extend API support to endpoints that are published from a github branch?
7 Replies
Unknown User
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
red_wolf
red_wolfOP•4w ago
I want to have my full endpoint configuration and deployment via code: Version controlled, sharable, readable in plain text, ... But this doesn't seem to be possible using the github integration, as opposed to deploying from a container registry.
Unknown User
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
red_wolf
red_wolfOP•4w ago
- collaboration: others in the team can easily view, review, ... the configuration - documentation: I need to write separate docs that instruct how to click something and where to put which value in the ui, rather than having a copy pastable command or script that i can run... - ui is buggy, ui is slow, ui is not searchable like api docs would be, ui changes are not traceable like versioned api changes would be - LLMs have and will continue to have a hard time with UIs ... see also: https://x.com/karpathy/status/1914489538006933770 - version control + having everything in one place (my git repository) - automation/scripting, ... - and also sharing publicly would be way, way easier, than having to go trough the tedious process of publishing something on the hub ... (which is restrictive in more than one way, e.g. that I can't (or at least I didnt find a straightforward way to) share mutiple versions of a template from the same repo (using the same handler or other common parts in a codebase, or a different docker file); a change in the iconUrl triggers a full rebuild, ..., ...
Andrej Karpathy (@karpathy)
The docs also have to change in the content. Eg instead of instructing a person to go to some page and do this or that, they could show curl commands to run - actions that are a lot easier for an LLM to carry out. Products have to change to support these too. Eg adding a
X
Unknown User
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View
red_wolf
red_wolfOP•4w ago
From my findings, but I might be wrong: 
  
GitHub templates are not regular templates:
   - They appear in template list but return 404 on direct access
   - They have auto-generated names like "[endpoint name]__template__00vc58"
   - Images are built and stored in RunPod's private registry: registry.runpod.net/{user}-{repo}-{branch}-{dockerfile}:{commit}
What you CAN update via API:
   - All endpoint settings (workers, timeouts, scaling, etc.)
   - Switch between different template versions
   - Endpoint name and configuration
What you cannot update via API:
   - Template environment variables
   - Docker CMD/ENTRYPOINT overrides
   - Container disk size
   - Any template-level settings
  
GitHub templates are not regular templates:
   - They appear in template list but return 404 on direct access
   - They have auto-generated names like "[endpoint name]__template__00vc58"
   - Images are built and stored in RunPod's private registry: registry.runpod.net/{user}-{repo}-{branch}-{dockerfile}:{commit}
What you CAN update via API:
   - All endpoint settings (workers, timeouts, scaling, etc.)
   - Switch between different template versions
   - Endpoint name and configuration
What you cannot update via API:
   - Template environment variables
   - Docker CMD/ENTRYPOINT overrides
   - Container disk size
   - Any template-level settings
Unknown User
Unknown User•4w ago
Message Not Public
Sign In & Join Server To View

Did you find this page helpful?