environment variables
how to get environment variables while build?
I set variables in endpoint settings, but they are not available during build.
Please tell me if I missed something?
...
Solution:
You can either build the Docker image yourself, push to a docker registry and deploy from there. Or if you want to use the Github Integration you need to put your key inside the Dockerfile, this is the current solution.
Regular "throttled" status
Hi,
I've configured a serverless endpoint with the
max_workers setting explicitly set to 1.
I've observed that the single worker for this endpoint frequently enters and stays in the "Throttled" state. This seems to be causing significant delays in request processing, making them take much longer than the actual inference time.
...Solution:
when you set max worker to 1, your worker only deploy to single machine, when you not using it, we will give that machine to other people and when machine is fully used, your worker will be throttled. Highly suggest to avoid set max worker to be 1.
Error running ComfyUI workflow from pod on serverless
I’m encountering an error when running a ComfyUI workflow from a pod on RunPod serverless.
Previously, I was running the ComfyUI workflow on a pod with network storage mounted, and it worked fine. Now, I want to run the workflow via API, so I deployed the endpoint using the image:
timpietruskyblibla/runpod-worker-comfy:3.4.0-base
with my network storage mounted as the endpoint’s storage....
Requests stuck in queue
Hi
I am having issues with my serverless deployment - tasks are stuck in queue for 6-10 min, while there are idle workers (screenshot 1)
I believe the issue to be with how the container is started, and not with the image itself....
