ComfyUI API
Good morning!
I have been following the instructions to be able to have a comfyui workflow as an API.
But I'm stuck here, having the template created "with flux.dev" and having a serverless.
...
Endpoint ID changing after Pulumi deployment
Pulumi output says one thing.
Runpod then says another thing.
The enpoint URL from Pulumi output that I then add to LiteLLM is obsolete....
CRITICAL: Runpod charging more unfairly
We have been charged everyday since the 13th of june, the logs clearly show that somedays the worker is not even called. Plus we have timeouts of 10 minutes, runpod is charging as if we called it everyday, one call for 10 minutes would be 0.1668 USD, while runpod is charging everyday more than 10x times the ammount, on the other hand we have the logs showing for example:
...
Unhealthy workers keep sabotaging production
As you can see, somehow 2/3 active workers + all flexible workers became unhealthy. I don't know the reason for this or if I have any power to fix it. However, without my involvement Runpod doesn't kill those workers and doesn't replace them automatically with healthy workers making my prod unstable. To resolve this incident I needed to manually kill unhealthy workers. I need some support on how to prevent or handle this situation.
Ollama Worker Keeps Redownloading Model
Hi, I’m trying to set up my first serverless Ollama (0.9.6) endpoint with an attached network volume (85 GB) to store the downloaded model (74 GB). Unfortunately, once the model has been fully downloaded, the worker starts downloading it again, and continues to do so indefinitely.
Is there something I might be overlooking?...
