queue delay times
Hi , I'm seeing really long delay times . even though there's nothing in the queue , and this is a really small CPU serverless endpoint . Any idea what causes this ?
output is undefined on response
Hello, i am running the serverless endpoint and I get a return in the console for a request made on the site, but when i use the sdk with the runSync function it does not give me an output. Instead it just says that it succeds and is completed but no output object is present on the response. here is the response printed as a table
Multiple models in a single serverless endpoint?
Hi everyone, I was wondering if this is possible since the environment variable seems to suggest that it's something that's supported.
as well as the fact that you have to mention the model name when posting a request....
Keeping idle workers alive even without any requests.
Hey everyone, does anyone have a clear understanding of how idle timeout works on RunPod?
It seems like billing is based on max workers by default.
For instance on this deployment I set 5 max workers, 0 active workers, and an idle timeout of 5 seconds, but even with no requests, I still see 3 idle workers. Is this expected behavior, or is something off?...
