Runpod serverless overhead/slow
I have a handler that is apparently running very fast, but my requests are not. I'm hoping to process video frames. I know this is an unconventional use case, but it appears that it is working reasonably well with this one exception:
What we're actually seeing are not fast responses, but responses that take at least a second, and often longer. The runpod dashboard claims that this is execution time, but the worker logs disagree.
Request ID Delay Time Execution Time
sync-61d689e6-502e... 0.18s 1.28s
What's going on here? Is there anything we can do?
I'll post my handler code in the next message.
What we're actually seeing are not fast responses, but responses that take at least a second, and often longer. The runpod dashboard claims that this is execution time, but the worker logs disagree.
Request ID Delay Time Execution Time
sync-61d689e6-502e... 0.18s 1.28s
What's going on here? Is there anything we can do?
I'll post my handler code in the next message.
