RunpodR
Runpod5mo ago
kaz133

Too big delay time. How can I reduce it?

It is important for me that my request is executed in 1 second or less. But the request is executed in about 1.5 seconds.

I have optimized the docker image a lot, its weight is now 300 MB. And if the cold start time is ok for me (200 ms), then the delay time is not (

How can it be optimized?

Right now I am in demo mode, trying to understand if the platform will allow me to get a response in 1 second.
Was this page helpful?