Hey guys, I'm running into a persistent
Hey guys, I'm running into a persistent issue where workers report typical wall time (200ms) but my client-side ends up taking around 5-6s and timing out. Haven't been able to reproduce consistently but run into this problem every single day basically.
Here's an example of what I've logged from one of these faulty requests:
- Wall time (233ms)
- Request from upstream provider (LLM Inference) - (181ms)
Client-Side
While connecting
-
summary | reused:0 proto:h3 dns:1ms tcp:118ms tls:117ms server:2918ms total:3154ms
-> Reused indicates if this was a previously open connection.
While receiving
->
Total Time for Server Response: 3156ms
Here's an example of what I've logged from one of these faulty requests:
- Wall time (233ms)
- Request from upstream provider (LLM Inference) - (181ms)
Client-Side
While connecting
-
summary | reused:0 proto:h3 dns:1ms tcp:118ms tls:117ms server:2918ms total:3154ms-> Reused indicates if this was a previously open connection.
While receiving
->
Total Time for Server Response: 3156ms
