what are the downsides of setting the

what are the downsides of setting the batching interval to 1 second?
10 Replies
Unknown User
Unknown User2mo ago
Message Not Public
Sign In & Join Server To View
volter
volter2mo ago
Wouldn't smaller batches also result in more class A operations? Although I guess if it's just 1 pipeline that would be a pretty minimal cost
switz
switzOP2mo ago
Can I query results that have not been closed yet? Are they buffered in memory or written right away? What’s the shortest query round trip from commit?
Unknown User
Unknown User2mo ago
Message Not Public
Sign In & Join Server To View
switz
switzOP2mo ago
so 10s is the minimum bound? I guess I could use a durable object for any data I need faster than that I'd like to build an OTEL ingestor on top of pipelines, but I also need real-time functionality for tailing OTEL-based logs. would someone from the team be open to chatting with me?
Unknown User
Unknown User2mo ago
Message Not Public
Sign In & Join Server To View
switz
switzOP2mo ago
Yeah I think I’ll have to utilize some pattern like that
Marc
Marc2mo ago
Thanks cole. Happy to help
switz
switzOP2mo ago
would love to chat about this when you have some time
Marc
Marc2mo ago
Feel free to DM me your availability next week and we'll fine a time

Did you find this page helpful?