what are the downsides of setting the

what are the downsides of setting the batching interval to 1 second?
10 Replies
Unknown User
Unknown User6d ago
Message Not Public
Sign In & Join Server To View
volter
volter6d ago
Wouldn't smaller batches also result in more class A operations? Although I guess if it's just 1 pipeline that would be a pretty minimal cost
switz
switzOP6d ago
Can I query results that have not been closed yet? Are they buffered in memory or written right away? What’s the shortest query round trip from commit?
Unknown User
Unknown User5d ago
Message Not Public
Sign In & Join Server To View
switz
switzOP5d ago
so 10s is the minimum bound? I guess I could use a durable object for any data I need faster than that I'd like to build an OTEL ingestor on top of pipelines, but I also need real-time functionality for tailing OTEL-based logs. would someone from the team be open to chatting with me?
Unknown User
Unknown User5d ago
Message Not Public
Sign In & Join Server To View
switz
switzOP5d ago
Yeah I think I’ll have to utilize some pattern like that
Marc
Marc4d ago
Thanks cole. Happy to help
switz
switzOPthis hour
would love to chat about this when you have some time
Marc
Marcthis hour
Feel free to DM me your availability next week and we'll fine a time

Did you find this page helpful?