hi @Matt Silverlock, re: dynamic
hi @Matt Silverlock, re: dynamic partitioning – the documentation states "By default, Pipelines partition data by event date and time. This will be customizable in the future.". can you share any rough timelines for when you expect to ship this? pretty critical for multi tenant workloads, so looking to assess if i can give Pipelines a shot or go down another route 🙂
thx!
3 Replies
Unknown User•4mo ago
Message Not Public
Sign In & Join Server To View
thanks cole, i'm excited for the arroyo integration. my use case is fairly simple; i want to group the events that land in r2 by organization id as i'll be offering tenant-specific in app analytics. each org will be producing a lot of events and they won't be querying data cross-org. in the past i've been heavy user of aws kinesis & data firehose which has support for this
Partition streaming data in Amazon Data Firehose - Amazon Data Fire...
Learn the mechanism and basics of dynamic partitioning and how you can use it with Amazon Data Firehose.
Unknown User•3mo ago
Message Not Public
Sign In & Join Server To View