Achieving Concurrency with Paginated API Queries Using `paginateChunkEffect`
Just thinking about how I would achieve concurrency when querying a paginated API using paginateChunkEffect
I'm thinking I'd need to find a way to break the job down into multiple separate streams, so e.g. if it's something that I can query by date as well as incrementing numerical id, I would first break my data range down into chunks, and then create multiple streams each querying just their date range.
I would then have to stitch together the multiple individual streams
I'm thinking I'd need to find a way to break the job down into multiple separate streams, so e.g. if it's something that I can query by date as well as incrementing numerical id, I would first break my data range down into chunks, and then create multiple streams each querying just their date range.
I would then have to stitch together the multiple individual streams
