Implementing concurrency limits and batching with Effect primitives
What Effect primitives would I want to be looking at if I want to do something like this:
Make requests with a concurrency limit.
Whenever a certain number of results are amassed, batch insert them into database.
Probably wouldn't need any kind of back pressure as the requests should be the bottleneck..
Make requests with a concurrency limit.
Whenever a certain number of results are amassed, batch insert them into database.
Probably wouldn't need any kind of back pressure as the requests should be the bottleneck..
