Queues Throttling
Hi, I am new to serverless, so I am not familiar with design patterns (I'd love to hear where can I learn more of this). I am wondering what's the best way to throttle API calls.
Let's say I am using thirdparty API endpoints, one which lists all of the objects and the other query an object. My goal is to list all of them, push them into a queue, then have a consumer slowly querying each object, without finishing them as fast as possible in one goal.
Is using "delay messages" the way to go? Assigning different delays while pushing them to the queue to achieve throttling?
delay messages: https://developers.cloudflare.com/queues/configuration/batching-retries/#delay-messages
I am using rust if that's relevant.
Let's say I am using thirdparty API endpoints, one which lists all of the objects and the other query an object. My goal is to list all of them, push them into a queue, then have a consumer slowly querying each object, without finishing them as fast as possible in one goal.
Is using "delay messages" the way to go? Assigning different delays while pushing them to the queue to achieve throttling?
delay messages: https://developers.cloudflare.com/queues/configuration/batching-retries/#delay-messages
I am using rust if that's relevant.
Cloudflare Docs
When configuring a consumer Worker for a queue, you can also define how messages are batched as they are delivered.
Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news
85,042Members
Resources
Similar Threads
Was this page helpful?
