Dynamic Rate Limit Handling in Inngest
Hey all
, I need to communicate with an API which has dynamic rate limits (max tokens per minute, AI stuff).
I'm using inngest to deal with queueing and retries but they don't seem to have a way or a pattern to dynamically reschedule/adjust the processing of a queue based on external factors like the max tokens per minutes in my case.
They do have a
I'm using inngest to deal with queueing and retries but they don't seem to have a way or a pattern to dynamically reschedule/adjust the processing of a queue based on external factors like the max tokens per minutes in my case.
They do have a
step utility for complex workflows so I'm wondering if I could use this step utility along with Effect to solve my problem?