Effect CommunityEC
Effect Communityβ€’2y agoβ€’
22 replies
jgoux

Dynamic Rate Limit Handling in Inngest

Hey all πŸ‘‹, I need to communicate with an API which has dynamic rate limits (max tokens per minute, AI stuff).
I'm using inngest to deal with queueing and retries but they don't seem to have a way or a pattern to dynamically reschedule/adjust the processing of a queue based on external factors like the max tokens per minutes in my case.
They do have a step utility for complex workflows so I'm wondering if I could use this step utility along with Effect to solve my problem?
Was this page helpful?