hey is there a way to do per-user queues
hey is there a way to do per-user queues when triggering Workflows? Either natively within the Workflows or by using Queues to trigger workflows? I would like to be able to have per-user queues when triggering workflows via API but also when creating workflows from within another workflow
2 Replies
You could probably have per-user queues, but unless you have pull consumers, you can't dynamically bind a consumer to new queues (you have to configure your wrangler file). Also there is a limit of 10k queues per account.
Maybe you could have one queue that sends user specific details to some DO. This DO would orchestrate things per-user (and trigger a workflow per-user). I am not sure if this is what you're looking for. Let me know if I can help further.
My use case is quite similar. Single queue allows a maximum of 5,000 ingestions per second, but my traffic could exceed 20,000 per second. I considered using queues through the HTTP API, but I’m concerned about the global rate limits on event ingestion into the queues.
So, I ended up creating four queues, binding them to the worker, and distributing the load randomly among them. Is there any better way to achieve this?