Can you rephrase? Can you show what you are trying to do?

MMatt Silverlock Can you rephrase? Can you show what you are trying to do?

Fabio•6/17/24, 12:55 PM

I have a route that calls a worker that makes the same request to a lambda. What I wanted to do was use the Queue, but I thought I could use it directly in the route, but in reality from what I understand I will have to create an 'add to queue' worker, with a route trigger that receives the request data and then adds it to the Queue, which itself will call another Worker that will make the request to the lambda.
Would that be it? Because then each request will have 2x more requests to workers

FFabio I have a route that calls a worker that makes the same request to a lambda. What...

Matt SilverlockOP•6/17/24, 1:18 PM

You need a Worker to write to a Queue, yes. But you can consume directly from a Lambda - https://developers.cloudflare.com/queues/configuration/pull-consumers/

Cloudflare Docs

Cloudflare Queues - Pull consumers · Cloudflare Queues

A pull-based consumer allows you to pull from a queue over HTTP from any environment and/or programming language outside of Cloudflare Workers. A …

Sohaib Muhammad•6/20/24, 7:40 AM

hi, need to know that is there a way to clear or flush queue so that any pending events not gets fired

SSohaib Muhammad hi, need to know that is there a way to clear or flush queue so that any pending...

Matt SilverlockOP•6/20/24, 2:38 PM

Not currently, no. You can delete the queue / recreate it.

Sohaib Muhammad•6/20/24, 3:00 PM

Thanks @elithrar , can we create/recreate programmatically, if yes than after recreation is it auto connected with the consumers and producers ?

SSohaib Muhammad Thanks @elithrar , can we create/recreate programmatically, if yes than after re...

Matt SilverlockOP•6/20/24, 3:04 PM

No, you'd need to rebind it (in both cases)

Sohaib Muhammad•6/20/24, 3:12 PM

thanks @elithrar , highly appreciated

John Spurlock•6/20/24, 5:29 PM

Ah a new error msg variant noticed today:

Error: Queue send failed: Service Temporarily Unavailable

Error: Queue send failed: Service Temporarily Unavailable

gonna assume this is client-side retryable

JJohn Spurlock Ah a new error msg variant noticed today: `Error: Queue send failed: Service Tem...

Matt SilverlockOP•6/20/24, 11:08 PM

Looks like that was during an incident (not Queues specific) today: https://www.cloudflarestatus.com/incidents/p7l6rrbhysck

Intermittent Connectivity Issue

ajgeiss0702•6/22/24, 5:40 PM

is there a reason that in the dasboard, there are 1-3 datapoints between the real data that is 0?

ajgeiss0702•6/22/24, 5:42 PM

basically i have a cron job that runs every 3 hours and adds a bunch of items to the queue, delayed to be spread over the next 3 hours. For some reason, the dashboard displays that there are 0 delayed messages between these "real" datapoints

Sohaib Muhammad•6/24/24, 7:44 AM

@ajgeiss0702 are you sending messages using send() method with delayed options OR you are using sendBatch() for sending all at once and use a global configuration for delaying

a5000•6/24/24, 2:02 PM

Hi there! Do you all have any recommendations on local dev for an api worker that takes requests, puts them in a queue, and the consumes the queue items with workers.ai. I know queues are beta and not fully supported by wrangler. Also I believe there's a limitation with local queues where they have to be in the same

wrangler

wrangler

project, so I can't run 2 node projects pointing at the same local queue.

I'm unable to spin up the project if I have a queue producer and workers ai enabled.

ajgeiss0702•6/24/24, 5:51 PM

I use send() to apply a different delay to each one (so that they’re spread out across those 3 hours)

Alec | Kriebel LLC.•6/25/24, 3:55 AM

I recently got an error when calling a sendBatch:

Queue sendBatch failed: Internal Server Error

Queue sendBatch failed: Internal Server Error

Does anyone have any details on what this error is or when it happens?

AAlec | Kriebel LLC.I recently got an error when calling a sendBatch: `Queue sendBatch failed: Inter...

Matt SilverlockOP•6/25/24, 1:21 PM

This is a Cloudflare internal error (e.g. no specifics to share). You can typically retry - are you seeing that repeat?

MMatt Silverlock This is a Cloudflare internal error (e.g. no specifics to share). You can typica...

Alec | Kriebel LLC.•6/25/24, 3:02 PM

No, it was a one time occurrence from what I can see in my logs. Wondering if there's anything us developers can do to minimize the chances of this happening

MMatt Silverlock This is a Cloudflare internal error (e.g. no specifics to share). You can typica...

SteffTek•6/25/24, 4:03 PM

tbh this can be a neck breaker for my application... well i think i have to teach the users to respam their request lol

SSteffTek tbh this can be a neck breaker for my application... well i think i have to teac...

Matt SilverlockOP•6/25/24, 4:06 PM

You can (should) retry in your producer Worker. There’s no case where 100% of requests succeed. Assume 99.9% success - if you have 1M queue sends, and .1% fail, that’s still up to 1k failures to potentially retry.

Matt SilverlockOP•6/25/24, 4:06 PM

You can retry in your code when you use a try-catch - no need to expose those failures directly to users.

MMatt Silverlock You can (should) retry in your producer Worker. There’s no case where 100% of re...

SteffTek•6/25/24, 4:08 PM

my api does allow rescheduling, i might thry the try catch, thx! i never had this problem until now. I had another one where my DLQ wouln't resend, because i forgor await

SSteffTek my api does allow rescheduling, i might thry the try catch, thx! i never had thi...

Matt SilverlockOP•6/25/24, 4:12 PM

Note that this isn’t specific to us - any API can fail intermittently at scale. Catching and retrying (before eventually failing) is a common strategy.

SteffTek•6/25/24, 4:12 PM

yeah, i know that ^^

Arthur🍃•6/25/24, 7:31 PM

Hi, I've had a worker for at least 8 months and it was working fine, but today I'm getting this error, does anyone know if there was any change in the queue?

AArthur🍃Hi, I've had a worker for at least 8 months and it was working fine, but today I...

Matt SilverlockOP•6/25/24, 8:05 PM

No changes to Queues APIs - are you seeing more than once occurrence of this?

MMatt Silverlock No changes to Queues APIs - are you seeing more than once occurrence of this?

Arthur🍃•6/25/24, 8:17 PM

Hello, yes, my queue simply stopped working, all requests were failing and throwing this error, my alternative was to create a new queue and connect it to my worker, after doing this the worker started working correctly again without throwing any more errors.

Note, I didn't make any changes to the code, I simply moved to a new queue and things started working again

AArthur🍃Hello, yes, my queue simply stopped working, all requests were failing and throw...

Matt SilverlockOP•6/25/24, 8:17 PM

Can you share your accountId and the (previous) queueId? Both are safe to share publicly.

Arthur🍃•6/25/24, 8:19 PM

This queue is very strange, I can't even look at the messages inside it

Arthur🍃•6/25/24, 8:19 PM

Arthur🍃•6/25/24, 8:20 PM

My account: c120f6c2efb6750841790c9355c6abe9

Arthur🍃•6/25/24, 8:20 PM

My queueId: 8ca18fdd38904e3b8ad439df6c197cad

Arthur🍃•6/25/24, 8:20 PM

I'm not sure if my accountId is 100% correct, I got it from the url

AArthur🍃I'm not sure if my accountId is 100% correct, I got it from the url

Pranshu Maheshwari•6/25/24, 8:53 PM

Stepping in for Matt here, thanks! We're looking into this.

Pranshu Maheshwari•6/25/24, 9:30 PM

Hi @everyone! Pranshu here. I’m a product manager at Cloudflare and I’ve recently taken on Queues. I’d love to learn more about how all of you are using Queues, and how you'd like to see it improve.

I’d especially love to hear from folks building startups. I’ve been a 2x founder myself, so I’ve been in your shoes!

If you’d like to grab some time to chat in the next two weeks, here’s my calendar: https://calendar.app.google/pdzfMFmwACg2PN8w8

Appointments

zegevlier•6/25/24, 9:34 PM

Sorry everyone for the ping!

Erisa•6/25/24, 10:01 PM

Let's please keep messages on-topic - mistakes happen, everyone is sorry about it - lets move on. If you want to comment about things not related to queues, try #off-topic

PPranshu Maheshwari Hi @everyone! Pranshu here. I’m a product manager at Cloudflare and I’ve recentl...

quisi.do•6/25/24, 10:11 PM

I'm working on a startup, and I'm unable to use queues for proof-of-concepts without first upgrading to a paid plan. I'm currently working free tier for PoCs and don't want to invest financially into a solution service until revenue is generated. Any chance of getting a free tier for queues?

Avat•6/25/24, 10:14 PM

Hello, I'm looking for advice how to handle canceled request.
So, I'm using an API which sends array of objects to my worker, which then iterates through this array and sends every object to queue.

The problem is, this API closes the connection almost immediately and the worker gets canceled.

How can I keep worker up until whole object is being sent as messages to queue?

Salamus•6/25/24, 10:20 PM

PPranshu Maheshwari Hi @everyone! Pranshu here. I’m a product manager at Cloudflare and I’ve recentl...

TheMightyPenguin•6/25/24, 10:34 PM

Queues not working on remote dev is a friction point for me! I mostly do all of my local dev without using wrangler dev remote, but as I’m working on an app that uses browser rendering, I have had to switch to remote as browser rendering does not work locally.

I could also phrase this problem as browser rendering not working locally tho, is that coming at some point? Everything else feels frictionless locally

Qquisi.do I'm working on a startup, and I'm unable to use queues for proof-of-concepts wit...

Pranshu Maheshwari•6/25/24, 10:34 PM

there is a free tier (up to 1mm operations / month), but yes, you do need to be on the workers paid plan to use it

Qquisi.do I'm working on a startup, and I'm unable to use queues for proof-of-concepts wit...

grandell•6/25/24, 10:35 PM

If you can afford $5 than you should upgrade. I work a lot of services and if you use it properly you can very easily make your money's worth.

Ggrandell If you can afford $5 than you should upgrade. I work a lot of services and if yo...

quisi.do•6/25/24, 11:07 PM

I have no doubt that I will benefit from it after having services; but right now, it is impossible to build PoCs for services with queues. My goal is to build a service on free tier, establish market, then upgrade to increase my limits to account for the new traffic. But without queues in my free tier service, I am unable to launch a new service that harnesses queues.

Qquisi.do I have no doubt that I will benefit from it after having services; but right now...

caleb•6/25/24, 11:51 PM

Welcome to running a business. Sometimes you need to spend before you have revenue.

Paul•6/26/24, 12:46 AM

When writing multiple queue consumers, they always need to be defined in the root default export right? So if we have multiple queues in one worker, the only way to define multiple consumers is to have a switch statement or equivalent in the root queue-key export and route the message to the right consumer right? One would assume I would need to have a "name" or equivalent key in the message body as a result, in order to route the message to the correct consumer right?

Can you rephrase? Can you show what you are trying to do?

Similar Threads