Cloudflare Developers•2y ago

Why do queues bind via their names rather than their ids :NotLikeThis:

PPraefe Why do queues bind via their names rather than their ids :NotLikeThis:

luna•4/27/24, 5:26 AM

https://tenor.com/view/damn-these-good-ass-questions-good-questions-k-camp-good-ass-questions-questions-gif-12501849

Tenor

Lluna could i have some help understanding what all of the stats mean? im a little con...

luna•4/28/24, 10:31 AM

any chance i could get some help with this?

Baya•4/29/24, 12:23 AM

Is there a way to clear a backlog from queues? I have huge consumer delay (6000 seconds).

oof2win2•4/29/24, 6:11 PM

can i send messages to a queue without having it bound to a worker? like a http api for the queue? and additionally an option to send the same message to multiple queues

Ooof2win2 can i send messages to a queue without having it bound to a worker? like a http ...

John Spurlock•4/29/24, 11:55 PM

there is no http api for sending messages other than using a worker: https://developers.cloudflare.com/queues/examples/publish-to-a-queue-over-http/

you could write a worker with multiple named queue bindings that sent the same input message to n queues using Promise.allSettledPromise.allSettled inside the worker, for example

oof2win2•4/30/24, 6:43 AM

i wanted to have a queue assigned on a per-user basis

oof2win2•4/30/24, 6:43 AM

but fair enough i guess, thanks

timmm•5/3/24, 2:21 AM

Is local dev possible with the producer in worker one and the consumer in worker two?

timmm•5/3/24, 2:21 AM

I'm using next-on-pages for worker one to produce the message and I'm not receiving it on worker two

timmm•5/3/24, 2:22 AM

Admittidely, this is the first time I've tried starting up two workers so maybe I'm not doing it right. But my understanding is you can start them both up and bindings should work

timmm•5/3/24, 2:29 AM

On nevermind! I see you can't have queues across workers atm in local dev

PraefeOP•5/3/24, 5:37 AM

When wrangler deploywrangler deploying multiple times quickly with queue config changes, the queue consumer config (and producer) page would crash with internal issues, and if I reaccessed it, the data hadn't been updated.

So the first time, it worked fine, but then the next times, while the command ran successfully, the web UI didn't reflect the config changes.

PraefeOP•5/3/24, 5:38 AM

Lead to my coworker thinking that the retry_delay option didn't work in wrangler.toml, but in reality, it wasn't being reflected in UI

Ashley•5/3/24, 11:09 AM

Q: the DLQ, if it has an active consumer, how long do the messages stay in the DLQ? Indefinitely? Until they fail a certain amount of time? A set time frame? (Docs doesn't seem to specify)

Tthecj247 Are there any issues with ACK via Python Request? Can pull messages just fine, i...

Matt Silverlock•5/5/24, 4:56 AM

@Rob could you have Todd & team look into this? The error message on a HTTP 500 should at least be clearer. The payload looks fine though? https://developers.cloudflare.com/queues/configuration/pull-consumers/#4-acknowledge-messages

Cloudflare Docs

Cloudflare Queues - Pull consumers · Cloudflare Queues

A pull-based consumer allows you to pull from a queue over HTTP from any environment and/or programming language outside of Cloudflare Workers. A …

John Spurlock•5/5/24, 4:53 PM

Shout out to the team: it's been over a week now since I've seen a single ConflictConflict or Internal Server ErrorInternal Server Error prevent a .send.send call (over 9 million sends in that time)

hob8yte•5/6/24, 2:59 PM

I'm seeing messages just sit and hang in a queue despite having concurrency enabled and a consumer worker attached. What steps can I take to debug this?

oof2win2•5/7/24, 8:30 PM

can i get local queues (only with wrangler) working without a paid cloudflare account? i want to use them for some local testing and dont want everyone on the team to require a paid cloudflare account

Ooof2win2 can i get local queues (only with wrangler) working without a paid cloudflare ac...

Hello, I’m Allie!•5/7/24, 8:34 PM

It should work fine out of the box

oof2win2•5/7/24, 8:34 PM

how do i enable r2 notifications on it though

oof2win2•5/7/24, 8:34 PM

is that supported on local dev?

Ooof2win2 how do i enable r2 notifications on it though

Hello, I’m Allie!•5/7/24, 8:34 PM

No. Only the Worker Bindings for R2 are available

oof2win2•5/7/24, 8:34 PM

since its not something defined in wrangler

Hello, I’m Allie!•5/7/24, 8:35 PM

No S3-API, and no notifications

oof2win2•5/7/24, 8:35 PM

alright, thanks

Hello, I’m Allie!•5/8/24, 8:44 AM

Anyone know if there is a way to inspect a Queue? I have a Cron that pushes 4 messages to a Queue, and while the first 3(that are processed pretty fast) complete succesfully, the last event(which is considerably heavier), never fires. Is there a way to see why that might be?

Hello, I’m Allie!•5/8/24, 8:44 AM

This is in local

Hello, I’m Allie!•5/8/24, 9:29 AM

It appears to be occurring when the QUEUE.sendQUEUE.send occurs after the event returns(even though it is within a waitUntilwaitUntil...

Gerbuuun•5/8/24, 8:32 PM

Hi,
I've quickly implemented a queue in front of a (prod) worker that takes some time to finish. It was previously called via a webhook (which I do not control) but the caller times out before the worker can finish. The webhook does retry which duplicates data flow. Do you guys recommend a different approach (also because queues is still in beta)?

GGerbuuun Hi, I've quickly implemented a queue in front of a (prod) worker that takes some...

Hello, I’m Allie!•5/8/24, 8:35 PM

You can also use waitUntilwaitUntil to process the Webhook, then return a Response back basically instantly

Gerbuuun•5/8/24, 8:41 PM

I'm doing some browser rendering stuff. With waitUntilwaitUntil it basically returns a response first and then starts the rendering?

Conner•5/8/24, 8:42 PM

"Attempts" on queues is a bit confusing

Conner•5/8/24, 8:43 PM

Anyone know if it starts at 0 or 1 for first execution?

Conner•5/8/24, 8:43 PM

So if my my max_retries is 3, will attempts be 0,1,2, or 1,2,3?

Conner•5/8/24, 8:44 PM

Would be nice if this were explicit in docs too, @HardlyWorkin'

GGerbuuun I'm doing some browser rendering stuff. With `waitUntil` it basically returns a ...

Hello, I’m Allie!•5/8/24, 8:52 PM

Sort of. You do something like this:

ctx.waitUntil(someWorkFunction(data));
return new Response();

ctx.waitUntil(someWorkFunction(data));
return new Response();

CConner Would be nice if this were explicit in docs too, @HardlyWorkin'

Hello, I’m Allie!•5/8/24, 8:53 PM

It starts at 1

HHello, I’m Allie!Sort of. You do something like this: ```ts ctx.waitUntil(someWorkFunction(data))...

Gerbuuun•5/8/24, 9:42 PM

Thanks for the tip!

Rabid•5/9/24, 4:50 PM

As soon as I add bindings for a queue producer, my scheduled cron stops working:

[[queues.producers]]
 queue = "wow-cataclysm-auctions-queue"
 binding = "QUEUE"

[[queues.producers]]
 queue = "wow-cataclysm-auctions-queue"
 binding = "QUEUE"

Rabid•5/9/24, 4:50 PM

If I remove that from my wrangler.toml, my schedule cron worker works again

Rabid•5/9/24, 4:56 PM

My producer code right now is literally just

export default {
  async scheduled(controller, env, ctx) {
    console.log('test')

  }
}

export default {
  async scheduled(controller, env, ctx) {
    console.log('test')

  }
}

Rabid•5/9/24, 4:57 PM

And the console.log doesn't fire if that queue binding exists

Rabid•5/9/24, 5:05 PM

In fact it has nothing to do with schedule, even just following the default instructions here: https://developers.cloudflare.com/queues/get-started/ results in a hello world fetch handler returning 500

Cloudflare Docs

Get started · Cloudflare Queues

Cloudflare Queues is a flexible messaging queue that allows you to queue messages for asynchronous processing. By following this guide, you will …

Rabid•5/9/24, 5:05 PM

If you remove the binding, the fetch handler works again

kian•5/9/24, 5:07 PM

Deployed, or with

wrangler dev

wrangler dev

Why do queues bind via their names rather than their ids :NotLikeThis:

Similar Threads

Similar Threads

Similar Threads