Cloudflare Developers•4y ago

it's my third time enabling it though lol

Ddave it's my third time enabling it though lol

Matt Silverlock•12/1/22, 5:51 PM

Welcome to the beta

James•12/2/22, 5:27 PM

Deployed our first Workers queue into production today. Working really well, and currently chugging through about 10k tasks.

James•12/2/22, 5:45 PM

Out of interest, although metrics aren't available in the dash yet, are they being recorded so we'll see historic data at some point?

James•12/2/22, 5:45 PM

Or is that all WIP?

James•12/2/22, 5:47 PM

And also, what's the max_wait_time_msmax_wait_time_ms I see returned in the API. Is that mapped to max_batch_timeoutmax_batch_timeout, or something different?

RRob They are being recorded. The current focus is more on real-time metrics, but exp...

James•12/2/22, 5:47 PM

Awesome, ty for the info!

RRob Under `.consumers[.settings.max_wait_time_ms]` right? That's the same.

James•12/2/22, 5:49 PM

Yeah precisely, okay cool thank you!

John Spurlock•12/5/22, 5:00 PM

Was excited to see the recent Queues graphql dataset changes (hoping for max(queueSize) to track queue length) but apart from the rename, looks like the primary change is losing sum(messages) ? Now, apart from sum(billableOperations) we only have sum(bytes), previously messageSize

aarhus•12/5/22, 6:46 PM

I am about to start using a queue to send emails - the message will contain the key to a template to be pulled from KV and all of the personalisation data needed. I am trying to work out how a queue determines a batch has failed - is it simply that the handler (for the batch) throws an error response?

zegevlier•12/5/22, 6:55 PM

Yea, that's it

Mmsutkowski is anyone able to help me resolve getting a "A Workers subscription is required ...

Unsmart•12/7/22, 1:33 AM

Do you have a workers subscription?

Unsmart•12/7/22, 1:53 AM

Hmm it seems to work fine for me. How are you trying to enable it?

Unsmart•12/7/22, 1:59 AM

I would suggest putting in a support ticket, or maybe someone on the queues team can help during business hours

Unsmart•12/7/22, 2:02 AM

Did you open it as a billing ticket? Since this would be billing issue.

Unsmart•12/7/22, 2:14 AM

Billing tickets dont get auto closed because we cant help with billing issues

Mmsutkowski I did that already, but it was auto-closed and redirected to community support e...

Matt Silverlock•12/7/22, 2:31 AM

You need to upgrade to a paid plan that has Workers Unbound. We’re working on making this more seamless, but if you go to a Worker service -> click Usage Model on the right hand side -> agree to Unbound pricing, Queues will be included

MMatt Silverlock You need to upgrade to a paid plan that has Workers Unbound. We’re working on ma...

Matt Silverlock•12/7/22, 2:32 AM

https://developers.cloudflare.com/workers/platform/pricing/#default-usage-model

Pricing · Cloudflare Workers docs

Documentation for Cloudflare Workers, a serverless execution environment that allows you to create entirely new applications or augment existing ones without configuring or maintaining infrastructure.

Unsmart•12/7/22, 3:08 AM

Ah interesting good to know

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt Silverlock•12/7/22, 3:23 PM

https://developers.cloudflare.com/queues/learning/how-queues-works/#consumers

How Queues Works · Cloudflare Queues

Reliably send and receive messages without the egress fees.

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt Silverlock•12/7/22, 3:23 PM

e.g.

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt Silverlock•12/7/22, 3:25 PM

Keep in mind that:

a) You'll have to switch on the queuequeue property
b) Right now, since consumers don't have concurrency, a consumer handling multiple queues makes it more likely that you fall behind, especially if your consumer has a lot of external network I/O that can be slow or failure prone

Unsmart•12/7/22, 7:52 PM

As far as queues go is the send message api regional dependent on your queues region? Like if I have a queue which was created in the US will rest of the world have slower response times to sending messages.

Kai•12/7/22, 9:02 PM

If one worker is the consumer of multiple queues, is concurrency per queue or global?

Unsmart•12/7/22, 9:22 PM

My question wasnt in response to you just a standalone question about queue regions

As far as latency I see about 500ms to my queue on a cold queue start and 250ms when its warmed up.

KKai If one worker is the consumer of multiple queues, is concurrency per queue or gl...

Matt Silverlock•12/7/22, 10:09 PM

There is no concurrency right now, but everything is/will be per queue. For example, a FIFO queue would have no concurrency. Each queue is the “atom” around which config is based.

Kai•12/7/22, 10:11 PM

Thanks. Asked about concurrency a few days ago and was told this would probably be a Config at some point and right now it's just no concurrency / concurrency = 1.
Per queue is great, thanks for the response!

it's my third time enabling it though lol

Similar Threads

Similar Threads

Similar Threads