Sorry about this: this is a cleanup for some billing stuff. As long as you are on: a) a paid Workers

Sorry about this: this is a cleanup for some billing stuff. As long as you are on: a) a paid Workers plan and b) enable Queues, it should work. We don't immediately delete your queues.

RRob Long-term we may configure; would love to hear the use case/requirement. CC @Mat...

Kai•11/30/22, 8:02 PM

It's really just an optimization for queues/cron/pubsub, not really a requirement for anything I'm doing. Hinting that there will be outbound requests & to what region would be nice to have.
For my use case, I have a small product that exposes an API and pulls data to serve from external sites. It both does this on demand and on a schedule, to keep upstream data fresh.
It has some complicated internal routing to do based on the upstream resource requested, and one of those routings is what region data is requested from, ie European data is only available from Europe each routing step is another queue and this makes a small tree of queues. To improve latency it'd be great to have Europe specific queues to be attached to European data centers.
I can give more details once I've started actually porting part of the product to cloudflare queues. The current code base is very stateful so specifics don't really translate.

maguayo•12/1/22, 9:59 AM

Is it there a way to see how many messages are in a queue? I found nothing in the UI or Cloudflare API

Mmaguayo Is it there a way to see how many messages are in a queue? I found nothing in th...

John Spurlock•12/1/22, 2:43 PM

queues

MMatt Silverlock Sorry about this: this is a cleanup for some billing stuff. As long as you are o...

dave•12/1/22, 3:59 PM

thanks! I did actually run into an error when trying to redeploy something that was bound to a queue, but enabling Queues in the web UI did the trick.

Matt SilverlockOP•12/1/22, 4:01 PM

Yeah, you must use the UI for the first time to enable - we like to be explicit about the potential for extra $$

MMatt Silverlock Yeah, you _must_ use the UI for the first time to enable - we like to be explici...

dave•12/1/22, 5:14 PM

it's my third time enabling it though lol

Ddave it's my third time enabling it though lol

Matt SilverlockOP•12/1/22, 5:51 PM

Welcome to the beta

James•12/2/22, 5:27 PM

Deployed our first Workers queue into production today. Working really well, and currently chugging through about 10k tasks.

James•12/2/22, 5:45 PM

Out of interest, although metrics aren't available in the dash yet, are they being recorded so we'll see historic data at some point?

James•12/2/22, 5:45 PM

Or is that all WIP?

James•12/2/22, 5:47 PM

And also, what's the max_wait_time_msmax_wait_time_ms I see returned in the API. Is that mapped to max_batch_timeoutmax_batch_timeout, or something different?

RRob They are being recorded. The current focus is more on real-time metrics, but exp...

James•12/2/22, 5:47 PM

Awesome, ty for the info!

RRob Under `.consumers[.settings.max_wait_time_ms]` right? That's the same.

James•12/2/22, 5:49 PM

Yeah precisely, okay cool thank you!

John Spurlock•12/5/22, 5:00 PM

Was excited to see the recent Queues graphql dataset changes (hoping for max(queueSize) to track queue length) but apart from the rename, looks like the primary change is losing sum(messages) ? Now, apart from sum(billableOperations) we only have sum(bytes), previously messageSize

aarhus•12/5/22, 6:46 PM

I am about to start using a queue to send emails - the message will contain the key to a template to be pulled from KV and all of the personalisation data needed. I am trying to work out how a queue determines a batch has failed - is it simply that the handler (for the batch) throws an error response?

zegevlier•12/5/22, 6:55 PM

Yea, that's it

Mmsutkowski is anyone able to help me resolve getting a "A Workers subscription is required ...

Unsmart•12/7/22, 1:33 AM

Do you have a workers subscription?

Unsmart•12/7/22, 1:53 AM

Hmm it seems to work fine for me. How are you trying to enable it?

Unsmart•12/7/22, 1:59 AM

I would suggest putting in a support ticket, or maybe someone on the queues team can help during business hours

Unsmart•12/7/22, 2:02 AM

Did you open it as a billing ticket? Since this would be billing issue.

Unsmart•12/7/22, 2:14 AM

Billing tickets dont get auto closed because we cant help with billing issues

Mmsutkowski I did that already, but it was auto-closed and redirected to community support e...

Matt SilverlockOP•12/7/22, 2:31 AM

You need to upgrade to a paid plan that has Workers Unbound. We’re working on making this more seamless, but if you go to a Worker service -> click Usage Model on the right hand side -> agree to Unbound pricing, Queues will be included

MMatt Silverlock You need to upgrade to a paid plan that has Workers Unbound. We’re working on ma...

Matt SilverlockOP•12/7/22, 2:32 AM

https://developers.cloudflare.com/workers/platform/pricing/#default-usage-model

Pricing · Cloudflare Workers docs

Documentation for Cloudflare Workers, a serverless execution environment that allows you to create entirely new applications or augment existing ones without configuring or maintaining infrastructure.

Unsmart•12/7/22, 3:08 AM

Ah interesting good to know

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt SilverlockOP•12/7/22, 3:23 PM

https://developers.cloudflare.com/queues/learning/how-queues-works/#consumers

How Queues Works · Cloudflare Queues

Reliably send and receive messages without the egress fees.

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt SilverlockOP•12/7/22, 3:23 PM

e.g.

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

Matt SilverlockOP•12/7/22, 3:25 PM

Keep in mind that:

a) You'll have to switch on the queuequeue property
b) Right now, since consumers don't have concurrency, a consumer handling multiple queues makes it more likely that you fall behind, especially if your consumer has a lot of external network I/O that can be slow or failure prone

Unsmart•12/7/22, 7:52 PM

As far as queues go is the send message api regional dependent on your queues region? Like if I have a queue which was created in the US will rest of the world have slower response times to sending messages.

Sorry about this: this is a cleanup for some billing stuff. As long as you are on: a) a paid Workers

Similar Threads

Similar Threads

Similar Threads