Cloudflare Developers•4y ago

I know metics is still WIP, but is there an API or something to see how many messages are left in qu

I know metics is still WIP, but is there an API or something to see how many messages are left in queue?

Mmaguayo I know metics is still WIP, but is there an API or something to see how many mes...

Matt Silverlock•12/26/22, 2:03 PM

Not yet. Soon. The underlying API is where the brunt of the work is

Bbx2 hi all, i read in the docs that there is no way to produce (completely different...

Matt Silverlock•12/27/22, 5:34 PM

Where in the docs did you read this? You can bind a Worker to multiple queues and thus write to multiple queues from the same Worker.

MMatt Silverlock Where in the docs did you read this? You can bind a Worker to multiple queues an...

Matt Silverlock•12/27/22, 5:35 PM

Create multiple bindings, call YOUR_BINDING.send()YOUR_BINDING.send() or SOME_OTHER_BINDING.sendBatch()SOME_OTHER_BINDING.sendBatch() as needed - https://developers.cloudflare.com/queues/configuration/#producer

Cloudflare Queues - Configuration · Cloudflare Queues

Reliably send and receive messages without the egress fees.

Unsmart•12/29/22, 1:06 PM

You can technically push more than 100/s sometimes or at least I've been able to so you could have more messages

Aanu From this page: https://developers.cloudflare.com/queues/limits/ I cannot find...

Matt Silverlock•12/29/22, 6:52 PM

There is no numerical limit. We don’t cap based on “number”. We cap based on oldest message — at some point you may not be able to consume as fast as you produce.

Matt Silverlock•12/29/22, 6:52 PM

(We don’t publish a “max messages per queue” as it isn’t a limit that exists)

Jacob•12/30/22, 2:19 PM

Ah cool, Queues shows stats now!

James•12/30/22, 5:00 PM

Oh very cool!

Unsmart•12/30/22, 10:45 PM

#pubsub-beta would be more of a message broker I assume depending on what exactly you mean by that.

Queues are basically just used to process things in batches. Can be used to give faster client responses if you need to call some other service that is slow. You can have retries.

There's no message fanout with queues there can only be a single consumer so it's not really a one stop shop for all event driven stuff but you can send the queue an event and have a consumer handle it so

Matt Silverlock•12/30/22, 11:37 PM

Queues (as it exists today) is ideal for fan-in, as an (async) job queue, for task batching & buffering.

If you need many to many or fan-out, consider Pub/Sub and/or combining Queue + Durable Objects + WebSockets. Which of those two depends on specifics about your workload.

DDan Ferguson I'm having a lot of difficulty with Queues - I'm not getting any error logs when...

aarhus•1/2/23, 10:42 AM

wrap the whole queue handler in a try/catch and log the exception?

Ssuresh.bala I am trying to use Service Bindings in the Queue handlers, but unable to do so. ...

Matt Silverlock•1/2/23, 3:11 PM

Can you share your code & binding config? What does “unable to do so” mean?

kian•1/3/23, 5:47 AM

Fetch just wants a URL or a Request - you can always make a Request object with the constructor

kian•1/3/23, 6:22 AM

Can be anything you want really

kian•1/3/23, 6:22 AM

Just has to be a valid URL

mukhtharcm•1/3/23, 1:23 PM

Sorry for the noob question.
Can somebody please explain what are these queues thing?
I mean what is the use case of this service?

kian•1/3/23, 1:25 PM

Reliable (retries) messaging between apps, batching, stuff like that

Mmukhtharcm Sorry for the noob question. Can somebody please explain what are these queues t...

Matt Silverlock•1/3/23, 2:46 PM

Take a look at https://developers.cloudflare.com/queues + https://blog.cloudflare.com/cloudflare-queues-open-beta/

Cloudflare Queues · Cloudflare Queues

Reliably send and receive messages without the egress fees.

The Cloudflare Blog

Build applications of any size on Cloudflare with the Queues open beta

Cloudflare Queues enables developers to build performant and resilient distributed applications that span the globe. Any developer with a paid Workers plan can enroll in the Open Beta and start building today!

mukhtharcm•1/3/23, 5:02 PM

Thank you guys!

Original message was deleted

Matt Silverlock•1/5/23, 6:42 PM

Will get it fixed - thanks

JJohand Legend! Didn’t see the message before now 😊 thanks for confirming

Emilio•1/5/23, 8:54 PM

Following up on this. The bug was actually fixed ages ago in October, but the miniflare version included in wrangler only just got updated. https://github.com/cloudflare/wrangler2/pull/2502

The next version of wrangler (>= 2.6.3) will include this, so look forward to that

GitHub

chore: upgrade `miniflare` to `2.11.0` by mrbbot · Pull Request #25...

What this PR solves / how to test:
This PR upgrades miniflare to version 2.11.0. Looks like I forgot to bump this in Wrangler, ooops. See the changelog here.
Associated docs issues/PR:
N/A
Author h...

John Spurlock•1/9/23, 2:56 PM

queues backlog and retry/lag times available now in graphql!!

thanks!

John Spurlock•1/9/23, 3:04 PM

Interesting note:

# Beta. Queue backlog data with adaptive sampling. Queues that are not being written to, or read from, will not return data, even if they have a backlog.

# Beta. Queue backlog data with adaptive sampling. Queues that are not being written to, or read from, will not return data, even if they have a backlog.

JJohn Spurlock queues backlog and retry/lag times available now in graphql!! 👀 thanks!

Emilio•1/9/23, 4:55 PM

Community Champions always on the ball, finding new features before we even announce them

JJohn Spurlock Interesting note: `# Beta. Queue backlog data with adaptive sampling. Queues tha...

Emilio•1/9/23, 4:58 PM

When your Queue is inactive we don't have any way (currently) to look at your backlog and log information about it

EEmilio Community Champions always on the ball, finding new features before we even anno...

John Spurlock•1/9/23, 5:10 PM

As much as I enjoy a good hate on graphql now and then, its standard way of schema introspection is pretty great

John Spurlock•1/9/23, 5:13 PM

queue

queue

handlers have exactly the same limits (cpu time etc) as a

fetch

fetch

handler would have in the same worker? More time for unbound vs bunded - or do they behave differently like DO

JJohn Spurlock Do `queue` handlers have exactly the same limits (cpu time etc) as a `fetch` han...

Matt Silverlock•1/9/23, 5:26 PM

Same limits

Rrelero90 Noob question: Can I have a consumer also act as a producer? Trying to have a co...

Matt Silverlock•1/9/23, 8:53 PM

Have you configured the bindings for the script that also acts as your consumer? Are you calling env.YOUR_BINDING_NAME.send()env.YOUR_BINDING_NAME.send() (and passing in

env

env

as an arg?). Posting your code would help to confirm

Rrelero90 Here you go

Matt Silverlock•1/9/23, 9:38 PM

Code looks good. Let me investigate / repro.

Rrelero90 Here you go

Matt Silverlock•1/9/23, 10:14 PM

Can you Object.keys(env)Object.keys(env) and paste the output? DM me if you prefer.

Ssamcfinan Hi all -- what's the difference between Queues and Pub/Sub? I might be confusing...

Matt Silverlock•1/11/23, 2:18 PM

Queues is ideal for reliable messaging — typically between services — think of it as a job queue, a buffer, or a lightweight RPC API. Great for many to one or one to one use-cases. Native Workers support is built in.

Pub/Sub is focused much more on the broadcast use-case — common in IoT or with real-time apps — and especially for scenarios where you need MQTT as a protocol.

I know metics is still WIP, but is there an API or something to see how many messages are left in qu

Similar Threads

Similar Threads

Similar Threads