Cloudflare Developers•4y ago

There is no colo nearest the dashboard it's edge. They would both do exactly the same thing.

UnsmartOP•12/23/22, 4:42 AM

That's about what I get

UnsmartOP•12/23/22, 4:43 AM

And don't think it's possible to know the colo your queue is in

GGary Somerhalder Interesting idea

aarhus•12/23/22, 11:56 AM

Or KV - but you would need to handle the eventual consistency (shouldn't be an issue if you create a unique ID for each object, but your consumer needs to handle it not being present)

UUnsmart There is no colo nearest the dashboard it's edge. They would both do exactly the...

Hello, I’m Allie!•12/23/22, 1:26 PM

Though sometimes, like for D1, if you do it from the dash, it is routed through the API, which I believe runs in IAD.

RRob > is that normal for now, yes. look for significant improvements here as the bet...

John Spurlock•12/23/22, 4:00 PM

Rob, it's an interesting question about the colo - is it safe to say the queue "resides" in the colo that the queuequeue handler runs in? Ok only mildly interesting for minimizing latency from publishers I guess. Ok only interesting to plot out a Dr Strangelove style map of the architecture...

JJohn Spurlock Rob, it's an interesting question about the colo - is it safe to say the queue "...

Emilio•12/23/22, 5:47 PM

A queue resides in a particular colo, yes. This is also something you can expect us to refine as we get closer to GA. Not saying it's going to change, but it's definitely something we are thinking about.

EEmilio A queue resides in a particular colo, yes. This is also something you can expect...

John Spurlock•12/23/22, 5:58 PM

is it the same colo as where the queuequeue handler runs?

John Spurlock•12/23/22, 6:15 PM

I need to draw my global architecture map tho

John Spurlock•12/23/22, 6:20 PM

Hehe maybe if I could choose where to place any of the other CF pieces that would be relevant, but happy to not have to think about it (long-term) so not a big deal

John Spurlock•12/23/22, 6:21 PM

Number 1 serious thing I'm eagerly awaiting is pull-based consumers

Kai•12/24/22, 10:35 AM

Location hints like with DOs would be amazing!

maguayo•12/25/22, 11:11 PM

I know metics is still WIP, but is there an API or something to see how many messages are left in queue?

Mmaguayo I know metics is still WIP, but is there an API or something to see how many mes...

Matt Silverlock•12/26/22, 2:03 PM

Not yet. Soon. The underlying API is where the brunt of the work is

Bbx2 hi all, i read in the docs that there is no way to produce (completely different...

Matt Silverlock•12/27/22, 5:34 PM

Where in the docs did you read this? You can bind a Worker to multiple queues and thus write to multiple queues from the same Worker.

MMatt Silverlock Where in the docs did you read this? You can bind a Worker to multiple queues an...

Matt Silverlock•12/27/22, 5:35 PM

Create multiple bindings, call YOUR_BINDING.send()YOUR_BINDING.send() or SOME_OTHER_BINDING.sendBatch()SOME_OTHER_BINDING.sendBatch() as needed - https://developers.cloudflare.com/queues/configuration/#producer

Cloudflare Queues - Configuration · Cloudflare Queues

Reliably send and receive messages without the egress fees.

UnsmartOP•12/29/22, 1:06 PM

You can technically push more than 100/s sometimes or at least I've been able to so you could have more messages

Aanu From this page: https://developers.cloudflare.com/queues/limits/ I cannot find...

Matt Silverlock•12/29/22, 6:52 PM

There is no numerical limit. We don’t cap based on “number”. We cap based on oldest message — at some point you may not be able to consume as fast as you produce.

Matt Silverlock•12/29/22, 6:52 PM

(We don’t publish a “max messages per queue” as it isn’t a limit that exists)

Jacob•12/30/22, 2:19 PM

Ah cool, Queues shows stats now!

James•12/30/22, 5:00 PM

Oh very cool!

UnsmartOP•12/30/22, 10:45 PM

#pubsub-beta would be more of a message broker I assume depending on what exactly you mean by that.

Queues are basically just used to process things in batches. Can be used to give faster client responses if you need to call some other service that is slow. You can have retries.

There's no message fanout with queues there can only be a single consumer so it's not really a one stop shop for all event driven stuff but you can send the queue an event and have a consumer handle it so

Matt Silverlock•12/30/22, 11:37 PM

Queues (as it exists today) is ideal for fan-in, as an (async) job queue, for task batching & buffering.

If you need many to many or fan-out, consider Pub/Sub and/or combining Queue + Durable Objects + WebSockets. Which of those two depends on specifics about your workload.

DDan Ferguson I'm having a lot of difficulty with Queues - I'm not getting any error logs when...

aarhus•1/2/23, 10:42 AM

wrap the whole queue handler in a try/catch and log the exception?

Ssuresh.bala I am trying to use Service Bindings in the Queue handlers, but unable to do so. ...

Matt Silverlock•1/2/23, 3:11 PM

Can you share your code & binding config? What does “unable to do so” mean?

kian•1/3/23, 5:47 AM

Fetch just wants a URL or a Request - you can always make a Request object with the constructor

kian•1/3/23, 6:22 AM

Can be anything you want really

kian•1/3/23, 6:22 AM

Just has to be a valid URL

mukhtharcm•1/3/23, 1:23 PM

Sorry for the noob question.
Can somebody please explain what are these queues thing?
I mean what is the use case of this service?

kian•1/3/23, 1:25 PM

Reliable (retries) messaging between apps, batching, stuff like that

Mmukhtharcm Sorry for the noob question. Can somebody please explain what are these queues t...

Matt Silverlock•1/3/23, 2:46 PM

Take a look at https://developers.cloudflare.com/queues + https://blog.cloudflare.com/cloudflare-queues-open-beta/

Cloudflare Queues · Cloudflare Queues

Reliably send and receive messages without the egress fees.

The Cloudflare Blog

Build applications of any size on Cloudflare with the Queues open beta

Cloudflare Queues enables developers to build performant and resilient distributed applications that span the globe. Any developer with a paid Workers plan can enroll in the Open Beta and start building today!

There is no colo nearest the dashboard it's edge. They would both do exactly the same thing.

Similar Threads

Similar Threads

Similar Threads