Cloudflare Developers•4y ago

what even is the use case for a delayed queue message? 🤔

what even is the use case for a delayed queue message?

UUnsmart what even is the use case for a delayed queue message? 🤔

John Spurlock•12/13/22, 11:08 PM

trigger a background job to run 10 minutes from now, but not every 10 minutes (cron)

UnsmartOP•12/13/22, 11:08 PM

I feel like alarms are more useful than a delayed queue message for that

UUnsmart I feel like alarms are more useful than a delayed queue message for that

John Spurlock•12/13/22, 11:09 PM

ok!

IItsWendell Retries are not done for e.g. consumers that throws errors right? E.g. the retri...

John Spurlock•12/13/22, 11:11 PM

Retries are not done for e.g. consumers that throws errors right?

It's my understanding that's exactly when retries are done, when the consumer throws - but probably best for someone orange to confirm

see https://developers.cloudflare.com/queues/javascript-apis/#consumer
starting with the

If the queue function throws

If the queue function throws

bit

RRob This is correct. If you throw an error inside your function that will cause a re...

UnsmartOP•12/14/22, 2:33 AM

Do you guys have a similar case as alarms where it wont count as a retry if you guys fail to deliver the message to the consumer?

UnsmartOP•12/14/22, 6:36 PM

I more meant if for any reason the message fails to be delivered to the consumer will it retry sending that message indefinitely (or until expires by time). Or if your max retries is set to 2 and it fails to deliver twice will it consider that message failed?

maguayo•12/15/22, 11:00 AM

If an exception is thrown in the consumer, the message goes back to the queue right?

Matt Silverlock•12/15/22, 12:38 PM

(Uncaught exception, that is. If the consumer handler throws)

Kai•12/15/22, 12:57 PM

Is there a way to see the queue length?

KKai Is there a way to see the queue length?

John Spurlock•12/15/22, 4:23 PM

Not yet: queues

Kai•12/15/22, 4:36 PM

unfortunate, thanks

Kai•12/15/22, 5:35 PM

Awesome to see this happening

It's not really important to me, just interesting, so happy to wait until it's implemented normally

James•12/15/22, 9:16 PM

yeah with

wrangler dev --local

wrangler dev --local

Kai•12/16/22, 1:29 AM

Note that local queues are all in memory though, no persistence support from what I can tell and it can pretty easily run OOM.

Jjohnyukon21 Is it only possible to write to and read from queues from the context of workers...

John Spurlock•12/17/22, 7:00 PM

workers only at the moment, although http endpoints are planned: https://developers.cloudflare.com/queues/javascript-apis/

In the future, we expect to support other APIs, such as HTTP endpoints to send or receive messages.

Cloudflare Queues - JavaScript APIs · Cloudflare Queues

Reliably send and receive messages without the egress fees.

Method•12/18/22, 2:41 AM

not clear to me, how is pubsub any different than queues? you send and receive messages to/from a subscriber/publisher...

UnsmartOP•12/18/22, 2:46 AM

Queues are 1 to 1 and pubsub is 1 to many

UnsmartOP•12/19/22, 9:37 PM

batching data, reducing load on databases or other apis that cant handle the raw load

zegevlier•12/20/22, 6:40 AM

And automatic retry on fail ^

Aaltryne I have a GPU process that can handle 1 task at a time. The tasks are 15s - 3 min...

Matt Silverlock•12/20/22, 1:23 PM

There is no consumer concurrency right now. You’ll get a batch up to that maximum size, and you won’t get another batch until your consumer processes (success or failure) the batch.

Matt Silverlock•12/20/22, 1:24 PM

Consumer concurrency is coming, but just “turning it on by default” would similarly break many use-cases, hence why it’s not something we’re just throwing over the fence

44x4notfound hey all, I have cloudflare workers types in my tsconfig but it can't seem to fig...

Emilio•12/20/22, 5:18 PM

Here are the type definitions https://github.com/cloudflare/workerd/blob/main/types/defines/queues.d.ts -- hopefully they make it to a release soon

GitHub

workerd/queues.d.ts at main · cloudflare/workerd

The JavaScript / Wasm runtime that powers Cloudflare Workers - workerd/queues.d.ts at main · cloudflare/workerd

Pato•12/20/22, 5:48 PM

hey!

Pato•12/20/22, 5:48 PM

I was wondering. if I need to send a daily statement to a lot of users, can queues help me with this?

PPato I was wondering. if I need to send a daily statement to a lot of users, can queu...

John Spurlock•12/20/22, 5:51 PM

absolutely, insert the work with a daily croncron - either as separate messages or one large message, then make incremental progress inside the queuequeue handler

what even is the use case for a delayed queue message? 🤔

Similar Threads