Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join
Lluna
View on Discord
4/26/2024

could i have some help understanding

could i have some help understanding what all of the stats mean? im a little confused.
DDanGamble
View on Discord
4/8/2024

Given you can't use a pages app and a

Given you can't use a pages app and a separate worker to consume a queue locally what is people's current workflows for handling this? I was thinking of deploying a queue and then just using that but I'm not sure how to have 1 binding be remote but the rest local
Eelithrar
View on Discord
12/18/2023

Queue processing stops locally

Stopped locally? Do you see errors? Can you open a bug report on GitHub (including the wrangler version & your code) - ?
Eelithrar
View on Discord
11/16/2023

This is something on the R2 side, but we

This is something on the R2 side, but we're also working on R2 Event Notifications - e.g. uploading to R2 via a Signed URL or the S3 API will publish an event to one of your Queues that you can consume.
Eelithrar
View on Discord
11/16/2023

Some updates for @Queues users:

Some updates for @Queues users: - We're working on landing HTTP Pull, which will allow you to poll a queue and consume it from outside of a Worker (or use a Worker in a poll-based flow vs. push-based). This will likely land just before/just after the holidays. - Queue throughput: our major milestone is about 3-5k msg/sec per queue (message size plays a role here), up from the ~400 msg/sec/queue currently - We're also working on landing controls around setting message delays - e.g. await env.MY_QUEUE.send(msg, { deliveryDelay: 600 }) on the producer side, and retry delays on the consumer side - e.g. messages.batch.retryAfter(300) or .retryAfter(seconds: number) on a per-message basis. API not final....
Eelithrar
View on Discord
11/7/2023

No: batch timeout is on the producer

No: batch timeout is on the producer side. It does not determine how the consumer scales. Your volume/message rate is very low, and (right now) we prefer to avoid scaling too quickly on the consumer side.
Ddivby0
View on Discord
10/19/2023

Of course : )

Of course : ) So basically I want to locally debug the queue producer and queue consumer. The queue producer is a cloudflare pages app, built on Remix. The queue consumer is a worker with plain typescript, no framework. I kept the worker that simple intentionally because it doesn't need database access or routing or whatever, it's basically a proxy for queue consumption (because cloudflare pages apps can't consume from a queue yet and other limitations)....
Ggideonred
View on Discord
9/29/2023

elithrar

@Matt ! Thanks for 1 and 3. For 2: we finally got a reply from our Cloudflare TAM and yes, they stated we need to add a payment method on our non-prod account. I'm working on us setting that up....
H=HT=Chief
View on Discord
9/18/2023

are there any plans to offer amqp

are there any plans to offer amqp support for remote integration with queues? I'd love to use this as an alternative to RabbitMQ.
JSJorrit Salverda
View on Discord
9/1/2023

RuntimeError: memory access out of bounds

Som of my Rust queue consumers throw exceptions very frequently before even starting the queue event handler, see https://github.com/cloudflare/workers-rs/issues/374. Or it times out without anything happening. It somehow feels like there's an issue outside of my code. Any idea what could cause this? I've tried instrumenting for a core dump, but the recordCoredump in wasm-coredump expects a request object, see https://github.com/cloudflare/wasm-coredump/issues/3.
Jjohnpyp
View on Discord
8/17/2023

I’m just trying to make sure that there

I’m just trying to make sure that there isn’t any unexpected issue or asterisk with keeping them colocated
SShirokawa
View on Discord
8/8/2023

Any updates on when Queues might come

Any updates on when Queues might come out of beta? Considering it for a production use case, but a bit hesitant, since as far as I understand it's not officially recommended for production use yet.
Ddingir
View on Discord
8/3/2023

Consumer not receiving messages

Hi all, hate to jump in with questions, but saw this channel and figured I'd give it a shot. I have a queue set up on a worker as a producer/consumer combo between multiple environments. Meaning, my wrangler.toml looks something like this: ``` [[env.development.queues.producers]] queue = "tasks-development"...
Kkewbish
View on Discord
7/28/2023

Is your Worker specifically your `queue`

Is your Worker (specifically your queue handler throwing exceptions? If your script fails and you're out of retries, the message will be dropped.
Kkewbish
View on Discord
7/27/2023

Took a quick look I can see your queue

Took a quick look - I can see your queue did at one point get up to a max concurrency of 7 (but it's out of range in the graph you screenshotted). Sometimes the dash takes a bit to update but I can see your backlog should be clear now. I'll check about the 'one worker consumes 4 different queues' bit but that shouldn't cause any issues.
Iitsmatteomanf
View on Discord
7/3/2023

He has a couple of weird issues in his

He has a couple of weird issues in his queue lul
EHElliot Hesp
View on Discord
5/30/2023

Specifying Queues per environment in wra...

https://community.cloudflare.com/t/specifying-queues-per-environment-in-wrangler-toml-file/513413 Does anyone know the answer to this? Also having the same problem
Ssathoro
View on Discord
5/4/2023

Async Processing

so our users are connected to our worker indefinitely while the article is created
Kkika
View on Discord
3/17/2023

I m on paid unbound plan so 600ms should

I'm on paid, unbound plan, so 600ms should not be my CPU limit.
No description
DDanTheGoodman
View on Discord
11/22/2022

Hey 🙂 I was curious about how consuming

Hey! 🙂 I was curious about how consuming from queues works from a per-worker perspective. I know that it's limited to 100/s right now, but for example if I have a worker set to a batch of 50, and I have 101 items in the queue, will it immediately spawn 3 workers? Or will one worker sequentially process batches of up to 50?
Next