You need to upgrade to a paid plan that has Workers Unbound. We’re working on making this more seaml

MMatt Silverlock You need to upgrade to a paid plan that has Workers Unbound. We’re working on ma...

M

https://developers.cloudflare.com/workers/platform/pricing/#default-usage-model

Documentation for Cloudflare Workers, a serverless execution environment that allows you to create entirely new applications or augment existing ones without configuring or maintaining infrastructure.

U

Unsmart•12/7/22, 3:08 AM

Ah interesting good to know

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

M

Matt SilverlockOP•12/7/22, 3:23 PM

https://developers.cloudflare.com/queues/learning/how-queues-works/#consumers

How Queues Works · Cloudflare Queues

Reliably send and receive messages without the egress fees.

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

M

Matt SilverlockOP•12/7/22, 3:23 PM

e.g.

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

[[queues.consumers]]
  queue = "SOME_QUEUE"
  max_batch_size = 100 # optional
  max_batch_timeout = 30 # optional

[[queues.consumers]]
  queue = "SOME_OTHER_QUEUE"

[[queues.consumers]]
  queue = "YET_ANOTHER_QUEUE"

DDovaluffy Is there a way to have multiple queues in a consumer ? I have been trying to add...

M

Matt SilverlockOP•12/7/22, 3:25 PM

Keep in mind that:

a) You'll have to switch on the

queue

queue

queue

queue property
b) Right now, since consumers don't have concurrency, a consumer handling multiple queues makes it more likely that you fall behind, especially if your consumer has a lot of external network I/O that can be slow or failure prone

U

Unsmart•12/7/22, 7:52 PM

As far as queues go is the send message api regional dependent on your queues region? Like if I have a queue which was created in the US will rest of the world have slower response times to sending messages.

K

Kai•12/7/22, 9:02 PM

If one worker is the consumer of multiple queues, is concurrency per queue or global?

U

Unsmart•12/7/22, 9:22 PM

My question wasnt in response to you just a standalone question about queue regions

As far as latency I see about 500ms to my queue on a cold queue start and 250ms when its warmed up.

KKai If one worker is the consumer of multiple queues, is concurrency per queue or gl...

M

Matt SilverlockOP•12/7/22, 10:09 PM

There is no concurrency right now, but everything is/will be per queue. For example, a FIFO queue would have no concurrency. Each queue is the “atom” around which config is based.

K

Kai•12/7/22, 10:11 PM

Thanks. Asked about concurrency a few days ago and was told this would probably be a Config at some point and right now it's just no concurrency / concurrency = 1.
Per queue is great, thanks for the response!

Nnucks I'm running into an issue where an environment variable I set in my worker isn't...

M

Matt SilverlockOP•12/8/22, 2:17 PM

How are you trying to access your env var?

Environment

Environment

Environment

Environment is available to a

queue

queue

queue

queue handler as an arg, and so

Environment.<YOUR_ENV_VAR>

Environment.<YOUR_ENV_VAR>

Environment.<YOUR_ENV_VAR>

Environment.<YOUR_ENV_VAR> will exist.

M

Matt SilverlockOP•12/8/22, 2:25 PM

Got it. Let me see if we can repro.

K

kian•12/8/22, 2:57 PM

fwiw if you don't want to have to declare

Environment

Environment

Environment

Environment for every handler, you can type the

export default

export default

export default

export default object literal

interface Environment {
  TOP_SECRET: string
}

interface Message {
  MY_EPIC_QUEUE_MESSAGE_INTERFACE_OR_WHATEVER: string
}

export default <ExportedHandler<Environment, Message>> {
  async fetch(req, env, ctx) {
    return new Response();
  },
  async queue(msg, env, ctx) {
    // do stuff
  }
}

interface Environment {
  TOP_SECRET: string
}

interface Message {
  MY_EPIC_QUEUE_MESSAGE_INTERFACE_OR_WHATEVER: string
}

export default <ExportedHandler<Environment, Message>> {
  async fetch(req, env, ctx) {
    return new Response();
  },
  async queue(msg, env, ctx) {
    // do stuff
  }
}

interface Environment {
  TOP_SECRET: string
}

interface Message {
  MY_EPIC_QUEUE_MESSAGE_INTERFACE_OR_WHATEVER: string
}

export default <ExportedHandler<Environment, Message>> {
  async fetch(req, env, ctx) {
    return new Response();
  },
  async queue(msg, env, ctx) {
    // do stuff
  }
}

interface Environment {
  TOP_SECRET: string
}

interface Message {
  MY_EPIC_QUEUE_MESSAGE_INTERFACE_OR_WHATEVER: string
}

export default <ExportedHandler<Environment, Message>> {
  async fetch(req, env, ctx) {
    return new Response();
  },
  async queue(msg, env, ctx) {
    // do stuff
  }
}

K

kian•12/8/22, 2:58 PM

once you go ExportedHandler you can't go back

K

kian•12/8/22, 2:58 PM

ever since @mrbbot mentioned it

Kkian fwiw if you don't want to have to declare `Environment` for every handler, you c...

I

Isaac McFadyen•12/8/22, 7:04 PM

Wah, TIL

You need to upgrade to a paid plan that has Workers Unbound. We’re working on making this more seaml

Similar Threads

Similar Threads

Similar Threads