It's just saying that it doesn't detect a `queue` function in your default export

Kkian It's just saying that it doesn't detect a `queue` function in your default expor...

R

Ryan K•12/5/23, 12:13 AM

I assumed that could be the case but I do indeed have a default export:

export default {
  fetch(request: Request, env: Env, ctx: ExecutionContext) {
    // Set env variables
    Object.keys(env).forEach((variable) => {
      process.env[variable] ??= `${env[variable]}`;
    })

    return fetch(request, env, ctx)
  },
  async queue(batch: MessageBatch<any>, env: Env): Promise<void> {
    let messages = JSON.stringify(batch.messages);
    console.log(`consumed from our queue: ${messages}`);
  },
}

export default {
  fetch(request: Request, env: Env, ctx: ExecutionContext) {
    // Set env variables
    Object.keys(env).forEach((variable) => {
      process.env[variable] ??= `${env[variable]}`;
    })

    return fetch(request, env, ctx)
  },
  async queue(batch: MessageBatch<any>, env: Env): Promise<void> {
    let messages = JSON.stringify(batch.messages);
    console.log(`consumed from our queue: ${messages}`);
  },
}

export default {
  fetch(request: Request, env: Env, ctx: ExecutionContext) {
    // Set env variables
    Object.keys(env).forEach((variable) => {
      process.env[variable] ??= `${env[variable]}`;
    })

    return fetch(request, env, ctx)
  },
  async queue(batch: MessageBatch<any>, env: Env): Promise<void> {
    let messages = JSON.stringify(batch.messages);
    console.log(`consumed from our queue: ${messages}`);
  },
}

export default {
  fetch(request: Request, env: Env, ctx: ExecutionContext) {
    // Set env variables
    Object.keys(env).forEach((variable) => {
      process.env[variable] ??= `${env[variable]}`;
    })

    return fetch(request, env, ctx)
  },
  async queue(batch: MessageBatch<any>, env: Env): Promise<void> {
    let messages = JSON.stringify(batch.messages);
    console.log(`consumed from our queue: ${messages}`);
  },
}

K

kianOP•12/5/23, 8:12 AM

They all should be available - have you tried them?

K

kianOP•12/5/23, 8:13 AM

I think that documentation aside is old, and should say within any handler context (fetch, scheduled, queue, email, etc)

K

kianOP•12/5/23, 4:54 PM

What version of

workers-types

workers-types

workers-types

workers-types are you using? It's likely outdated

K

kianOP•12/5/23, 4:54 PM

The current version has this

declare interface Queue<Body = unknown> {
  send(message: Body, options?: QueueSendOptions): Promise<void>;
  sendBatch(messages: Iterable<MessageSendRequest<Body>>): Promise<void>;
}

declare interface Queue<Body = unknown> {
  send(message: Body, options?: QueueSendOptions): Promise<void>;
  sendBatch(messages: Iterable<MessageSendRequest<Body>>): Promise<void>;
}

declare interface Queue<Body = unknown> {
  send(message: Body, options?: QueueSendOptions): Promise<void>;
  sendBatch(messages: Iterable<MessageSendRequest<Body>>): Promise<void>;
}

declare interface Queue<Body = unknown> {
  send(message: Body, options?: QueueSendOptions): Promise<void>;
  sendBatch(messages: Iterable<MessageSendRequest<Body>>): Promise<void>;
}

K

kianOP•12/7/23, 8:17 AM

Smart Placement currently only affects

fetch

fetch

handlers iirc

M

Mikyari•12/9/23, 5:18 AM

Is there any kind of delay message like Rabbit MQ in Cloudflare Queues?

I intend to use Cloudflare Queues to define solution for my case.

User creates a new order
The system will send an email to remind user about the unpaid order after 30 minutes. If the user complete the payment within 30 minutes, the email will not be sent.

MMikyari Is there any kind of delay message like Rabbit MQ in Cloudflare Queues? I inten...

H

Hello, I’m Allie!•12/9/23, 7:33 AM

I wouldn’t think you need Queues at all. Create a DO with a 30 minute alarm. If it receives a Request before the alarm triggers, clear it

MMikyari Is there any kind of delay message like Rabbit MQ in Cloudflare Queues? I inten...

J

John Spurlock•12/9/23, 9:48 PM

not yet, but they are working on it: queues

C

cg•12/10/23, 10:09 PM

Hey @Matt , how's the investigation going, do you have any updates on timelines? Should I just assume that the fix would be in the GA in Q1/Q2 next year?

Ccg Hey @Matt , how's the investigation going, do you have any updates on timelines?...

M

Matt Silverlock•12/11/23, 12:39 AM

We’re still working on it. Non-trivial to fix. Likely within the next 2-3 weeks.

SSam We have also had this same issue with a queue that seemly just stopped sending m...

M

Matt Silverlock•12/11/23, 7:45 PM

We’re working on addressing this - it’s an unfortunate beta-type bug.

SSam We have also had this same issue with a queue that seemly just stopped sending m...

M

Matt Silverlock•12/11/23, 7:46 PM

P.S: an account ID and queue ID allow us to investigate further. I generally recommend avoiding assuming your bug == someone else’s bug

M

Matt Silverlock•12/11/23, 7:48 PM

They’re not private identifiers. You can post them here @SamP

SSam account ID is 12fd8847ed86e95913678748fab30104 and broken queue ID is seine

M

Matt Silverlock•12/11/23, 8:57 PM

Looks like the consumer is consuming fast now. We manually intervened (and have a patch going out to attempt to fix the root cause)

Ccodehex @Matt We have this same issue with queue. Account ID: d2025e363dd2037ea27e179562...

M

Matt Silverlock•12/12/23, 3:51 AM

Can you describe the issue? How large is your backlog?

T

tdevthairun•12/12/23, 4:37 AM

hello I need help about cloudflare queue I want to send queue to run hono routes for create data in postgresql or any idea for help me.

T

tdevthairun•12/12/23, 4:37 AM

VVâjhâtz What would be the best way to process a million entries? I'm currently testing d...

M

Matt Silverlock•12/18/23, 1:25 PM

Stopped locally? Do you see errors? Can you open a bug report on GitHub (including the wrangler version & your code) - ?

T

thiccvitalik•12/21/23, 4:05 PM

Hi! When I have a consumer with a max_batch_size of 5, does this imply that the processing of those 5 messages will share the 128MB memory allocated to the worker? And if I set the max_batch_size to 1, does it ensure that the processing of each message will exclusively have 128MB of memory?

Tthiccvitalik Hi! When I have a consumer with a max_batch_size of 5, does this imply that the ...

U

Unsmart•12/21/23, 9:42 PM

If you have a batch of 5 all messages will be in the same invocation which has 128MB. But also in addition any concurrency you set on the queue would also share that same 128MB afaik. It might be possible that even http/cron events that happen to hit the same server share the 128MB if on the same worker (although not too sure about that).

From what I understand basically a worker script will have 128MB shared across the entire server not just the single invocation.

T

thiccvitalik•12/21/23, 9:54 PM

Thanks for the answers. That's very surprising that additional concurrency also shares the 128MB. The maximum concurrent consumer invocations is 20 in beta. That would mean each of those has only 6MB. blob_sweat

U

Unsmart•12/21/23, 9:59 PM

Im not entirely sure if thats accurate or if it was and things have changed but I think I heard something about that being that case at least when concurrency first was added

K

kianOP•12/22/23, 1:40 AM

Nope.

It's just saying that it doesn't detect a `queue` function in your default export

Similar Threads

Similar Threads

Similar Threads