but many don't

C

cgOP•11/23/23, 9:41 PM

With the error:

 "Queue send failed: Service Temporarily Unavailable"

"Queue send failed: Service Temporarily Unavailable"

 "Queue send failed: Service Temporarily Unavailable"

"Queue send failed: Service Temporarily Unavailable"

Ccg but many don't

M

Matt Silverlock•11/23/23, 9:50 PM

OK, let us continue to investigate.

C

cgOP•11/23/23, 10:05 PM

I have removed taht foo code

C

cgOP•11/23/23, 10:05 PM

I'm going to have to leave now, thanksgiving stuff.

C

cgOP•11/23/23, 10:05 PM

I'll check back in

C

cgOP•11/23/23, 10:06 PM

If you have any updates Matt, I have a support ticket

3037173

D

dattaproffs•11/23/23, 11:30 PM

Hi, i don't see anything about it in the docs but i thought i could ask anyway.
Is there a way to delay messages in the queue? i wan't to add them to the queue but consume them in an hour.

C

cgOP•11/24/23, 5:09 AM

@Matt any news/ updates?

Ccg @Matt any news/ updates?

M

MattIPv4•11/24/23, 5:18 AM

I feel you pinged the wrong Matt

C

cgOP•11/24/23, 5:18 AM

ah shoot, sorry mate

C

cgOP•11/24/23, 5:19 AM

well, happy thanksgiving

C

cgOP•11/24/23, 5:19 AM

nice work

C

cgOP•11/24/23, 5:19 AM

love what you're doing

Ddattaproffs Hi, i don't see anything about it in the docs but i thought i could ask anyway. ...

M

Mark•11/24/23, 10:31 AM

I have also been looking for the ability to delay queue messages. Is this possible?

MMark I have also been looking for the ability to delay queue messages. Is this possib...

M

Matt Silverlock•11/24/23, 2:26 PM

queues

Ddattaproffs Hi, i don't see anything about it in the docs but i thought i could ask anyway. ...

M

Matt Silverlock•11/24/23, 2:27 PM

See the pinned messages: queues

MMatt Silverlock See the pinned messages: https://discord.com/channels/595317990191398933/1008691...

D

dattaproffs•11/24/23, 6:12 PM

Ah ofc. Thanks

A

amg•11/26/23, 4:49 PM

Hi, I am not able to see the queue page to create a queue. The website always redirect me to the overview route

A

amg•11/26/23, 4:52 PM

I am able to create the queue with wrangler but I am always redirect to this page

A

amg•11/26/23, 4:53 PM

A

amg•11/26/23, 4:59 PM

It seems that until you create a worker, you can not access to the queues

C

cgOP•11/26/23, 10:54 PM

@Matt
Any news / updates on the Service Temporarily Unavailable issue?

Ccg @Matt Any news / updates on the Service Temporarily Unavailable issue?

M

Matt Silverlock•11/26/23, 11:08 PM

Not yet. Are you still seeing this repeatedly per your repro above?

C

cgOP•11/26/23, 11:08 PM

yep, still seing this

C

cgOP•11/26/23, 11:26 PM

I can consistently reproduce it with at least one queue message type

C

cgOP•11/26/23, 11:26 PM

The code is rather simple IMO, so I'm not really sure what to do

Ccg The code is rather simple IMO, so I'm not really sure what to do

M

Matt Silverlock•11/26/23, 11:52 PM

We won’t know until we investigate further. We’ve not seen a case like this before where the queue is returning hard errors every N messages.

C

cgOP•11/26/23, 11:53 PM

I'm available to assist with any investigate if it would help, I'm in Cali time for the next week, then back to AEDT

S

Shihmin Lee•11/27/23, 4:00 AM

Hey guys. A question about dead_letter_queue. I noticed the message gets encrypted when it goes to dead_letter_queue. Is there a way to send the message as JSON instead?

S

Shihmin Lee•11/27/23, 1:43 PM

Another question is for message inside the dead_letter_queue. Is there a way to move it into the original queue manually on the GUI?

SShihmin Lee Another question is for message inside the dead_letter_queue. Is there a way to ...

M

Matt Silverlock•11/27/23, 2:38 PM

You cannot move a message "back" to the original queue. You can set up the original queue as the DLQ for the "DLQ" you have, but you cannot move individual messages.

S

Shihmin Lee•11/27/23, 9:56 PM

I see. Is there a way to use the existing worker to subscribe to 2 queues at the same time? It might seem strange if I need another worker for this DLQ and maybe I also need a DLQ DLQ worker for this DLQ? :p

As for the JSON part. Is there a way to see the message as JSON in the DLQ?

K

kian•11/27/23, 10:11 PM

Is there a way to use the existing worker to subscribe to 2 queues at the same time?

Yep https://developers.cloudflare.com/queues/learning/how-queues-works/#create-a-consumer

S

Shihmin Lee•11/27/23, 10:17 PM

Thanks.

S

Shihmin Lee•11/27/23, 10:44 PM

Hey Kian, maybe I wasn't clear enough in my previous request. Can you provide a document that shows how to configure a single worker to subscribe to two different queues with two consumers? I can't seem to figure out how to configure [[queues.consumers]] in the .toml file.

U

Unsmart•11/27/23, 10:48 PM

The docs he linked is how you do that.

[[queues.consumers]]
queue = "1"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "2"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "1"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "2"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "1"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "2"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "1"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

[[queues.consumers]]
queue = "2"
max_batch_size = 100 # optional
max_batch_timeout = 30 # optional

export default {
  async queue(batch: MessageBatch<Error>, env: Environment): Promise<void> {
    switch (batch.queue) {
      case '1':
        // handle queue 1
        break;
      case '2':
        // handle queue 2
        break;
    }
  },
};

export default {
  async queue(batch: MessageBatch<Error>, env: Environment): Promise<void> {
    switch (batch.queue) {
      case '1':
        // handle queue 1
        break;
      case '2':
        // handle queue 2
        break;
    }
  },
};

export default {
  async queue(batch: MessageBatch<Error>, env: Environment): Promise<void> {
    switch (batch.queue) {
      case '1':
        // handle queue 1
        break;
      case '2':
        // handle queue 2
        break;
    }
  },
};

export default {
  async queue(batch: MessageBatch<Error>, env: Environment): Promise<void> {
    switch (batch.queue) {
      case '1':
        // handle queue 1
        break;
      case '2':
        // handle queue 2
        break;
    }
  },
};

S

Shihmin Lee•11/27/23, 10:54 PM

Gotcha.

C

cgOP•11/28/23, 12:29 AM

@Matt, apologies on keeping @'ing you but I've heard nothing from the support ticket.
If there any time lines or information you can provide, that would be really helpful. I'll have to start looking at other services to accomodate the Queue, like moving to SQS as it's starting to impact business

Ccg @Matt, apologies on keeping @'ing you but I've heard nothing from the support ti...

M

Matt Silverlock•11/28/23, 12:32 AM

Unfortunately we’re still investigating. I hate to have this take so long but Queues is still in beta, and so issues like this (which have been rare) may still crop up. I also assume you’ve created a fresh queue and still reproduce this.

C

cgOP•11/28/23, 12:55 AM

Thanks, I appreciate the reply. Yea, a fresh queue still had the issue.

C

cgOP•11/28/23, 1:26 AM

Could I confirm that when calling

QUEUE.send()

QUEUE.send()

QUEUE.send()

QUEUE.send() within a consumer, that it doesn't spawn a new worker within the same "thread"

C

cgOP•11/28/23, 1:26 AM

I'm seeing

Queue sendBatch failed: Subrequest depth limit exceeded.  This request recursed through Workers too many times.

Queue sendBatch failed: Subrequest depth limit exceeded. This request recursed through Workers too many times.

Queue sendBatch failed: Subrequest depth limit exceeded.  This request recursed through Workers too many times.

Queue sendBatch failed: Subrequest depth limit exceeded. This request recursed through Workers too many times. but the message that has invoked the consumer should not reach this limit at all

C

cgOP•11/28/23, 1:28 AM

This is the code that is being hit (has been modified)

C

cgOP•11/28/23, 1:29 AM

export const handleMessage = async ({
  message,
  env,
}) => {
  const { items, nextPageToken } =
    await api.listByStatus({
      limit: 100,
      nextPageToken: message.nextPageToken,
      status: 'approved',
    });

  if (nextPageToken) {
    await sendQueueMessage({
      message: {
        type: '<REDACTED>',
        nextPageToken,
      },
      env,
    });
  }

  const toBeProcessed = items
    .filter((f) => !f.processed)

  await sendBatchQueueMessage({
    batch: toBeProcessed.map((transaction) => ({
      message: {
        transaction,
        type: '<OTHERMESSAGE>',
      },
    })),
    env,
  });
};

export const handleMessage = async ({
  message,
  env,
}) => {
  const { items, nextPageToken } =
    await api.listByStatus({
      limit: 100,
      nextPageToken: message.nextPageToken,
      status: 'approved',
    });

  if (nextPageToken) {
    await sendQueueMessage({
      message: {
        type: '<REDACTED>',
        nextPageToken,
      },
      env,
    });
  }

  const toBeProcessed = items
    .filter((f) => !f.processed)

  await sendBatchQueueMessage({
    batch: toBeProcessed.map((transaction) => ({
      message: {
        transaction,
        type: '<OTHERMESSAGE>',
      },
    })),
    env,
  });
};

export const handleMessage = async ({
  message,
  env,
}) => {
  const { items, nextPageToken } =
    await api.listByStatus({
      limit: 100,
      nextPageToken: message.nextPageToken,
      status: 'approved',
    });

  if (nextPageToken) {
    await sendQueueMessage({
      message: {
        type: '<REDACTED>',
        nextPageToken,
      },
      env,
    });
  }

  const toBeProcessed = items
    .filter((f) => !f.processed)

  await sendBatchQueueMessage({
    batch: toBeProcessed.map((transaction) => ({
      message: {
        transaction,
        type: '<OTHERMESSAGE>',
      },
    })),
    env,
  });
};

export const handleMessage = async ({
  message,
  env,
}) => {
  const { items, nextPageToken } =
    await api.listByStatus({
      limit: 100,
      nextPageToken: message.nextPageToken,
      status: 'approved',
    });

  if (nextPageToken) {
    await sendQueueMessage({
      message: {
        type: '<REDACTED>',
        nextPageToken,
      },
      env,
    });
  }

  const toBeProcessed = items
    .filter((f) => !f.processed)

  await sendBatchQueueMessage({
    batch: toBeProcessed.map((transaction) => ({
      message: {
        transaction,
        type: '<OTHERMESSAGE>',
      },
    })),
    env,
  });
};

C

cgOP•11/28/23, 1:31 AM

These are the two helper functions:

export const sendQueueMessage = ({ message, env }: SendQueueMessage) => {
  return env.PROCESS_QUEUE.send(message, { contentType: 'json' });
};

export const sendBatchQueueMessage = ({
  batch,
  env,
}: SendBatchQueueMessage) => {
  const ch = chunk(batch, 20);
  return Promise.all(
    ch.map((c) => {
      return env.PROCESS_QUEUE.sendBatch(
        c.map((body) => ({ body: body.message, contentType: 'json' })),
      );
    }),
  );
};

export const sendQueueMessage = ({ message, env }: SendQueueMessage) => {
  return env.PROCESS_QUEUE.send(message, { contentType: 'json' });
};

export const sendBatchQueueMessage = ({
  batch,
  env,
}: SendBatchQueueMessage) => {
  const ch = chunk(batch, 20);
  return Promise.all(
    ch.map((c) => {
      return env.PROCESS_QUEUE.sendBatch(
        c.map((body) => ({ body: body.message, contentType: 'json' })),
      );
    }),
  );
};

export const sendQueueMessage = ({ message, env }: SendQueueMessage) => {
  return env.PROCESS_QUEUE.send(message, { contentType: 'json' });
};

export const sendBatchQueueMessage = ({
  batch,
  env,
}: SendBatchQueueMessage) => {
  const ch = chunk(batch, 20);
  return Promise.all(
    ch.map((c) => {
      return env.PROCESS_QUEUE.sendBatch(
        c.map((body) => ({ body: body.message, contentType: 'json' })),
      );
    }),
  );
};

export const sendQueueMessage = ({ message, env }: SendQueueMessage) => {
  return env.PROCESS_QUEUE.send(message, { contentType: 'json' });
};

export const sendBatchQueueMessage = ({
  batch,
  env,
}: SendBatchQueueMessage) => {
  const ch = chunk(batch, 20);
  return Promise.all(
    ch.map((c) => {
      return env.PROCESS_QUEUE.sendBatch(
        c.map((body) => ({ body: body.message, contentType: 'json' })),
      );
    }),
  );
};

K

kian•11/28/23, 2:02 AM

Concurrent consumers are in the same Worker 'instance' I believe, so you can sometimes run into limits that you wouldn't expect to hit.

U

Unsmart•11/28/23, 4:26 AM

I'm guessing durable object alarms dont have this subrequest depth tracking? I think quite a few people use it for crons so could use that for the infinite loop things

Similar Threads