If the 6 connection limit is reached, what happens to the worker? Is there some error reported somew

Ccg If the 6 connection limit is reached, what happens to the worker? Is there some ...

M

Connections will be pending (until they potentially time out). On top of that, you can only make 1000 requests per invocation (e.g. each

send

send

send

send or

sendBatch

sendBatch

counts as one) . An invocation is each call to

queue

queue

queue

queue or

fetch

fetch

.

C

cgOP•11/23/23, 7:59 PM

I'd be surprised if I am hitting the limit, as the log message that I am observing appears in Google Cloud Log Explorer as a result of a

fetch

fetch

that is finalised at the end of the

queue()

queue()

queue()

queue() handler

C

cgOP•11/23/23, 7:59 PM

return handleMessages(batch, { ...env, logger }).finally(() =>
      tracer.finalizeQueueEvent({ batch }),
    );

return handleMessages(batch, { ...env, logger }).finally(() =>
      tracer.finalizeQueueEvent({ batch }),
    );

return handleMessages(batch, { ...env, logger }).finally(() =>
      tracer.finalizeQueueEvent({ batch }),
    );

return handleMessages(batch, { ...env, logger }).finally(() =>
      tracer.finalizeQueueEvent({ batch }),
    );

C

cgOP•11/23/23, 8:01 PM

maybe I'm understanding this wrong, but if I am seeing the log message in Logs Explorer as a result of an outbound

fetch

fetch

, then all the requests within the

queue

queue

queue

queue invocation must be < 1000, or else the log message would never make it

C

cgOP•11/23/23, 8:08 PM

I've also seen the error

Queue send failed: Service Temporarily Unavailable

Queue send failed: Service Temporarily Unavailable

Queue send failed: Service Temporarily Unavailable

Queue send failed: Service Temporarily Unavailable

C

cgOP•11/23/23, 8:08 PM

Which I don't believe should have the same batching / concurrency issues

Ccg maybe I'm understanding this wrong, but if I am seeing the log message in Logs E...

M

Matt Silverlock•11/23/23, 8:09 PM

Correct, so we can rule that out.

C

cgOP•11/23/23, 8:44 PM

Well, I must say I'm at a loss here

C

cgOP•11/23/23, 8:44 PM

it might be a bit of a nuclear option, but I could create a new queue?

C

cgOP•11/23/23, 9:01 PM

Well, no, changing to a new Queue did not solve it, still seeing:

 "Queue sendBatch failed: Service Temporarily Unavailable

 "Queue sendBatch failed: Service Temporarily Unavailable

 "Queue sendBatch failed: Service Temporarily Unavailable

 "Queue sendBatch failed: Service Temporarily Unavailable

Ccg Well, no, changing to a new Queue did not solve it, still seeing: ``` "Queue s...

M

Matt Silverlock•11/23/23, 9:21 PM

If you set up the most minimal queue - e.g. identical to the tutorial - do you still see the issue? I want to rule out anything else here.

MMatt Silverlock If you set up the most minimal queue - e.g. identical to the tutorial - do you s...

M

Matt Silverlock•11/23/23, 9:21 PM

Heck, just

send(“foo”)

send(“foo”)

send(“foo”)

send(“foo”)

C

cgOP•11/23/23, 9:23 PM

I can send messages via the dashbaord and they get received and processed

C

cgOP•11/23/23, 9:24 PM

The Q seems to be working, it's seems like the consumer fails to produce an event

C

cgOP•11/23/23, 9:28 PM

I'll put this at the top of the handleMessage()

C

cgOP•11/23/23, 9:28 PM

  env.logger.info('Sending foo');
  env.PROCESS_QUEUE.send('FOO')
    .then(() => env.logger.info('sent foo'))
    .catch((e) => env.logger.error('failed to send foo', e));

  env.logger.info('Sending foo');
  env.PROCESS_QUEUE.send('FOO')
    .then(() => env.logger.info('sent foo'))
    .catch((e) => env.logger.error('failed to send foo', e));

  env.logger.info('Sending foo');
  env.PROCESS_QUEUE.send('FOO')
    .then(() => env.logger.info('sent foo'))
    .catch((e) => env.logger.error('failed to send foo', e));

  env.logger.info('Sending foo');
  env.PROCESS_QUEUE.send('FOO')
    .then(() => env.logger.info('sent foo'))
    .catch((e) => env.logger.error('failed to send foo', e));

C

cgOP•11/23/23, 9:37 PM

well how about that

C

cgOP•11/23/23, 9:37 PM

some send and some don't

C

cgOP•11/23/23, 9:38 PM

but many don't

C

cgOP•11/23/23, 9:41 PM

With the error:

 "Queue send failed: Service Temporarily Unavailable"

"Queue send failed: Service Temporarily Unavailable"

 "Queue send failed: Service Temporarily Unavailable"

"Queue send failed: Service Temporarily Unavailable"

Ccg but many don't

M

Matt Silverlock•11/23/23, 9:50 PM

OK, let us continue to investigate.

C

cgOP•11/23/23, 10:05 PM

I have removed taht foo code

C

cgOP•11/23/23, 10:05 PM

I'm going to have to leave now, thanksgiving stuff.

C

cgOP•11/23/23, 10:05 PM

I'll check back in

C

cgOP•11/23/23, 10:06 PM

If you have any updates Matt, I have a support ticket

3037173

D

dattaproffs•11/23/23, 11:30 PM

Hi, i don't see anything about it in the docs but i thought i could ask anyway.
Is there a way to delay messages in the queue? i wan't to add them to the queue but consume them in an hour.

C

cgOP•11/24/23, 5:09 AM

@Matt any news/ updates?

Ccg @Matt any news/ updates?

M

MattIPv4•11/24/23, 5:18 AM

I feel you pinged the wrong Matt

C

cgOP•11/24/23, 5:18 AM

ah shoot, sorry mate

C

cgOP•11/24/23, 5:19 AM

well, happy thanksgiving

C

cgOP•11/24/23, 5:19 AM

nice work

C

cgOP•11/24/23, 5:19 AM

love what you're doing

Ddattaproffs Hi, i don't see anything about it in the docs but i thought i could ask anyway. ...

M

Mark•11/24/23, 10:31 AM

I have also been looking for the ability to delay queue messages. Is this possible?

MMark I have also been looking for the ability to delay queue messages. Is this possib...

M

Matt Silverlock•11/24/23, 2:26 PM

queues

Ddattaproffs Hi, i don't see anything about it in the docs but i thought i could ask anyway. ...

M

Matt Silverlock•11/24/23, 2:27 PM

See the pinned messages: queues

MMatt Silverlock See the pinned messages: https://discord.com/channels/595317990191398933/1008691...

D

dattaproffs•11/24/23, 6:12 PM

Ah ofc. Thanks

A

amg•11/26/23, 4:49 PM

Hi, I am not able to see the queue page to create a queue. The website always redirect me to the overview route

A

amg•11/26/23, 4:52 PM

I am able to create the queue with wrangler but I am always redirect to this page

A

amg•11/26/23, 4:53 PM

A

amg•11/26/23, 4:59 PM

It seems that until you create a worker, you can not access to the queues

C

cgOP•11/26/23, 10:54 PM

@Matt
Any news / updates on the Service Temporarily Unavailable issue?

Ccg @Matt Any news / updates on the Service Temporarily Unavailable issue?

M

Matt Silverlock•11/26/23, 11:08 PM

Not yet. Are you still seeing this repeatedly per your repro above?

C

cgOP•11/26/23, 11:08 PM

yep, still seing this

C

cgOP•11/26/23, 11:26 PM

I can consistently reproduce it with at least one queue message type

C

cgOP•11/26/23, 11:26 PM

The code is rather simple IMO, so I'm not really sure what to do

Ccg The code is rather simple IMO, so I'm not really sure what to do

M

Matt Silverlock•11/26/23, 11:52 PM

We won’t know until we investigate further. We’ve not seen a case like this before where the queue is returning hard errors every N messages.

C

cgOP•11/26/23, 11:53 PM

I'm available to assist with any investigate if it would help, I'm in Cali time for the next week, then back to AEDT

S

Shihmin Lee•11/27/23, 4:00 AM

Hey guys. A question about dead_letter_queue. I noticed the message gets encrypted when it goes to dead_letter_queue. Is there a way to send the message as JSON instead?

S

Shihmin Lee•11/27/23, 1:43 PM

Another question is for message inside the dead_letter_queue. Is there a way to move it into the original queue manually on the GUI?

SShihmin Lee Another question is for message inside the dead_letter_queue. Is there a way to ...

M

Matt Silverlock•11/27/23, 2:38 PM

You cannot move a message "back" to the original queue. You can set up the original queue as the DLQ for the "DLQ" you have, but you cannot move individual messages.

If the 6 connection limit is reached, what happens to the worker? Is there some error reported somew

Similar Threads

Similar Threads

Similar Threads