Has anyone ever come accross the error `Trace: TypeError: Found invalid object in transferList` when

Has anyone ever come accross the error

Trace: TypeError: Found invalid object in transferList

Trace: TypeError: Found invalid object in transferList

Trace: TypeError: Found invalid object in transferList

Trace: TypeError: Found invalid object in transferList when caching a response? The code I have is

if (response.status !== 404) {
        response.headers.set("cache-control", "max-age=3600")
        c.executionCtx.waitUntil(cache.put(req, response.clone()))
    }

if (response.status !== 404) {
        response.headers.set("cache-control", "max-age=3600")
        c.executionCtx.waitUntil(cache.put(req, response.clone()))
    }

if (response.status !== 404) {
        response.headers.set("cache-control", "max-age=3600")
        c.executionCtx.waitUntil(cache.put(req, response.clone()))
    }

if (response.status !== 404) {
        response.headers.set("cache-control", "max-age=3600")
        c.executionCtx.waitUntil(cache.put(req, response.clone()))
    }

and if I comment it out then I don't get the error. It only happens on this one endpoint

Cyb3r-Jak3OP•3/1/23, 10:35 PM

Found it: https://github.com/cloudflare/miniflare/issues/527

CCyb3r-Jak3 Found it: https://github.com/cloudflare/miniflare/issues/527

James•3/1/23, 10:43 PM

Oh good, I've been seeing this all over my dev today and assumed it was related to an update of something. Didn't have chance to dig-in yet though

JJames Oh good, I've been seeing this all over my dev today and assumed it was related ...

dave•3/1/23, 11:42 PM

my gut tells me this is a mitigation for a dangling arraybuffer issue lol

CCyb3r-Jak3 Has anyone ever come accross the error `Trace: TypeError: Found invalid object i...

dave•3/1/23, 11:44 PM

are you using node_compat mode?

Ddave are you using node_compat mode?

Cyb3r-Jak3OP•3/2/23, 1:36 AM

Nope

danielsundq•3/3/23, 7:04 AM

Hi. Is there any additional network limits applied to a cron worker, compared to an ordinary worker invoked by an outside request? I get a strange 404 from my cron worker. The cron worker does a request to another worker through a service binding, which in turn tries to do a request to an external api. The fetch request to the external api fails with 404 when invoked from the cron worker. But if i trigger this from the outside (Postman for example) it will succeed.

kian•3/3/23, 9:19 AM

There is nothing that'd cause a Scheduled Event to be 404'd and a Fetch Event not to be 404'd

danielsundq•3/3/23, 9:38 AM

Kian: Ok interesting. This problem reminds me of when I tried to make fetch request directly to other workers within the same zone. The external API in this case is actually done through a proxy worker within the same zone. But I understand you are saying that there should be no difference depending on how it's triggered

kian•3/3/23, 9:42 AM

Fetching same-zone as in custom routes or workers.dev?

kian•3/3/23, 9:43 AM

Either way, that'd get a 522 error rather than a 404 iirc

danielsundq•3/3/23, 9:45 AM

Custom routes. Ok good to know

danielsundq•3/3/23, 9:46 AM

I will look for a solution elsewere then

Ddanielsundq Kian: Ok interesting. This problem reminds me of when I tried to make fetch requ...

Hello, I’m Allie!•3/3/23, 11:11 AM

Could the service you are

fetch

fetch

ing be region-locked? The Cron Worker might run in a different datacenter than where your regular HTTP-triggered Workers requests run.

Kavatch•3/3/23, 11:33 AM

How do workers perform when it comes to CPU heavy tasks? Like I want to encode a GIF which takes around 10 sec on my local PC, but when I run it on a Server with quite a good CPU it get it down to ~2 seconds.
If I now ran it inside a worker, would I rather see an increase in time for encoding, or a drop-off in time required?

Kavatch•3/3/23, 11:35 AM

I am using Rust, if that makes any difference

KKavatch I am using Rust, if that makes any difference

Hello, I’m Allie!•3/3/23, 11:43 AM

WebAssembly takes a heavy initial hit, because you have to translate your JS objects into ArrayBuffers to pass in. Should perform fine though.

Kavatch•3/3/23, 11:48 AM

My main concern is just that I might hit the 30 sec timeout limit (for HTTP requests) if the encoding is slower on workers than on my PC, for example.
And since I am unable to find any concrete numbers on the CPU performance on the website, my best bet was that maybe here someone knows if how they perform on that type of task or even has some experiences with that kind of workers.

KKavatch My main concern is just that I might hit the 30 sec timeout limit (for HTTP requ...

Jadugar_Jaggu•3/3/23, 11:50 AM

Use cron triggers (hourly setting) to increase time limit

KKavatch My main concern is just that I might hit the 30 sec timeout limit (for HTTP requ...

Hello, I’m Allie!•3/3/23, 11:50 AM

As an example of what Workers+WASM can do, you can check out https://og-playground.vercel.app/. In general, CF won't provide direct CF metrics, but I would say, for light/moderate loads, go with Workers+WASM, for heavy+ loads, go with something like https://fly.io

Vercel OG Image Playground

Generate Open Graph images with Vercel’s Edge Function.

KKavatch My main concern is just that I might hit the 30 sec timeout limit (for HTTP requ...

Jadugar_Jaggu•3/3/23, 11:52 AM

I use a task that takes 10 to 12 minutes using a worker. I just do it once an hour using cron triggers and KV

JJadugar_Jaggu I use a task that takes 10 to 12 minutes using a worker. I just do it once an ho...

Hello, I’m Allie!•3/3/23, 11:54 AM

The issue is the CPU Time. AFAIK, you still only get 30 seconds of CPU with Cron Triggers.

Hello, I’m Allie!•3/3/23, 11:55 AM

NVM

HHello, I’m Allie!As an example of what Workers+WASM can do, you can check out https://og-playgrou...

Kavatch•3/3/23, 11:55 AM

I will have a look at these sites , thank you!

Hello, I’m Allie!•3/3/23, 11:55 AM

I read the wrong section

Jadugar_Jaggu•3/3/23, 11:55 AM

he is asking for http request timeout

Jadugar_Jaggu•3/3/23, 11:55 AM

not cpu

Hello, I’m Allie!•3/3/23, 11:55 AM

Yeah, misread, sorry!

JJadugar_Jaggu Use cron triggers (hourly setting) to increase time limit

Kavatch•3/3/23, 11:57 AM

In general a good Idea however since I want to encode "on demand" I probably can't use cron jobs since I want to do it every time a user calls an endpoint. Thanks though!

KKavatch In general a good Idea however since I want to encode "on demand" I probably can...

Jadugar_Jaggu•3/3/23, 12:01 PM

If you want to do it on demand you can give a try to Queue. Cause in it consumer worker also support waitUntil() like cron

I am not that sure but you can try it

Jadugar_Jaggu•3/3/23, 12:03 PM

Just need to set the value of Message batch size to 1