For example loading the entire file into memory just to send it somewhere else, using streams is bet

T

tonytheonly•4/30/24, 1:56 AM

I have a worker that I want to call an external api on, but I want to return a response without awaiting the the external api call. (the external api call is to just save time writing to the db on another service).

        const promise = fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        });
        c.executionCtx.waitUntil(promise.then())

        flow.params = { campaignId: campaignId }
        return flow;

        const promise = fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        });
        c.executionCtx.waitUntil(promise.then())

        flow.params = { campaignId: campaignId }
        return flow;

        const promise = fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        });
        c.executionCtx.waitUntil(promise.then())

        flow.params = { campaignId: campaignId }
        return flow;

        const promise = fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        });
        c.executionCtx.waitUntil(promise.then())

        flow.params = { campaignId: campaignId }
        return flow;

T

tonytheonly•4/30/24, 1:57 AM

however when I am testing it local and it is not hitting the service

T

tonytheonly•4/30/24, 1:58 AM

I am using hono https://hono.dev/api/context#executionctx

Context - Hono

Ultrafast web framework for Cloudflare Workers, Fastly Compute, Deno, Bun, Vercel, Node.js, and others. Fast, but not only fast.

T

tonytheonly•4/30/24, 2:00 AM

the worker is on localhost:8787 and the write service for the impression is on localhost:3000 I am able to create the impression successully calling it directly but the waitUntil is not hitting it when calling the localhost:8787 endpoint

T

tonytheonly•4/30/24, 12:15 PM

If not waitUntil what method would I use? I believe I still have to await a durable object call correct?

I

ItsWendell•4/30/24, 12:20 PM

@tony Since this is quite a general question about waitUntil I think it's actually fine do to this in here. Do you see any other logs in your console? Are both endpoints ran through the workers sdk / wrangler?

Give this a try:

        c.executionCtx.waitUntil(fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        }).catch((e) => console.error("Error doing impressions", e))
);

        c.executionCtx.waitUntil(fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        }).catch((e) => console.error("Error doing impressions", e))
);

        c.executionCtx.waitUntil(fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        }).catch((e) => console.error("Error doing impressions", e))
);

        c.executionCtx.waitUntil(fetch('http://localhost:3000/impression', {
            method: "POST",
            body: JSON.stringify(data),
            headers: {
                "content-type": "application/json",
            }
        }).catch((e) => console.error("Error doing impressions", e))
);

D

Danny Zhao•4/30/24, 12:22 PM

If I have a worker like the official example

export default {
  async fetch(request: Request): Promise<Response> {
    /**
     * Replace `remote` with the host you wish to send requests to
     */
    const remote = "https://example.com";

    return await fetch(remote, request);
  },
};

export default {
  async fetch(request: Request): Promise<Response> {
    /**
     * Replace `remote` with the host you wish to send requests to
     */
    const remote = "https://example.com";

    return await fetch(remote, request);
  },
};

export default {
  async fetch(request: Request): Promise<Response> {
    /**
     * Replace `remote` with the host you wish to send requests to
     */
    const remote = "https://example.com";

    return await fetch(remote, request);
  },
};

export default {
  async fetch(request: Request): Promise<Response> {
    /**
     * Replace `remote` with the host you wish to send requests to
     */
    const remote = "https://example.com";

    return await fetch(remote, request);
  },
};

And the response is about 100MB which takes a user 1 minute to download. How much money may I be charged for each request according to the pricing model?

DDanny Zhao If I have a worker like the official example ```typescript export default { a...

I

ItsWendell•4/30/24, 12:28 PM

You'll be charged for CPU time and amount of requests, not waiting for IO, since this is IO and you're not doing/awaiting for any CPU actions it shouldn't be too much. This will incur probably at most <10ms (probably less) of CPU time per request. I don't think you pay for the data transferred at all, but not 100% sure about that in terms of ingress.

IItsWendell You'll be charged for CPU time and amount of requests, not waiting for IO, since...

D

Danny Zhao•4/30/24, 12:39 PM

Thanks for responding!

I

ItsWendell•4/30/24, 12:47 PM

Also good to monitor this as you go in the dashboard!

IItsWendell @tony Since this is quite a general question about waitUntil I think it's actual...

T

tonytheonly•4/30/24, 12:55 PM

one is a worker the other is a node docker image. Does waitUntil only work on when calling other workers?

IItsWendell @tony Since this is quite a general question about waitUntil I think it's actual...

T

tonytheonly•4/30/24, 12:58 PM

The entire function is wrapped in a try catch so any error would be logged and thrown.

T

tonytheonly•4/30/24, 12:59 PM

That being said I get now errors, and when looking at the logs of the localhost:3000 i see no console log of the request. However when I post the same information in postman to localhost:3000 I get a console log

G

George Boot•4/30/24, 1:10 PM

I am getting

Cannot read properties of undefined (reading 'writeDataPoint')

Cannot read properties of undefined (reading 'writeDataPoint')

Cannot read properties of undefined (reading 'writeDataPoint')

Cannot read properties of undefined (reading 'writeDataPoint') when trying analytics engine. I've added the binding to my toml and deployed. Is there anything else I need to to to start using analytics engine?

G

George Boot•4/30/24, 1:11 PM

It seems like my analytics_engine_datasets isnt actually bound to the worker. A console.log of the env doesn't show the binding

M

matiasjMusante•4/30/24, 1:15 PM

Does someone know something about function usage on static page rendering in next on pages, as disccused above:

https://community.cloudflare.com/t/loading-static-page-counts-towards-function-request/535651

Is this really like this? Is this situation shared among all other frameworks/ssgenerators? I mean, do they all incur in function usage when rendering static pages? I was reading about Astro, and it seems nice but I dont know if may be it´s the same with all frameworks.

MmatiasjMusante Does someone know something about function usage on static page rendering in nex...

I

Isaac McFadyen•4/30/24, 1:20 PM

?channel-crossposting

F

Flare•4/30/24, 1:20 PM

Please do not post your question in multiple channels per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

M

matiasjMusante•4/30/24, 1:23 PM

Oh sorry I didn´t mean to!! I just didn´t know exactly where to ask,

BBeny For example loading the entire file into memory just to send it somewhere else, ...

R

rootalien•4/30/24, 3:29 PM

The company I work for doesn't want to do this. because they have their own software.

R

Rich•4/30/24, 3:47 PM

Does anybody know if the Cache API supports Cache Reserve?

R

Rich•4/30/24, 3:54 PM

do you know if Cache Reserve / R2 is global or per colo?

C

Chaika•4/30/24, 3:58 PM

it's an r2 bucket, r2 buckets are offered in a few locations but it's just like s3 in the sense that it's persistent object storage

C

Chaika•4/30/24, 3:59 PM

you have three options for cache
Local Colo Cache <- only one Cache API will ever touch
Tiered Cache <- can vary depending on setup, either Smart (one) or Generic (a few upper tiers), optionally with middle tier (a few in the middle)
Cache Reserve <- R2, last
So Requests could go
Local -> Tiered Cache Middle -> Tiered Cache Upper -> Cache Reserve -> Origin

C

Chaika•4/30/24, 3:59 PM

https://blog.cloudflare.com/introducing-cache-reserve

R

Rich•4/30/24, 4:05 PM

Ok thanks -- I guess rolling our own cache reserve with R2 directly would be a bit clumsy as CF cache purging obv wouldn't work.

I wonder, does CF intend to add support for Cache Reserve and Tired Caching when using the Cache API eventually?

RRich Ok thanks -- I guess rolling our own cache reserve with R2 directly would be a b...

C

Chaika•4/30/24, 4:08 PM

don't think I've heard anything about it, and it's been this way since Cache API came out in 2019. You can use the fetch() api to use tiered caching/cache reserve, but would have to have an endpoint to fetch of course

CChaika don't think I've heard anything about it, and it's been this way since Cache API...

R

Rich•4/30/24, 4:10 PM

yeah we need the Cache API as we're caching POST requests (graphql). It'd be interesting to know why the Cache API can't take advantage of it but fetch can...

RRich yeah we need the Cache API as we're caching POST requests (graphql). It'd be int...

C

Chaika•4/30/24, 4:12 PM

well I imagine some of it is just simple limitations

Tiered Caching Smart requires an IP/geolocation to use, cache api doesn't give it one.
I know Cache Reserve is also part of "Pingora" which their connecting to origin software, so a step outside of the normal stack/where workers run
plus Cache API is completely free

Fetch() goes through the normal outgoing flow

IItsWendell @tony Since this is quite a general question about waitUntil I think it's actual...

T

tonytheonly•4/30/24, 4:13 PM

workers-and-pages-helpexecutionCtx.waitUntil on write service

CChaika well I imagine some of it is just simple limitations Tiered Caching Smart requi...

R

Rich•4/30/24, 4:29 PM

hmm I see. I guess the Cache API could accept an IP as a header -- but yeah I suppose the fundamental difference between fetch and the Cache API is the Request passed to the latter doesn't necessarily point to an actual origin -- could be

new Request("https://this.doesnt.exist.at/all")

new Request("https://this.doesnt.exist.at/all")

new Request("https://this.doesnt.exist.at/all")

new Request("https://this.doesnt.exist.at/all") .

Given our cache key isn't really a

Request

Request

Request

Request, I wonder if we're better off ditching the Cache API and implementing a more standard key / value cache with R2 or KV

B

bene2591•4/30/24, 7:13 PM

hi, if I store assets into cache using the cache api using a worker and purge the zone cache where this worker has a route, will these files also be purged?

A

Adi•5/1/24, 1:29 AM

I got seen zoned on general discussions with this question, figured I'd ask here

. Would love some clarification.

Quick question about the smart placement limitation on RPC service bindings. Is that temporary? Or is it a limitation that is expected to be around for a while? Not looking for a timeline, just some confirmation the vision for RPC.

P

Paul•5/1/24, 2:25 AM

Hi I need some help calling Cloudflare workers from Postman or any client, I used Honojs and it works fine locally, but when I make a call to the server after deploying an getting error: Option apiKey is required

K

Karan•5/1/24, 7:29 AM

no cipher supported in cloudflare workers ?

J

johnwick•5/1/24, 8:21 AM

Hey guys, has anyone encountered this problem?

Uncaught Error: Dynamic require of "node:worker_threads" is not supported

Uncaught Error: Dynamic require of "node:worker_threads" is not supported

Uncaught Error: Dynamic require of "node:worker_threads" is not supported

Uncaught Error: Dynamic require of "node:worker_threads" is not supported

Jjohnwick Hey guys, has anyone encountered this problem? `Uncaught Error: Dynamic require ...

H

Hello, I’m Allie!•5/1/24, 8:23 AM

Your code/a package's code is attempting to use the

worker_threads

worker_threads

worker_threads

worker_threads package from Node, which is not supported on Workers

J

johnwick•5/1/24, 8:23 AM

Oh god!

J

johnwick•5/1/24, 8:25 AM

I would also like to ask, what other nodejs services does cloudflare have?

Jjohnwick I would also like to ask, what other nodejs services does cloudflare have?

H

Hello, I’m Allie!•5/1/24, 8:25 AM

These are the packages supported at the moment: https://developers.cloudflare.com/workers/runtime-apis/nodejs

Cloudflare Docs

Node.js compatibility · Cloudflare Workers docs

Implemented Node.js runtime APIs and enablement instructions for your Worker project.

N

Neiki•5/1/24, 9:57 AM

hey i noticed i sometimes get 524 http errors on my worker while requesting another api with the nodejs fetch request, i searched a little and its a "cloudflare timeout error", why does this happen?

and when or is it in sometime possible to use axios instead of fetch?

Bbene2591 hi, if I store assets into cache using the cache api using a worker and purge th...

R

Rich•5/1/24, 2:31 PM

I've been told it should purge so long as you use

caches.default

caches.default

caches.default

caches.default (rather than

caches.open

caches.open

caches.open

caches.open) -- however we've been unable to get purging to work sadly.

P

Pato•5/1/24, 7:05 PM

Hey im getting this error when trying to use a service binding:

TypeError: Cannot read properties of undefined (reading 'fetch')
    at handler (index.js:7841:37)
    at async handle (index.js:2287:29)
    at async Object.handle (index.js:2287:29)
    at async jsonError (index.js:7924:12) {
  stack: TypeError: Cannot read properties of undefined (re…287:29)
    at async jsonError (index.js:7924:12),
  message: Cannot read properties of undefined (reading 'fetch')
}

TypeError: Cannot read properties of undefined (reading 'fetch')
    at handler (index.js:7841:37)
    at async handle (index.js:2287:29)
    at async Object.handle (index.js:2287:29)
    at async jsonError (index.js:7924:12) {
  stack: TypeError: Cannot read properties of undefined (re…287:29)
    at async jsonError (index.js:7924:12),
  message: Cannot read properties of undefined (reading 'fetch')
}

TypeError: Cannot read properties of undefined (reading 'fetch')
    at handler (index.js:7841:37)
    at async handle (index.js:2287:29)
    at async Object.handle (index.js:2287:29)
    at async jsonError (index.js:7924:12) {
  stack: TypeError: Cannot read properties of undefined (re…287:29)
    at async jsonError (index.js:7924:12),
  message: Cannot read properties of undefined (reading 'fetch')
}

TypeError: Cannot read properties of undefined (reading 'fetch')
    at handler (index.js:7841:37)
    at async handle (index.js:2287:29)
    at async Object.handle (index.js:2287:29)
    at async jsonError (index.js:7924:12) {
  stack: TypeError: Cannot read properties of undefined (re…287:29)
    at async jsonError (index.js:7924:12),
  message: Cannot read properties of undefined (reading 'fetch')
}

C

coffee'•5/1/24, 7:32 PM

hi, there is a 50 limit cf worker children requst ，if i can use a worker to trigger the other worker and split my requests

V

vas•5/1/24, 9:15 PM

Hi, Does changing a worker's Usage model in cloudflare worker dashboard incur downtime or is it only applied to new instances of that worker?

C

crusaderay•5/1/24, 9:32 PM

Any plans for workers to support 3rd party libs?

Ccrusaderay Any plans for workers to support 3rd party libs?

C

Cyb3r-Jak3•5/1/24, 9:38 PM

What do you mean? You can use a lot of npm packages with workers

For example loading the entire file into memory just to send it somewhere else, using streams is bet

Similar Threads

Similar Threads

Similar Threads