Will try to do, but is it the only way to find out if my execution was terminated early?

MMaxMax Will try to do, but is it the only way to find out if my execution was terminate...

H

Assuming that the logs don't show an error, then I don't think it would be getting cut off. Might be something else being skipped in the code

H

Hello, I’m Allie!•2/1/24, 2:47 PM

If the request goes through, then it has completed execution, so maybe there are some conditions for an API call that aren't being fulfilled

HHello, I’m Allie!Though, can't you just prevent Cloud Run from booting anywhere other than the US...

D

dave•2/1/24, 2:48 PM

Cloud Run is booting only in the US. The thing is if the Worker is running outside of the US, the subrequest to Cloud Run is gonna be outside the US for bandwidth billing purposes, no?

Ddave Cloud Run is booting only in the US. The thing is if the Worker is running outsi...

H

Hello, I’m Allie!•2/1/24, 2:49 PM

Uh... I'm not actually sure how they determine the "region" it is egressing to, and thus the bill. If it is based on IP geolocation, then all Workers should appear as being from the US

H

Hello, I’m Allie!•2/1/24, 2:50 PM

As for your original question, if Argo detects that an "origin" is in the US, it will spawn itself there. This does require more than one request per Worker invocation though

Ddave Cloud Run is booting only in the US. The thing is if the Worker is running outsi...

I

Isaac McFadyen•2/1/24, 3:04 PM

I believe Cloud Run uses anycast for their URLs

I

Isaac McFadyen•2/1/24, 3:04 PM

And then they'd bill based on the DC ingressed at

IIsaac McFadyen I believe Cloud Run uses anycast for their URLs

D

dave•2/1/24, 3:05 PM

whatttt. lemme check that!

I

Isaac McFadyen•2/1/24, 3:05 PM

If not then I can't imagine how they bill based on region, GeoIP wouldn't be accurate enough for billing purposes

I

Isaac McFadyen•2/1/24, 3:05 PM

I know for sure Cloud CDN and Cloud Load Balancer does and I was under the impression that the Cloud Run URL is just GCP-managed LB.

D

dave•2/1/24, 3:08 PM

oh wow you're right

Original message was deleted

C

Cyb3r-Jak3•2/1/24, 5:26 PM

Try wrangler 3.18 https://github.com/cloudflare/workers-sdk/issues/4562

GitHub

🐛 BUG: "[ERROR] Error in ProxyController: Error inside ProxyWorker"...

Which Cloudflare product(s) does this pertain to? Wrangler core, Miniflare What version(s) of the tool(s) are you using? 3.19.0 [Wrangler] What version of Node are you using? 20.10.0 What operating...

S

Scai•2/1/24, 6:35 PM

Hey, so I want to use workers with nodejs package called GameDig. I want to call the worker service, and pass the location where should run. It is possible to give to the worker the region code where to execute?

SScai Hey, so I want to use workers with nodejs package called GameDig. I want to call...

C

Chaika•2/1/24, 6:42 PM

Workers aren't nodejs, they run off the Chrome's Javascript engine V8, kind of like a new tab would, in their own isolates. There's some node compat and CF's own socket stuff, but you would need to majorly alter gamedig to use CF's Socket stuff, and it wouldn't work for anything that depends on UDP/CF only supports TCP. So minecraft would be possible, any steam game/using steam server query protocol wouldn't, and you can't tell the worker where to run. You could create a Durable Object and have it run in a few specific regions (<https://developers.cloudflare.com/durable-objects/reference/data-location/#provide-a-location-hint), but it's only a hint to a wide region and CF doesn't have DOs in South America/Africa atm

Data location · Cloudflare Durable Objects docs

You can restrict a Durable Object to a jurisdiction, or provide a location hint.

S

Scai•2/1/24, 6:51 PM

Yeah, I would like to have udp games too.

S

Scai•2/1/24, 6:52 PM

And I want to be as close to game servers the query.

S

Scai•2/1/24, 6:52 PM

And I was thinking cloudflare workers would work because of the low latency overall.

C

Chaika•2/1/24, 6:54 PM

udp sockets are somewhere in the plans, one day hopefully

SScai And I was thinking cloudflare workers would work because of the low latency over...

C

Chaika•2/1/24, 6:54 PM

by default it would be closest to the visitor/executor of the worker, not the server

G

glamboyosa•2/1/24, 7:09 PM

heya guys. possible noob question as I'm super new to CF using it for a side project (https://vaella.glamboyosa.xyz) and environment variables and CF workers but.

say I have an environment variable in my dev.vars called database_id

and in the [vars] I reference database_id as database_id=$database_id

and also for environment.development

and it all works fine.

but how would I reference environment variables for production that way?

I am aware you could set up a GitHub action but I don't want to or need to so early. and I'd like to commit my wrangler.toml file with my sensitive data secure.

Vaella

Private Audio Rant Rooms

G

glamboyosa•2/1/24, 7:09 PM

so kinda like on the Vercel dashboard where you can specify environment variables and it'll be read for prod deploys.

G

glamboyosa•2/1/24, 7:09 PM

like I wanna be able to tell D1 to reference the database_id variable and it kinda point to the var in prod somehow when I use wrangler.

same for using wrangler deploy ...

I'd appreciate any guidance or examples (so j don't waste anyone's time if it's a bit too noob-ish!)

A

AKStriker98•2/1/24, 7:32 PM

Would a worker with service bindings to itself to boost the number of sub requests for logging purposes start interrupting the simultaneous open requests unless an event.waitUntil() and return is coded?

D

dave•2/1/24, 8:31 PM

huh, when my Worker does a

fetch

fetch

to a URL outside of my zone, polish is used...?

Original message was deleted

R

Radoš•2/1/24, 10:35 PM

1) Create

package.json

package.json

file. The main thing you care about is:

...
"type": "module",
"workspaces": [
  "projects/*"
],
"scripts": {
  "stripe-worker": "cd projects/stripe-worker && bun",
  "main-site": "cd projects/main-site && bun",
  "mail-worker": "cd projects/mail-worker && bun"
},
...

...
"type": "module",
"workspaces": [
  "projects/*"
],
"scripts": {
  "stripe-worker": "cd projects/stripe-worker && bun",
  "main-site": "cd projects/main-site && bun",
  "mail-worker": "cd projects/mail-worker && bun"
},
...

...
"type": "module",
"workspaces": [
  "projects/*"
],
"scripts": {
  "stripe-worker": "cd projects/stripe-worker && bun",
  "main-site": "cd projects/main-site && bun",
  "mail-worker": "cd projects/mail-worker && bun"
},
...

...
"type": "module",
"workspaces": [
  "projects/*"
],
"scripts": {
  "stripe-worker": "cd projects/stripe-worker && bun",
  "main-site": "cd projects/main-site && bun",
  "mail-worker": "cd projects/mail-worker && bun"
},
...

2) Create a projects dir in the root with desired project folders. Each folder will have whatever code you need
3) Adjust

scripts

scripts

. In my case I use bun as why not. No need for pnpm workspace as this works the same if not better.
4) Terminal

bun main-site install

bun main-site install

or

bun install

bun install

depends on what you want to do.
5) Adjust

scripts

scripts

in

package.json

package.json

so you can do something like

bun main-site deploy

bun main-site deploy

or

bun mail-worker dev

bun mail-worker dev

No need to overcomplicate this. Use common libs in the root

package.json

package.json

and let bun to handle the rest.

K

kayo•2/1/24, 11:12 PM

Hey, is Workers a SaaS thing or a FaaS?

C

Chaika•2/1/24, 11:27 PM

FaaS

J

Justintime•2/1/24, 11:28 PM

does anyone know a workaround for the following

workers.api.error.malformed_param: must specify either 'script' or 'service' [code: 10004]

workers.api.error.malformed_param: must specify either 'script' or 'service' [code: 10004]

B

bun•2/2/24, 12:57 AM

@Chaika i honestly would prefer to do this with r2 + cache. but im not sure how the cache thing works exactly? i get that cloudflare has some cache but how accessible is it to workers? and most importantly whats with the weird cache accessing syntax? i couldnt get it to work, i would get cache miss everytime

Bbun @Chaika i honestly would prefer to do this with r2 + cache. but im not sure how ...

C

Chaika•2/2/24, 12:58 AM

Sounds like you were trying to use Workers? With R2, you would be best off with just an R2 Custom Domain and a Cache rule to force it

B

bun•2/2/24, 12:58 AM

yeah i have a custom r2 domain, but when doing bindings is that domain used ?

C

Chaika•2/2/24, 12:58 AM

If you use an R2 Custom Domain then you wouldn't pay for Worker Invocations and any cache hits are free

Bbun yeah i have a custom r2 domain, but when doing bindings is that domain used ?

C

Chaika•2/2/24, 12:58 AM

what do you mean "when doing bindings"?

B

bun•2/2/24, 12:59 AM

i wasnt accessing r2 storage through fetch on my custom domain. i was accessing them through

wrangler.toml

wrangler.toml

storage bindings

C

Chaika•2/2/24, 1:00 AM

That wouldn't use the Custom domain or cache by default, you'd have to use the cache api yourself

C

Chaika•2/2/24, 1:01 AM

i couldnt get it to work, i would get cache miss everytime

The Cache API doesn't work/will always return miss in a bunch of environments, including dev

However, any Cache API operations in the Cloudflare Workers dashboard editor, Playground previews, and any *.workers.dev deployments will have no impact. For Workers fronted by Cloudflare Access
, the Cache API is not currently available. Only Workers deployed to custom domains have access to functional cache operations.

https://developers.cloudflare.com/workers/runtime-apis/cache/

B

bun•2/2/24, 1:01 AM

yeah i was doing the cache api manually but it wasnt working for some reason

B

bun•2/2/24, 1:01 AM

yeah my workers were also deployed with custom domains

B

bun•2/2/24, 1:01 AM

i can show you my code if that will help

C

Chaika•2/2/24, 1:01 AM

Sure

B

bun•2/2/24, 1:02 AM

app.use("*", async (c, next) => {
  const t = performance.now();
  const cache = caches.default;

  const cacheUrl = new URL(c.req.url);

  const cacheKey = new Request(cacheUrl.toString(), c.req);

  let response = await cache.match(cacheKey);

  if (response) {
    c.env.myData = { cachedData: await response.json() };
    console.log("cache hit", performance.now() - t);
    return next();
  }

  const object = await c.env.MY_R2_STORAGE.get("some-data.json");

  if (!object) {
    throw new Error("Data not found");
  }

  const headers = new Headers();

  object.writeHttpMetadata(headers);
  headers.set("etag", object.httpEtag);
  const status = object.body ? 200 : 304;

  const [body1, body2] = object.body.tee();

  response = new Response(body1, {
    headers,
    status,
  });

  response.headers.append("Cache-Control", "s-maxage=31536000");

  c.executionCtx.waitUntil(cache.put(cacheKey, response));

  if (!cachedData) {
    throw new Error("Data not found");
  }

  c.env.myData = { cachedData: await streamToJson(body2) };

  console.log("cache miss", performance.now() - t);

  return next();
});

app.use("*", async (c, next) => {
  const t = performance.now();
  const cache = caches.default;

  const cacheUrl = new URL(c.req.url);

  const cacheKey = new Request(cacheUrl.toString(), c.req);

  let response = await cache.match(cacheKey);

  if (response) {
    c.env.myData = { cachedData: await response.json() };
    console.log("cache hit", performance.now() - t);
    return next();
  }

  const object = await c.env.MY_R2_STORAGE.get("some-data.json");

  if (!object) {
    throw new Error("Data not found");
  }

  const headers = new Headers();

  object.writeHttpMetadata(headers);
  headers.set("etag", object.httpEtag);
  const status = object.body ? 200 : 304;

  const [body1, body2] = object.body.tee();

  response = new Response(body1, {
    headers,
    status,
  });

  response.headers.append("Cache-Control", "s-maxage=31536000");

  c.executionCtx.waitUntil(cache.put(cacheKey, response));

  if (!cachedData) {
    throw new Error("Data not found");
  }

  c.env.myData = { cachedData: await streamToJson(body2) };

  console.log("cache miss", performance.now() - t);

  return next();
});

app.use("*", async (c, next) => {
  const t = performance.now();
  const cache = caches.default;

  const cacheUrl = new URL(c.req.url);

  const cacheKey = new Request(cacheUrl.toString(), c.req);

  let response = await cache.match(cacheKey);

  if (response) {
    c.env.myData = { cachedData: await response.json() };
    console.log("cache hit", performance.now() - t);
    return next();
  }

  const object = await c.env.MY_R2_STORAGE.get("some-data.json");

  if (!object) {
    throw new Error("Data not found");
  }

  const headers = new Headers();

  object.writeHttpMetadata(headers);
  headers.set("etag", object.httpEtag);
  const status = object.body ? 200 : 304;

  const [body1, body2] = object.body.tee();

  response = new Response(body1, {
    headers,
    status,
  });

  response.headers.append("Cache-Control", "s-maxage=31536000");

  c.executionCtx.waitUntil(cache.put(cacheKey, response));

  if (!cachedData) {
    throw new Error("Data not found");
  }

  c.env.myData = { cachedData: await streamToJson(body2) };

  console.log("cache miss", performance.now() - t);

  return next();
});

app.use("*", async (c, next) => {
  const t = performance.now();
  const cache = caches.default;

  const cacheUrl = new URL(c.req.url);

  const cacheKey = new Request(cacheUrl.toString(), c.req);

  let response = await cache.match(cacheKey);

  if (response) {
    c.env.myData = { cachedData: await response.json() };
    console.log("cache hit", performance.now() - t);
    return next();
  }

  const object = await c.env.MY_R2_STORAGE.get("some-data.json");

  if (!object) {
    throw new Error("Data not found");
  }

  const headers = new Headers();

  object.writeHttpMetadata(headers);
  headers.set("etag", object.httpEtag);
  const status = object.body ? 200 : 304;

  const [body1, body2] = object.body.tee();

  response = new Response(body1, {
    headers,
    status,
  });

  response.headers.append("Cache-Control", "s-maxage=31536000");

  c.executionCtx.waitUntil(cache.put(cacheKey, response));

  if (!cachedData) {
    throw new Error("Data not found");
  }

  c.env.myData = { cachedData: await streamToJson(body2) };

  console.log("cache miss", performance.now() - t);

  return next();
});

B

bun•2/2/24, 1:04 AM

as you can see i was using same

cacheKey

cacheKey

for both

cache.match

cache.match

and

cache.put

cache.put

. however it was always a miss

B

bun•2/2/24, 1:05 AM

im super confused on why

Request

Request

constructed from

request.url

request.url

has to be the cache key

C

Chaika•2/2/24, 1:08 AM

Its built on top of the normal cdn cache

C

Chaika•2/2/24, 1:09 AM

it could be a valid url that isn't in your zone as long as it's not another cf website, some people use example.invalid or stuf like that

C

Chaika•2/2/24, 1:09 AM

if you pass it a request with headers though it respects some of them: https://developers.cloudflare.com/workers/runtime-apis/cache/#parameters-1

Cache · Cloudflare Workers docs

Control reading and writing from the Cloudflare global network cache.

C

Chaika•2/2/24, 1:21 AM

I don't see anything wrong with that code though as long as it is running on a custom domain/route on your own domain (i.e not the workers.dev, not behind access.
It just never returns hit on your end?
I would question though if it's the same response json, why are you having it differ by url?

B

bun•2/2/24, 1:24 AM

differ by url? you mean

const cacheUrl = new URL(c.req.url)

const cacheUrl = new URL(c.req.url)

?

B

bun•2/2/24, 1:24 AM

yeah i was just super confused by this methodology of caching something so while trying to make it work i just didnt question it and made it as close to the documentation example as possible

B

bun•2/2/24, 1:25 AM

const request = await fetch("https://r2.sunney.dev/data.json", {
    cf: {
      cacheTtl: 60 * 60 * 24,
      cacheEverything: true,
      cacheKey: someCustomKey,
    },
  }).then((res) => res.json());

const request = await fetch("https://r2.sunney.dev/data.json", {
    cf: {
      cacheTtl: 60 * 60 * 24,
      cacheEverything: true,
      cacheKey: someCustomKey,
    },
  }).then((res) => res.json());

const request = await fetch("https://r2.sunney.dev/data.json", {
    cf: {
      cacheTtl: 60 * 60 * 24,
      cacheEverything: true,
      cacheKey: someCustomKey,
    },
  }).then((res) => res.json());

const request = await fetch("https://r2.sunney.dev/data.json", {
    cf: {
      cacheTtl: 60 * 60 * 24,
      cacheEverything: true,
      cacheKey: someCustomKey,
    },
  }).then((res) => res.json());

this works well enough

Will try to do, but is it the only way to find out if my execution was terminated early?

Similar Threads

Similar Threads

Similar Threads