any idea what this is ``` ✘ [ERROR] workerd/jsg/setup.c++:508: error: CODE_MOVED for unknown code bl

KKTibow any idea what this is ``` ✘ [ERROR] workerd/jsg/setup.c++:508: error: CODE_MOVED...

I

Isaac McFadyen•4/17/24, 10:04 PM

https://github.com/cloudflare/workerd/issues/1472

I

Isaac McFadyen•4/17/24, 10:05 PM

TLDR: you can ignore it.

[...] This message is not really an error, at least not one that's relevant to most people. [...] There's actually no impact for workerd users since this information is only used when generating crash dumps in our internal codebase.

J

James•4/17/24, 10:28 PM

it'll also be hidden from userland output in the near future via wrangler too: https://github.com/cloudflare/workers-sdk/pull/5626

JJames it'll also be hidden from userland output in the near future via wrangler too: h...

I

Isaac McFadyen•4/17/24, 10:37 PM

Oh nice, I didn't catch that one.

C

Caleb•4/17/24, 11:16 PM

So im using the free workers plan which limits workers to 10ms

C

Caleb•4/17/24, 11:17 PM

C

Caleb•4/17/24, 11:17 PM

how is this possible

CCaleb Click to see attachment

C

Chaika•4/18/24, 12:14 AM

short answer: If you have more requests in a short period you will quickly overrun your cpu limit
Long answer: How are CPU limits enforced in the free tier?

I

Isaac McFadyen•4/18/24, 12:36 AM

?cpu-time-overage made it a tag

F

Flare•4/18/24, 12:36 AM

See this message from the lead Workers engineer on how you can sometimes consume CPU time over 10ms on the free plan: https://canary.discord.com/channels/595317990191398933/1204401951026974780/1204805369658867752

V

Vikash•4/18/24, 5:55 AM

How to using caching on code-level? I need to cache the

getAuthUser(userId)

getAuthUser(userId)

getAuthUser(userId)

getAuthUser(userId) function result on code level to avoid querying D1 again and again.

So, I built a get/set caching funcotion using a fake url, user/1, user/2 etc. But it doesn't seems to be working and I see undefined in response.

export const getCached = async (request: HonoRequest, key: string) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });

  const cache = caches.default;
  const response = await cache.match(cacheKey);
  console.log('r', response);
  if (response) {
    const json = await response.json();
    console.log('json', json);
  }
};

export const setCached = async (
  request: HonoRequest,
  key: string,
  data: any
) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });
  const cache = caches.default;
  const response = new Response(data);
  response.headers.append('Cache-Control', 's-maxage=30');
  await cache.put(cacheKey, response);
};

export const getCached = async (request: HonoRequest, key: string) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });

  const cache = caches.default;
  const response = await cache.match(cacheKey);
  console.log('r', response);
  if (response) {
    const json = await response.json();
    console.log('json', json);
  }
};

export const setCached = async (
  request: HonoRequest,
  key: string,
  data: any
) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });
  const cache = caches.default;
  const response = new Response(data);
  response.headers.append('Cache-Control', 's-maxage=30');
  await cache.put(cacheKey, response);
};

export const getCached = async (request: HonoRequest, key: string) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });

  const cache = caches.default;
  const response = await cache.match(cacheKey);
  console.log('r', response);
  if (response) {
    const json = await response.json();
    console.log('json', json);
  }
};

export const setCached = async (
  request: HonoRequest,
  key: string,
  data: any
) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });
  const cache = caches.default;
  const response = new Response(data);
  response.headers.append('Cache-Control', 's-maxage=30');
  await cache.put(cacheKey, response);
};

export const getCached = async (request: HonoRequest, key: string) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });

  const cache = caches.default;
  const response = await cache.match(cacheKey);
  console.log('r', response);
  if (response) {
    const json = await response.json();
    console.log('json', json);
  }
};

export const setCached = async (
  request: HonoRequest,
  key: string,
  data: any
) => {
  const cacheUrl = new URL(request.url);
  cacheUrl.pathname = '/' + key;

  const cacheKey = new Request(cacheUrl.toString(), {
    method: 'GET',
    cf: {
      cacheEverything: true,
      cacheTtl: 86400,
    },
  });
  const cache = caches.default;
  const response = new Response(data);
  response.headers.append('Cache-Control', 's-maxage=30');
  await cache.put(cacheKey, response);
};

I

Iaci•4/18/24, 12:37 PM

hi all, how am i able to get the ip address of the request source? is it somewhere in the request object? if yes, how am i able to extract that ?

I

Iaci•4/18/24, 12:39 PM

thanks

J

jason•4/18/24, 2:01 PM

https://developers.cloudflare.com/images/transform-images/transform-via-workers/#warning-about-cachekey

Is the cacheKey only available for Enterprise customers for Image Transformations? I'm using a worker to proxy and transform Signed S3 images - so the source URL is unqiue for every request - even though the actual source url is different. I'd like to pass the unsigned version of the source url as the cacheKey to prevent transforming the same image over and over again. Is this possible?

Cloudflare Docs

Transform via Workers · Cloudflare Image Optimization docs

Using Cloudflare Workers to transform with a custom URL scheme gives you powerful programmatic control over every image request.

J

jason•4/18/24, 3:33 PM

@Leo Thanks Leo. Is there pricing available for using the Cache API in a worker? I can't find it.

Jjason @Leo Thanks Leo. Is there pricing available for using the Cache API in a worker?...

H

Hello, I’m Allie!•4/18/24, 3:36 PM

It is free. Max size for cached objects is cached by plan

DDaniFoldi You can definitely host big projects on Workers! With the 10MB size limit of pai...

Y

Yakuzo•4/18/24, 5:22 PM

Hi, after discovering JSRPC I have a few questions. I have a few unclear points about it. Is the simple fact of putting functions that extend WorkerEntrypoint enough to create a kind of "sub-function"? In the RPC documentation on Cloudflare, there is mention of Worker A and Worker B with a configuration in wrangler.toml. I don't quite understand how to set this up. Does this mean that I have to recreate a project to create another worker that I associate with my main worker (my API), or have I misunderstood the usage? Another quick question: is it good practice to put all my controllers used for route logic after validating the query format, or do I really need to set aside more demanding functions using RPC?

YYakuzo Hi, after discovering JSRPC I have a few questions. I have a few unclear points ...

D

DaniFoldi•4/18/24, 6:20 PM

let me try and answer all your questions in one go haha

yes, check the docs for how to import and link stuff, should be pretty simple
yes, jsrpc is between multiple workers - although you can bind a worker to itself, and use a different entrypoint, but that usually has other usecases (that require recursion or another 1000 subrequests)
I don't actually think there are many best practices around it yet, it's so new; the way I'd structure it is to have a few entrypoints (with route patterns) that do similar stuff (like one worker for main api, and a few more for any special functions such as webhooks if you have them), and pass them through a few other workers that handle CORS, auth, rate limiting, etc, and then business logic; you should be able to use jsrpc for all these, light and heavy tasks alike

DDaniFoldi let me try and answer all your questions in one go haha 1. yes, check the docs f...

Y

Yakuzo•4/18/24, 6:30 PM

Sorry for the complex question ( or rather questions ), it's true that rereading it wasn't easy to understand so gg.
Okay I'm starting to understand in this case. So yeah, if I start with a monorepo with one worker per API function, the repository will start to be titanic with each time the nodes modules to replicate for each worker.
It's actually quite new for Cloudflare but also for me, so I'm trying to figure out what would be the most optimized use case, knowing that reading the documentation, inter-worker requests look really fast, so I'm going to have to find a good use case.

D

DaniFoldi•4/18/24, 6:38 PM

I wouldn't really go that far as to deploy a worker for each api endpoint - you can also get multiple entrypoints per worker, which might be faster.

From optimization perspective, today, you're still charged for subrequests, which multiply your bill (there was a tweet but I couldn't find it now saying that those would be gone :soontm:), and loading workers into memory might take time, so at one end of the spectrum, you have DX, at the other end you have low cost (today) and tiny speed improvement

DDaniFoldi I wouldn't really go that far as to deploy a worker for each api endpoint - you ...

Y

Yakuzo•4/18/24, 6:52 PM

Okay I see, so it would be more for the use of functions that are least used, such as authentication. I'll have to figure out how to do it, but it looks really nice.

YYakuzo Okay I see, so it would be more for the use of functions that are least used, su...

D

DaniFoldi•4/18/24, 6:54 PM

yeah I think it makes most sense to separate out bits of your application that you want to update independently

DDaniFoldi yeah I think it makes most sense to separate out bits of your application that y...

Y

Yakuzo•4/18/24, 6:55 PM

So we should see more use of JSRPC to make reusable, easy-to-update "micro-components".

D

DaniFoldi•4/18/24, 6:55 PM

exactly!

M

mau•4/18/24, 6:56 PM

I am having issues using crypto with pg (hyperdrive)

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

wrangler.toml
compatibility_flags = [ "nodejs_compat" ]

error attached in the file. As soon as i enable

node_compat = true

node_compat = true

crypto doesnt work

message.txt9.81KB

M

mau•4/18/24, 6:56 PM

any help?

DDaniFoldi exactly!

Y

Yakuzo•4/18/24, 6:56 PM

Okay nice !

Mmau any help?

D

DaniFoldi•4/18/24, 6:58 PM

you should be getting an error that you can't use

node_compat

node_compat

and

nodejs_compat

nodejs_compat

compatibility flag together
do you need node_compat for anything? pg should work with just the flag

M

mau•4/18/24, 6:58 PM

I need crypto function for implement cache aside pattern using kv

M

mau•4/18/24, 6:58 PM

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

example

D

DaniFoldi•4/18/24, 6:58 PM

you can use that just fine with the flag too

M

mau•4/18/24, 6:59 PM

its not working

M

mau•4/18/24, 6:59 PM

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

when node_compat = true