Hi, after discovering JSRPC I have a few questions. I have a few unclear points about it. Is the sim

YYakuzo Hi, after discovering JSRPC I have a few questions. I have a few unclear points ...

D

DaniFoldi•4/18/24, 6:20 PM

let me try and answer all your questions in one go haha

yes, check the docs for how to import and link stuff, should be pretty simple
yes, jsrpc is between multiple workers - although you can bind a worker to itself, and use a different entrypoint, but that usually has other usecases (that require recursion or another 1000 subrequests)
I don't actually think there are many best practices around it yet, it's so new; the way I'd structure it is to have a few entrypoints (with route patterns) that do similar stuff (like one worker for main api, and a few more for any special functions such as webhooks if you have them), and pass them through a few other workers that handle CORS, auth, rate limiting, etc, and then business logic; you should be able to use jsrpc for all these, light and heavy tasks alike

DDaniFoldi let me try and answer all your questions in one go haha 1. yes, check the docs f...

Y

YakuzoOP•4/18/24, 6:30 PM

Sorry for the complex question ( or rather questions ), it's true that rereading it wasn't easy to understand so gg.
Okay I'm starting to understand in this case. So yeah, if I start with a monorepo with one worker per API function, the repository will start to be titanic with each time the nodes modules to replicate for each worker.
It's actually quite new for Cloudflare but also for me, so I'm trying to figure out what would be the most optimized use case, knowing that reading the documentation, inter-worker requests look really fast, so I'm going to have to find a good use case.

D

DaniFoldi•4/18/24, 6:38 PM

I wouldn't really go that far as to deploy a worker for each api endpoint - you can also get multiple entrypoints per worker, which might be faster.

From optimization perspective, today, you're still charged for subrequests, which multiply your bill (there was a tweet but I couldn't find it now saying that those would be gone :soontm:), and loading workers into memory might take time, so at one end of the spectrum, you have DX, at the other end you have low cost (today) and tiny speed improvement

DDaniFoldi I wouldn't really go that far as to deploy a worker for each api endpoint - you ...

Y

YakuzoOP•4/18/24, 6:52 PM

Okay I see, so it would be more for the use of functions that are least used, such as authentication. I'll have to figure out how to do it, but it looks really nice.

YYakuzo Okay I see, so it would be more for the use of functions that are least used, su...

D

DaniFoldi•4/18/24, 6:54 PM

yeah I think it makes most sense to separate out bits of your application that you want to update independently

DDaniFoldi yeah I think it makes most sense to separate out bits of your application that y...

Y

YakuzoOP•4/18/24, 6:55 PM

So we should see more use of JSRPC to make reusable, easy-to-update "micro-components".

D

DaniFoldi•4/18/24, 6:55 PM

exactly!

M

mau•4/18/24, 6:56 PM

I am having issues using crypto with pg (hyperdrive)

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

wrangler.toml
compatibility_flags = [ "nodejs_compat" ]

error attached in the file. As soon as i enable

node_compat = true

node_compat = true

node_compat = true

node_compat = true

crypto doesnt work

message.txt9.81KB

M

mau•4/18/24, 6:56 PM

any help?

DDaniFoldi exactly!

Y

YakuzoOP•4/18/24, 6:56 PM

Okay nice !

Mmau any help?

D

DaniFoldi•4/18/24, 6:58 PM

you should be getting an error that you can't use

node_compat

node_compat

and

nodejs_compat

nodejs_compat

compatibility flag together
do you need node_compat for anything? pg should work with just the flag

M

mau•4/18/24, 6:58 PM

I need crypto function for implement cache aside pattern using kv

M

mau•4/18/24, 6:58 PM

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

example

D

DaniFoldi•4/18/24, 6:58 PM

you can use that just fine with the flag too

M

mau•4/18/24, 6:59 PM

its not working

M

mau•4/18/24, 6:59 PM

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

when node_compat = true

M

mau•4/18/24, 7:08 PM

Can i use crypto and pg together?

M

mau•4/18/24, 7:09 PM

node_compat = true
compatibility_flags = [ "nodejs_compat" ]
so confused between these two

M

mau•4/18/24, 7:19 PM

https://developers.cloudflare.com/hyperdrive/examples/aws-rds-aurora/.

Cloudflare Docs

Connect to AWS RDS and Aurora · Hyperdrive

This example shows you how to connect Hyperdrive to an Amazon Relational Database Service (Amazon RDS) Postgres or Amazon Aurora database instance.

M

mau•4/18/24, 7:20 PM

As per documentation it says I need node_compat = true

M

mau•4/18/24, 7:20 PM

Which is not working with crypto

J

James•4/18/24, 8:44 PM

Sadly you can't use

nodejs_compat

nodejs_compat

and

node_compat

node_compat

together.

node_compat

node_compat

is an old and legacy way for wrangler to inject polyfills and globals that emulate Node.js things.

nodejs_compat

nodejs_compat

is actually real node.js support for various modules, straight from the runtime. It's the recommended way to do things nowadays.

J

James•4/18/24, 8:44 PM

Sadly Hyperdrive requires

node_compat

node_compat

for the recommended

pg

pg

driver today. You can use

postgres.js

postgres.js

postgres.js

postgres.js with

nodejs_compat

nodejs_compat

, but it doesn't have full support with hyperdrive yet, mainly for things like caching.

M

mau•4/18/24, 9:03 PM

I just want to use crypto module

M

mau•4/18/24, 9:03 PM

There is no other way I can do with pg?

M

mau•4/18/24, 9:04 PM

I need that for generating hash and use that for caching the queries using kv

M

mau•4/18/24, 9:04 PM

I appreciate your help.

Mmau I need that for generating hash and use that for caching the queries using kv

I

Isaac McFadyen•4/18/24, 9:12 PM

If this is for non-cryptographic purposes you can use

crypto.subtle

crypto.subtle

crypto.subtle

crypto.subtle which is built into all Workers, even without node compat: https://developers.cloudflare.com/workers/runtime-apis/web-crypto/#digest

I

Isaac McFadyen•4/18/24, 9:12 PM

Just do a

digest

digest

digest

digest using SHA-1

IIsaac McFadyen If this is for non-cryptographic purposes you can use `crypto.subtle` which is b...

I

Iaci•4/18/24, 9:13 PM

exactly this

I

Iaci•4/18/24, 9:13 PM

i use these functions to create SHA-256 hash from a string:

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

M

mau•4/19/24, 1:51 AM

Thanks guys!

M

mau•4/19/24, 1:51 AM

I will give it a try

JJames Sadly Hyperdrive requires `node_compat` for the recommended `pg` driver today. Y...

H

Hebilicious•4/19/24, 7:17 AM

Hey are you sure about this? I'm using the flag and postgres.js with hyperdrive and caching appears to be working (altough there is some other performance issues)

S

Sam•4/19/24, 10:38 AM

Does a call to a RPC function count as an additional request? Or is it "free" to use RPC function within Workers? The docs don't mention this, so I assume it's not being billed. But want to be sure.

SSam Does a call to a RPC function count as an additional request? Or is it "free" to...

H

Hello, I’m Allie!•4/19/24, 10:42 AM

IIRC, a call to function on an RPC Stub is free. A call to a function on a DO/Service Binding Stub is billed

Y

YakuzoOP•4/19/24, 2:24 PM

Hi, I have a little problem but I think it's a bug so I'd rather share it. In a dev environment, with one worker communicating with another using RPC, and with an environment variable configuration for dev and prod like this :

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

My Worker A calling Worker B can't find a worker with the name I assigned to Worker B.
Command that works:
npx wrangler dev -c authentification/wrangler.toml --port 9002
Command that doesn't work:
npx wrangler dev -c authentification/wrangler.toml --env dev --port 9002

By adding the "env" property, it no longer finds the Worker

YYakuzo Hi, I have a little problem but I think it's a bug so I'd rather share it. In a ...

K

kian•4/19/24, 2:45 PM

Environments change the name of the Worker

K

kian•4/19/24, 2:45 PM

If you have

name = "foo"

name = "foo"

name = "foo"

name = "foo" and don't specify a name specifically under

env.dev

env.dev

env.dev

env.dev, then that Worker when ran with

--env dev

--env dev

--env dev

--env dev is now called

foo-dev

foo-dev

foo-dev

foo-dev.

K

kian•4/19/24, 2:46 PM

https://developers.cloudflare.com/workers/wrangler/environments/

Kkian If you have `name = "foo"` and don't specify a name specifically under `env.dev`...

Y

YakuzoOP•4/19/24, 2:46 PM

Oh okay

Y

YakuzoOP•4/19/24, 2:48 PM

Make sense now, thanks

L

Lambo•4/19/24, 8:44 PM

Is it possible to have a scheduled worker call to a HTTP worker via a binding? All the examples I see mention passing on the

request.url

request.url

request.url

request.url when calling

fetch()

fetch()

fetch()

fetch(), which wouldn't exist within the context of a scheduled worker?

L

Lambo•4/19/24, 8:48 PM

Ah okay, thanks!

L

luna•4/20/24, 12:18 AM

is there an expected delay from a request happening to it showing up on the metrics page?

L

luna•4/20/24, 1:09 AM

do tail workers only work for fetch requests?

K

kian•4/20/24, 1:25 AM

Should work for everything - it's the same stuff that powers

wrangler tail

wrangler tail

wrangler tail

wrangler tail

L

luna•4/20/24, 1:31 AM

hmm.

L

luna•4/20/24, 1:43 AM

do i maybe have it setup wrong?

i have this in my wrangler.toml with the main file exporting fetch, scheduled and queue handlers.

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

Screenshot_2024-04-20_at_11.12.27_am.png

Hi, after discovering JSRPC I have a few questions. I have a few unclear points about it. Is the sim

Similar Threads