I wouldn't really go that far as to deploy a worker for each api endpoint - you can also get multipl

DDaniFoldi I wouldn't really go that far as to deploy a worker for each api endpoint - you ...

Y

Yakuzo•4/18/24, 6:52 PM

Okay I see, so it would be more for the use of functions that are least used, such as authentication. I'll have to figure out how to do it, but it looks really nice.

YYakuzo Okay I see, so it would be more for the use of functions that are least used, su...

D

DaniFoldiOP•4/18/24, 6:54 PM

yeah I think it makes most sense to separate out bits of your application that you want to update independently

DDaniFoldi yeah I think it makes most sense to separate out bits of your application that y...

Y

Yakuzo•4/18/24, 6:55 PM

So we should see more use of JSRPC to make reusable, easy-to-update "micro-components".

D

DaniFoldiOP•4/18/24, 6:55 PM

exactly!

M

mau•4/18/24, 6:56 PM

I am having issues using crypto with pg (hyperdrive)

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

wrangler.toml
compatibility_flags = [ "nodejs_compat" ]

error attached in the file. As soon as i enable

node_compat = true

node_compat = true

node_compat = true

node_compat = true

crypto doesnt work

message.txt9.81KB

M

mau•4/18/24, 6:56 PM

any help?

DDaniFoldi exactly!

Y

Yakuzo•4/18/24, 6:56 PM

Okay nice !

Mmau any help?

D

DaniFoldiOP•4/18/24, 6:58 PM

you should be getting an error that you can't use

node_compat

node_compat

and

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat compatibility flag together
do you need node_compat for anything? pg should work with just the flag

M

mau•4/18/24, 6:58 PM

I need crypto function for implement cache aside pattern using kv

M

mau•4/18/24, 6:58 PM

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

example

D

DaniFoldiOP•4/18/24, 6:58 PM

you can use that just fine with the flag too

M

mau•4/18/24, 6:59 PM

its not working

M

mau•4/18/24, 6:59 PM

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

when node_compat = true

M

mau•4/18/24, 7:08 PM

Can i use crypto and pg together?

M

mau•4/18/24, 7:09 PM

node_compat = true
compatibility_flags = [ "nodejs_compat" ]
so confused between these two

M

mau•4/18/24, 7:19 PM

https://developers.cloudflare.com/hyperdrive/examples/aws-rds-aurora/.

Cloudflare Docs

Connect to AWS RDS and Aurora · Hyperdrive

This example shows you how to connect Hyperdrive to an Amazon Relational Database Service (Amazon RDS) Postgres or Amazon Aurora database instance.

M

mau•4/18/24, 7:20 PM

As per documentation it says I need node_compat = true

M

mau•4/18/24, 7:20 PM

Which is not working with crypto

J

James•4/18/24, 8:44 PM

Sadly you can't use

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat and

node_compat

node_compat

together.

node_compat

node_compat

is an old and legacy way for wrangler to inject polyfills and globals that emulate Node.js things.

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat is actually real node.js support for various modules, straight from the runtime. It's the recommended way to do things nowadays.

J

James•4/18/24, 8:44 PM

Sadly Hyperdrive requires

node_compat

node_compat

for the recommended

pg

pg

driver today. You can use

postgres.js

postgres.js

postgres.js

postgres.js with

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat, but it doesn't have full support with hyperdrive yet, mainly for things like caching.

M

mau•4/18/24, 9:03 PM

I just want to use crypto module

M

mau•4/18/24, 9:03 PM

There is no other way I can do with pg?

M

mau•4/18/24, 9:04 PM

I need that for generating hash and use that for caching the queries using kv

M

mau•4/18/24, 9:04 PM

I appreciate your help.

Mmau I need that for generating hash and use that for caching the queries using kv

I

Isaac McFadyen•4/18/24, 9:12 PM

If this is for non-cryptographic purposes you can use

crypto.subtle

crypto.subtle

crypto.subtle

crypto.subtle which is built into all Workers, even without node compat: https://developers.cloudflare.com/workers/runtime-apis/web-crypto/#digest

I

Isaac McFadyen•4/18/24, 9:12 PM

Just do a

digest

digest

digest

digest using SHA-1

IIsaac McFadyen If this is for non-cryptographic purposes you can use `crypto.subtle` which is b...

I

Iaci•4/18/24, 9:13 PM

exactly this

I

Iaci•4/18/24, 9:13 PM

i use these functions to create SHA-256 hash from a string:

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

M

mau•4/19/24, 1:51 AM

Thanks guys!

M

mau•4/19/24, 1:51 AM

I will give it a try

JJames Sadly Hyperdrive requires `node_compat` for the recommended `pg` driver today. Y...

H

Hebilicious•4/19/24, 7:17 AM

Hey are you sure about this? I'm using the flag and postgres.js with hyperdrive and caching appears to be working (altough there is some other performance issues)

S

Sam•4/19/24, 10:38 AM

Does a call to a RPC function count as an additional request? Or is it "free" to use RPC function within Workers? The docs don't mention this, so I assume it's not being billed. But want to be sure.

SSam Does a call to a RPC function count as an additional request? Or is it "free" to...

H

Hello, I’m Allie!•4/19/24, 10:42 AM

IIRC, a call to function on an RPC Stub is free. A call to a function on a DO/Service Binding Stub is billed

Y

Yakuzo•4/19/24, 2:24 PM

Hi, I have a little problem but I think it's a bug so I'd rather share it. In a dev environment, with one worker communicating with another using RPC, and with an environment variable configuration for dev and prod like this :

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

My Worker A calling Worker B can't find a worker with the name I assigned to Worker B.
Command that works:
npx wrangler dev -c authentification/wrangler.toml --port 9002
Command that doesn't work:
npx wrangler dev -c authentification/wrangler.toml --env dev --port 9002

By adding the "env" property, it no longer finds the Worker

YYakuzo Hi, I have a little problem but I think it's a bug so I'd rather share it. In a ...

K

kian•4/19/24, 2:45 PM

Environments change the name of the Worker

K

kian•4/19/24, 2:45 PM

If you have

name = "foo"

name = "foo"

name = "foo"

name = "foo" and don't specify a name specifically under

env.dev

env.dev

env.dev

env.dev, then that Worker when ran with

--env dev

--env dev

--env dev

--env dev is now called

foo-dev

foo-dev

foo-dev

foo-dev.

K

kian•4/19/24, 2:46 PM

https://developers.cloudflare.com/workers/wrangler/environments/

Kkian If you have `name = "foo"` and don't specify a name specifically under `env.dev`...

Y

Yakuzo•4/19/24, 2:46 PM

Oh okay

Y

Yakuzo•4/19/24, 2:48 PM

Make sense now, thanks

L

Lambo•4/19/24, 8:44 PM

Is it possible to have a scheduled worker call to a HTTP worker via a binding? All the examples I see mention passing on the

request.url

request.url

request.url

request.url when calling

fetch()

fetch()

, which wouldn't exist within the context of a scheduled worker?

L

Lambo•4/19/24, 8:48 PM

Ah okay, thanks!

L

luna•4/20/24, 12:18 AM

is there an expected delay from a request happening to it showing up on the metrics page?

L

luna•4/20/24, 1:09 AM

do tail workers only work for fetch requests?

K

kian•4/20/24, 1:25 AM

Should work for everything - it's the same stuff that powers

wrangler tail

wrangler tail

L

luna•4/20/24, 1:31 AM

hmm.

L

luna•4/20/24, 1:43 AM

do i maybe have it setup wrong?

i have this in my wrangler.toml with the main file exporting fetch, scheduled and queue handlers.

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

Screenshot_2024-04-20_at_11.12.27_am.png

K

kian•4/20/24, 1:46 AM

And your Tail Worker isn't being invoked?

L

luna•4/20/24, 2:31 AM

nope

L

luna•4/20/24, 3:50 AM

ignore me, i wasnt looking at the correct tab.

I wouldn't really go that far as to deploy a worker for each api endpoint - you can also get multipl

Similar Threads

Similar Threads

Similar Threads