exactly!

M

mau•4/18/24, 6:56 PM

I am having issues using crypto with pg (hyperdrive)

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

import crypto from 'node:crypto';

class CryptoCls {
  static hashString(_text?: string): string {
    let hash = '';
    if (_text) {
      hash = crypto.createHash('sha256').update(_text).digest('hex');
    }
    return hash;
  }
}

app.get('/', async (context: Context) => {
  class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);
  const client = new Client(context.env.HYPERDRIVE);
  await client.connect();
  const result = await client.query('SELECT * FROM user_courses');
  return context.json(data);
});

wrangler.toml
compatibility_flags = [ "nodejs_compat" ]

error attached in the file. As soon as i enable

node_compat = true

node_compat = true

node_compat = true

node_compat = true

crypto doesnt work

message.txt9.81KB

M

mau•4/18/24, 6:56 PM

any help?

DDaniFoldi exactly!

Y

Yakuzo•4/18/24, 6:56 PM

Okay nice !

Mmau any help?

D

DaniFoldiOP•4/18/24, 6:58 PM

you should be getting an error that you can't use

node_compat

node_compat

node_compat

node_compat and

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat compatibility flag together
do you need node_compat for anything? pg should work with just the flag

M

mau•4/18/24, 6:58 PM

I need crypto function for implement cache aside pattern using kv

M

mau•4/18/24, 6:58 PM

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

class RedisCacheAside {
    static getHashKey(_filter: any) {
      let retKey = '';
      if (_filter) {
        retKey = 'CACHE_ASIDE_' + CryptoCls.hashString(JSON.stringify(_filter));
      }
      return retKey;
    }
  }
  const query = {
    color: {
      equals: 'mint',
    },
  };
  let data = RedisCacheAside.getHashKey(query);

example

D

DaniFoldiOP•4/18/24, 6:58 PM

you can use that just fine with the flag too

M

mau•4/18/24, 6:59 PM

its not working

M

mau•4/18/24, 6:59 PM

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

✘ [ERROR] TypeError: crypto_default.createHash is not a function

      at CryptoCls.hashString
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/features/common/crypto.ts:7:21)
      at RedisCacheAside.getHashKey
  (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:59:45)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:69:30)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at null.<anonymous> (file:///Users/nicolethomas/Desktop/Membership/hono/src/index.ts:31:9)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)
      at null.<anonymous>
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:30:20)
      at poweredBy2
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/middleware/powered-by/index.js:4:11)
      at dispatch
  (file:///Users/nicolethomas/Desktop/Membership/hono/node_modules/.pnpm/hono@4.2.2/node_modules/hono/dist/compose.js:29:23)

when node_compat = true

M

mau•4/18/24, 7:08 PM

Can i use crypto and pg together?

M

mau•4/18/24, 7:09 PM

node_compat = true
compatibility_flags = [ "nodejs_compat" ]
so confused between these two

M

mau•4/18/24, 7:19 PM

https://developers.cloudflare.com/hyperdrive/examples/aws-rds-aurora/.

Cloudflare Docs

Connect to AWS RDS and Aurora · Hyperdrive

This example shows you how to connect Hyperdrive to an Amazon Relational Database Service (Amazon RDS) Postgres or Amazon Aurora database instance.

M

mau•4/18/24, 7:20 PM

As per documentation it says I need node_compat = true

M

mau•4/18/24, 7:20 PM

Which is not working with crypto

J

James•4/18/24, 8:44 PM

Sadly you can't use

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat and

node_compat

node_compat

node_compat

node_compat together.

node_compat

node_compat

node_compat

node_compat is an old and legacy way for wrangler to inject polyfills and globals that emulate Node.js things.

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat is actually real node.js support for various modules, straight from the runtime. It's the recommended way to do things nowadays.

J

James•4/18/24, 8:44 PM

Sadly Hyperdrive requires

node_compat

node_compat

node_compat

node_compat for the recommended

pg

pg

pg

pg driver today. You can use

postgres.js

postgres.js

postgres.js

postgres.js with

nodejs_compat

nodejs_compat

nodejs_compat

nodejs_compat, but it doesn't have full support with hyperdrive yet, mainly for things like caching.

M

mau•4/18/24, 9:03 PM

I just want to use crypto module

M

mau•4/18/24, 9:03 PM

There is no other way I can do with pg?

M

mau•4/18/24, 9:04 PM

I need that for generating hash and use that for caching the queries using kv

M

mau•4/18/24, 9:04 PM

I appreciate your help.

Mmau I need that for generating hash and use that for caching the queries using kv

I

Isaac McFadyen•4/18/24, 9:12 PM

If this is for non-cryptographic purposes you can use

crypto.subtle

crypto.subtle

crypto.subtle

crypto.subtle which is built into all Workers, even without node compat: https://developers.cloudflare.com/workers/runtime-apis/web-crypto/#digest

I

Isaac McFadyen•4/18/24, 9:12 PM

Just do a

digest

digest

digest

digest using SHA-1

IIsaac McFadyen If this is for non-cryptographic purposes you can use `crypto.subtle` which is b...

I

Iaci•4/18/24, 9:13 PM

exactly this

I

Iaci•4/18/24, 9:13 PM

i use these functions to create SHA-256 hash from a string:

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

async function hashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

M

mau•4/19/24, 1:51 AM

Thanks guys!

M

mau•4/19/24, 1:51 AM

I will give it a try

JJames Sadly Hyperdrive requires `node_compat` for the recommended `pg` driver today. Y...

H

Hebilicious•4/19/24, 7:17 AM

Hey are you sure about this? I'm using the flag and postgres.js with hyperdrive and caching appears to be working (altough there is some other performance issues)

S

Sam•4/19/24, 10:38 AM

Does a call to a RPC function count as an additional request? Or is it "free" to use RPC function within Workers? The docs don't mention this, so I assume it's not being billed. But want to be sure.

SSam Does a call to a RPC function count as an additional request? Or is it "free" to...

H

Hello, I’m Allie!•4/19/24, 10:42 AM

IIRC, a call to function on an RPC Stub is free. A call to a function on a DO/Service Binding Stub is billed

Y

Yakuzo•4/19/24, 2:24 PM

Hi, I have a little problem but I think it's a bug so I'd rather share it. In a dev environment, with one worker communicating with another using RPC, and with an environment variable configuration for dev and prod like this :

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

[env.dev.vars]
API_HOST = "localhost"
API_PORT = "9000"
[env.production.vars]
API_HOST = "engine.corsa.club"
API_PORT = "443"

My Worker A calling Worker B can't find a worker with the name I assigned to Worker B.
Command that works:
npx wrangler dev -c authentification/wrangler.toml --port 9002
Command that doesn't work:
npx wrangler dev -c authentification/wrangler.toml --env dev --port 9002

By adding the "env" property, it no longer finds the Worker

YYakuzo Hi, I have a little problem but I think it's a bug so I'd rather share it. In a ...

K

kian•4/19/24, 2:45 PM

Environments change the name of the Worker

K

kian•4/19/24, 2:45 PM

If you have

name = "foo"

name = "foo"

name = "foo"

name = "foo" and don't specify a name specifically under

env.dev

env.dev

env.dev

env.dev, then that Worker when ran with

--env dev

--env dev

--env dev

--env dev is now called

foo-dev

foo-dev

foo-dev

foo-dev.

K

kian•4/19/24, 2:46 PM

https://developers.cloudflare.com/workers/wrangler/environments/

Kkian If you have `name = "foo"` and don't specify a name specifically under `env.dev`...

Y

Yakuzo•4/19/24, 2:46 PM

Oh okay

Y

Yakuzo•4/19/24, 2:48 PM

Make sense now, thanks

L

Lambo•4/19/24, 8:44 PM

Is it possible to have a scheduled worker call to a HTTP worker via a binding? All the examples I see mention passing on the

request.url

request.url

request.url

request.url when calling

fetch()

fetch()

, which wouldn't exist within the context of a scheduled worker?

L

Lambo•4/19/24, 8:48 PM

Ah okay, thanks!

L

luna•4/20/24, 12:18 AM

is there an expected delay from a request happening to it showing up on the metrics page?

L

luna•4/20/24, 1:09 AM

do tail workers only work for fetch requests?

K

kian•4/20/24, 1:25 AM

Should work for everything - it's the same stuff that powers

wrangler tail

wrangler tail

L

luna•4/20/24, 1:31 AM

hmm.

L

luna•4/20/24, 1:43 AM

do i maybe have it setup wrong?

i have this in my wrangler.toml with the main file exporting fetch, scheduled and queue handlers.

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

[[queues.producers]]
queue = "stats"
binding = "QUEUE"

[[queues.consumers]]
queue = "stats"
max_batch_size = 10
max_batch_timeout = 30

Screenshot_2024-04-20_at_11.12.27_am.png

K

kian•4/20/24, 1:46 AM

And your Tail Worker isn't being invoked?

L

luna•4/20/24, 2:31 AM

nope

L

luna•4/20/24, 3:50 AM

ignore me, i wasnt looking at the correct tab.

O

oof2win2•4/20/24, 7:49 AM

does CF have some product which allows pubsub for clients? i only need sub so i thought of polling and websockets, but was wondering if cf has something better for scale

Z

zegevlier•4/20/24, 9:48 AM

Not an employee, but the startup time you're referring to is the startup limit. As in, your worker needs to be able to start up within that time for it to run at all.

A Worker must be able to be parsed and execute its global scope (top-level code outside of any handlers) within 400 ms. Worker size can impact startup because there is more code to parse and evaluate. Avoiding expensive code in the global scope can keep startup efficient as well.

Z

zegevlier•4/20/24, 9:49 AM

Are you seeing slow cold starts? What promted this question?

Similar Threads