Cloudflare Developers•11mo ago

Yes, I'm discover stranger things on stress scenarios.

Lletincho5 Yes, I'm discover stranger things on stress scenarios.

dave•2/11/25, 5:44 PM

hyperdrive

Ddave Neon suggestions without the pooler. https://neon.tech/docs/guides/cloudflare-h...

AJR•2/11/25, 5:48 PM

I, personally, think without the pooler will be a better experience

dave•2/12/25, 2:05 PM

@AJR As a sanity check, when I use the patch API, what happens to existing connections?

Ddave @AJR As a sanity check, when I use the patch API, what happens to existing conne...

AJR•2/12/25, 2:21 PM

In most scenarios, a new pool will be created when you send traffic after the PATCH change to your configuration, and the existing connections will idle and then time out.

AAJR In most scenarios, a new pool will be created when you send traffic after the PA...

dave•2/12/25, 2:30 PM

ah dang, so that would deal with if the database password was expiring (since it would trigger a disconnect on the old pools), but wouldn't be useful for @AJR Hmm, I _think_ I _may_ have found a sadly

letincho5OP•2/12/25, 8:45 PM

Hi, I'm working with Drizzle (node-postgres) + Hyperdrive + Neon, I'm trying with/without pooler's connection string and with/without SSL required in connection string... but, sometimes I receive an error: Connection terminated unexpectedly ... any ideas?

letincho5OP•2/12/25, 8:46 PM

I try with node-postgress pool configuration like: min = 0, idleTimeout=0, etc...

The error appears on stress scenarios (500 request in 10 seconds)

AAJR In most scenarios, a new pool will be created when you send traffic after the PA...

dave•2/13/25, 10:36 PM

been thinking about this more; is there really no way to force close existing connections from the Hyperdrive side of things?

Ddave been thinking about this more; is there really no way to force close existing co...

AJR•2/13/25, 10:38 PM

Well, we'd need to build it. It'd be pretty doable, it's just not something we've had to do before.

AJR•2/13/25, 10:38 PM

But no, we don't currently have a "nuke this pool" button available to us.

AJR•2/13/25, 10:41 PM

Unrelated: we've started teeing up migration of existing Hyperdrives to the new pool placement system. I love my demo page screencaps, so here y'all go.

dave•2/13/25, 10:53 PM

Could we have have the same/similar page that shows the stats like that for our Hyperdrives?

thomasgauvin•2/14/25, 2:33 PM

@dave | ai.moda what do you think of hyperdrive's current analytics on latency? ie what are you looking to get out of this

AAJR I, personally, think without the pooler will be a better experience

thomasgauvin•2/14/25, 2:34 PM

pr incoming

Tthomasgauvin @dave | ai.moda what do you think of hyperdrive's current analytics on latency? ...

dave•2/14/25, 3:17 PM

I'd be curious what my direct to database origin latency would be for this for example.

Ddave I'd be curious what my direct to database origin latency would be for this for e...

AJR•2/14/25, 3:32 PM

If you're in an experimenting mood, you can do vanilla TCP connections to your DB from Workers. It usually goes about as well as the demo page suggests so we don't suggest it, but it'd give you the easy comparison.

https://developers.cloudflare.com/workers/tutorials/postgres/

Cloudflare Docs

Connect to a PostgreSQL database with Cloudflare Workers · Cloudfla...

In this tutorial, you will learn how to create a Cloudflare Workers application and connect it to a PostgreSQL database using TCP Sockets and Hyperdrive. The Workers application you create in this tutorial will interact with a product database inside of PostgreSQL.

AAJR If you're in an experimenting mood, you can do vanilla TCP connections to your D...

dave•2/14/25, 3:33 PM

This is a prod Worker, I don't wanna attempt fate.

Tthomasgauvin @dave | ai.moda what do you think of hyperdrive's current analytics on latency? ...

dave•2/14/25, 4:18 PM

oh I would also like to see number of connections from Hyperdrive to the origin database.

It'd be fun to see "connections" from Workers to Hyperdrive too, but maybe not that useful.

Ddave oh I would also like to see number of connections from Hyperdrive to the origin ...

thomasgauvin•2/14/25, 5:03 PM

@Emilio this is what we were discussing

DaniFoldi•2/14/25, 6:38 PM

I can see both parts being interesting especially when combined with transactions, so it's easy to spot if there are bottlenecks there

fforres•2/16/25, 3:35 AM

Hey folks. anyone has had success connecting to a fly.io hosted postgress via a tunnel?

I setup an app with

cloudflared

cloudflared

and i'm able to define some hostnames and connect to them (a demo website running on 8080)

But I'm not able to connect hyperdrive to it via the tunnel.
(Following this https://developers.cloudflare.com/hyperdrive/configuration/connect-to-private-database/#3-create-an-access-application-to-secure-the-tunnel)

However...if I setup a public IP and hit that directly... I can?

Cloudflare Docs

Connect to a private database using Tunnel · Hyperdrive

Hyperdrive can securely connect to your private databases using Cloudflare Tunnel and Cloudflare Access.

AJR•2/16/25, 12:04 PM

Interesting. I haven't tested with fly personally. Are you able to get it working with just psql across an arbitrary TCP tunnel to your DB, no hyperdrive in the loop?

My guess would be that the connectivity from your tunnel egress to your origin database isn't there, so cloudflared can't reach postgres

fforres•2/17/25, 2:36 AM

seems to be the case @AJR
was right now pinging the fly.io folks also https://community.fly.io/t/cloudflared-tunnel-and-postgres/23927/4

if I setup a public IP on the DB, and connect via a xxxx.fly.dev url, i am able to connect with hyperdrive (no tunnel, same credentials).

and SSHing into another different machine in the same internal network, and runnning a psql into the db with the internal URL worksl (

psql postgres://user:pass@database.internal/db-name

psql postgres://user:pass@database.internal/db-name

)

But the issue comes from setting up the tunnel and not being able to hit the DB.

Fly.io

Cloudflared Tunnel and Postgres

It might help if you could say more about your Postgres instance, why TLS is a hard requirement in this context, and the full details of the connection strings have been tried so far: both the cases that succeeded and the cases that failed. (* out any passwords, of course—and feel free to do the same for any names that you consider sensitive—b...

dave•2/17/25, 3:05 PM

Does using

now()

now()

break caching?

Ddave Does using `now()` break caching?

AJR•2/17/25, 4:35 PM

Yes. Any volatile function will disable caching for that query.

AJR•2/17/25, 4:37 PM

You can check in the

pg_proc

pg_proc

catalog table what the

provolatile

provolatile

designation for any given function is, if needed.

iano•2/17/25, 7:40 PM

We have started seeing an increased number of

Error: write CONNECTION_CLOSED <id>.hyperdrive.local:5432

Error: write CONNECTION_CLOSED <id>.hyperdrive.local:5432

which look like peer timeouts from our DB side in the last couple of weeks (maybe more recently?)

rsidhaarth•2/18/25, 5:16 PM

Hi All, any idea when we can expect MySQL support

Rrsidhaarth Hi All, any idea when we can expect MySQL support

AJR•2/18/25, 5:53 PM

hyperdrive

AJR•2/18/25, 5:54 PM

Soon!

dan•2/19/25, 8:57 PM

is sthe new pool placement system live yet?

Ddan is sthe new pool placement system live yet?

AJR•2/19/25, 10:22 PM

For all new or updated Hyperdrives, yes. Also, we've begun backfilling to existing Hyperdrives. If you want yours bumped to the front of the line, just toss the ID here or in a DM and I'm happy to do so.

dave•2/21/25, 8:31 PM

Is Hyperdrive a transaction, session, or statement pooler?

AJR•2/21/25, 8:35 PM

Transaction-mode pooler.

dave•2/21/25, 8:40 PM

Thank you!

Niveth•2/24/25, 3:05 PM

Does Hyperdrive maintains connection on BOM or DEL datacenters ?

Our application is facing 3x to 5x higher latency compared to direct connection to the database.

Database is hosted on ap-south-1 (Nearby to BOM datacenter)

For context we have both cloudflare pro and workers paid account.

AJR•2/24/25, 3:06 PM

Send me the ID for your hyperdrive, let me take a look.

NNiveth Does Hyperdrive maintains connection on BOM or DEL datacenters ? Our applicatio...

AJR•2/24/25, 3:16 PM

Ah, just dug into this a bit. With legacy regional pooling we were not able to maintain connections in BOM datacenters, but I believe we should be able to lift that restriction for the new global pools. Let me talk to the team about getting that changed in our next release.

In the meantime, if you send me your IDs I will manually place them into our BOM datacenters for you.

AAJR Ah, just dug into this a bit. With legacy regional pooling we were not able to ...

Niveth•2/24/25, 6:08 PM

Sorry it took time to reply, I really appreciate you helping me with this. Thanks!

I have two hyperdrive config. One got created few months back

75199f96334c42559f89fe73965875e8

75199f96334c42559f89fe73965875e8

Another hyperdrive I have created just now,

7ae2159c8f4e4c77bf037815e02e8995

7ae2159c8f4e4c77bf037815e02e8995

Let me know which hyperdrive you are able to place in on

NNiveth Sorry it took time to reply, I really appreciate you helping me with this. Thank...

AJR•2/24/25, 6:35 PM

No worries, thank you for bringing this to our attention.

Both of those will now run correctly out of our BOM data centers. Please let me know how it looks for you.

AAJR No worries, thank you for bringing this to our attention. Both of those will no...

Niveth•2/24/25, 6:46 PM

It looks amazing,

Latency for the initial request went down from 600-800ms (old hyperdrive config) to 30-50ms.

AJR•2/24/25, 7:00 PM

You love to see it.

Good luck building!

ATSHUW•2/25/25, 3:11 PM

hello gys, i want to know if i can use Hyperdrive without workers, with normal nodejs app?

AATSHUW hello gys, i want to know if i can use Hyperdrive without workers, with normal n...

AJR•2/25/25, 3:18 PM

No, that is not something we currently support, I'm afraid.

CC @thomasgauvin

Jikyu•2/25/25, 8:08 PM

I'd like to use Neon with Hyperdrive, but I see conflicting documentation whether to turn on/off Neon's own pooling.

Cloudflare's docs says to turn it off:
https://developers.cloudflare.com/hyperdrive/examples/neon/#:~:text=uncheck%20the%20connection%20pooling

Neon's docs says to turn it on:
https://neon.tech/blog/hyperdrive-neon-faq#so-should-i-use-hyperdrive-together-with-neons-pooling

WHO DO I TRUST

AJR•2/25/25, 8:08 PM

Since you're asking in the Hyperdrive discord, I vote you trust us

AJR•2/25/25, 8:10 PM

Serious answer: if it works for you with both, it's fine to have it on. We discourage it because it isn't going to make a ton of difference for most users, and adds a lot of complexity to your traffic flow. In particular the poolers for some hosting services really struggle with prepared statements, and some popular JS/Rust postgres drivers make very heavy use of those.

Jikyu•2/25/25, 8:10 PM

Thank you for the answer!!

AgentCord•2/27/25, 4:01 PM

Guys, why is this query not cached, is it possible to cache usersusers?

It is fetching a user based on a provided API key, updating API key's "lastCall" field, and returning the user info:

WITH updated_keys AS (
  UPDATE keys
  SET "lastCall" = NOW()
  WHERE "key" = ${token} 
  RETURNING "key", "userId"
)
SELECT 
  uk.key,
  u.id      AS user_id,
  u.balance AS user_balance,
  u.mail    AS user_mail
FROM updated_keys uk
JOIN users u ON uk."userId" = u.id;

WITH updated_keys AS (
  UPDATE keys
  SET "lastCall" = NOW()
  WHERE "key" = ${token} 
  RETURNING "key", "userId"
)
SELECT 
  uk.key,
  u.id      AS user_id,
  u.balance AS user_balance,
  u.mail    AS user_mail
FROM updated_keys uk
JOIN users u ON uk."userId" = u.id;

AJR•2/27/25, 4:40 PM

Two reasons:

an UPDATE statement mutates database state, can't cache that.
the NOW() function is volatile, so that can't be cached either

If you were just querying the SELECT, separate from that CTE, that should cache fine.

WITH updated_keys AS ( UPDATE keys SET "lastCall" = NOW() WHERE "key" = ${token} RETURNING "key", "userId" ) SELECT uk.key, u.id AS user_id, u.balance AS user_balance, u.mail AS user_mail FROM updated_keys uk JOIN users u ON uk."userId" = u.id;

Yes, I'm discover stranger things on stress scenarios.

Similar Threads