oh I would also like to see number of connections from Hyperdrive to the origin database. It'd be f

oh I would also like to see number of connections from Hyperdrive to the origin database.

It'd be fun to see "connections" from Workers to Hyperdrive too, but maybe not that useful.

Ddave oh I would also like to see number of connections from Hyperdrive to the origin ...

thomasgauvin•2/14/25, 5:03 PM

@Emilio this is what we were discussing

DaniFoldi•2/14/25, 6:38 PM

I can see both parts being interesting especially when combined with transactions, so it's easy to spot if there are bottlenecks there

fforres•2/16/25, 3:35 AM

Hey folks. anyone has had success connecting to a fly.io hosted postgress via a tunnel?

I setup an app with cloudflaredcloudflared and i'm able to define some hostnames and connect to them (a demo website running on 8080)

But I'm not able to connect hyperdrive to it via the tunnel.
(Following this https://developers.cloudflare.com/hyperdrive/configuration/connect-to-private-database/#3-create-an-access-application-to-secure-the-tunnel)

However...if I setup a public IP and hit that directly... I can?

Cloudflare Docs

Connect to a private database using Tunnel · Hyperdrive

Hyperdrive can securely connect to your private databases using Cloudflare Tunnel and Cloudflare Access.

AJR•2/16/25, 12:04 PM

Interesting. I haven't tested with fly personally. Are you able to get it working with just psql across an arbitrary TCP tunnel to your DB, no hyperdrive in the loop?

My guess would be that the connectivity from your tunnel egress to your origin database isn't there, so cloudflared can't reach postgres

fforres•2/17/25, 2:36 AM

seems to be the case @AJR
was right now pinging the fly.io folks also https://community.fly.io/t/cloudflared-tunnel-and-postgres/23927/4

if I setup a public IP on the DB, and connect via a xxxx.fly.dev url, i am able to connect with hyperdrive (no tunnel, same credentials).

and SSHing into another different machine in the same internal network, and runnning a psql into the db with the internal URL worksl (psql postgres://user:pass@database.internal/db-namepsql postgres://user:pass@database.internal/db-name)

But the issue comes from setting up the tunnel and not being able to hit the DB.

Fly.io

Cloudflared Tunnel and Postgres

It might help if you could say more about your Postgres instance, why TLS is a hard requirement in this context, and the full details of the connection strings have been tried so far: both the cases that succeeded and the cases that failed. (* out any passwords, of course—and feel free to do the same for any names that you consider sensitive—b...

daveOP•2/17/25, 3:05 PM

Does using now()now() break caching?

Ddave Does using `now()` break caching?

AJR•2/17/25, 4:35 PM

Yes. Any volatile function will disable caching for that query.

AJR•2/17/25, 4:37 PM

You can check in the pg_procpg_proc catalog table what the provolatileprovolatile designation for any given function is, if needed.

iano•2/17/25, 7:40 PM

We have started seeing an increased number of Error: write CONNECTION_CLOSED <id>.hyperdrive.local:5432Error: write CONNECTION_CLOSED <id>.hyperdrive.local:5432 which look like peer timeouts from our DB side in the last couple of weeks (maybe more recently?)

rsidhaarth•2/18/25, 5:16 PM

Hi All, any idea when we can expect MySQL support

Rrsidhaarth Hi All, any idea when we can expect MySQL support

AJR•2/18/25, 5:53 PM

hyperdrive

AJR•2/18/25, 5:54 PM

Soon!

dan•2/19/25, 8:57 PM

is sthe new pool placement system live yet?

Ddan is sthe new pool placement system live yet?

AJR•2/19/25, 10:22 PM

For all new or updated Hyperdrives, yes. Also, we've begun backfilling to existing Hyperdrives. If you want yours bumped to the front of the line, just toss the ID here or in a DM and I'm happy to do so.

daveOP•2/21/25, 8:31 PM

Is Hyperdrive a transaction, session, or statement pooler?

AJR•2/21/25, 8:35 PM

Transaction-mode pooler.

daveOP•2/21/25, 8:40 PM

Thank you!

Niveth•2/24/25, 3:05 PM

Does Hyperdrive maintains connection on BOM or DEL datacenters ?

Our application is facing 3x to 5x higher latency compared to direct connection to the database.

Database is hosted on ap-south-1 (Nearby to BOM datacenter)

For context we have both cloudflare pro and workers paid account.

AJR•2/24/25, 3:06 PM

Send me the ID for your hyperdrive, let me take a look.

NNiveth Does Hyperdrive maintains connection on BOM or DEL datacenters ? Our applicatio...

AJR•2/24/25, 3:16 PM

Ah, just dug into this a bit. With legacy regional pooling we were not able to maintain connections in BOM datacenters, but I believe we should be able to lift that restriction for the new global pools. Let me talk to the team about getting that changed in our next release.

In the meantime, if you send me your IDs I will manually place them into our BOM datacenters for you.

AAJR Ah, just dug into this a bit. With legacy regional pooling we were not able to ...

Niveth•2/24/25, 6:08 PM

Sorry it took time to reply, I really appreciate you helping me with this. Thanks!

I have two hyperdrive config. One got created few months back

75199f96334c42559f89fe73965875e875199f96334c42559f89fe73965875e8

Another hyperdrive I have created just now,

7ae2159c8f4e4c77bf037815e02e89957ae2159c8f4e4c77bf037815e02e8995

Let me know which hyperdrive you are able to place in on

NNiveth Sorry it took time to reply, I really appreciate you helping me with this. Thank...

AJR•2/24/25, 6:35 PM

No worries, thank you for bringing this to our attention.

Both of those will now run correctly out of our BOM data centers. Please let me know how it looks for you.

AAJR No worries, thank you for bringing this to our attention. Both of those will no...

Niveth•2/24/25, 6:46 PM

It looks amazing,

Latency for the initial request went down from 600-800ms (old hyperdrive config) to 30-50ms.

AJR•2/24/25, 7:00 PM

You love to see it.

Good luck building!

ATSHUW•2/25/25, 3:11 PM

hello gys, i want to know if i can use Hyperdrive without workers, with normal nodejs app?

AATSHUW hello gys, i want to know if i can use Hyperdrive without workers, with normal n...

AJR•2/25/25, 3:18 PM

No, that is not something we currently support, I'm afraid.

CC @thomasgauvin

Jikyu•2/25/25, 8:08 PM

I'd like to use Neon with Hyperdrive, but I see conflicting documentation whether to turn on/off Neon's own pooling.

Cloudflare's docs says to turn it off:
https://developers.cloudflare.com/hyperdrive/examples/neon/#:~:text=uncheck%20the%20connection%20pooling

Neon's docs says to turn it on:
https://neon.tech/blog/hyperdrive-neon-faq#so-should-i-use-hyperdrive-together-with-neons-pooling

WHO DO I TRUST

AJR•2/25/25, 8:08 PM

Since you're asking in the Hyperdrive discord, I vote you trust us

AJR•2/25/25, 8:10 PM

Serious answer: if it works for you with both, it's fine to have it on. We discourage it because it isn't going to make a ton of difference for most users, and adds a lot of complexity to your traffic flow. In particular the poolers for some hosting services really struggle with prepared statements, and some popular JS/Rust postgres drivers make very heavy use of those.

Jikyu•2/25/25, 8:10 PM

Thank you for the answer!!

AgentCord•2/27/25, 4:01 PM

Guys, why is this query not cached, is it possible to cache usersusers?

It is fetching a user based on a provided API key, updating API key's "lastCall" field, and returning the user info:

WITH updated_keys AS (
  UPDATE keys
  SET "lastCall" = NOW()
  WHERE "key" = ${token} 
  RETURNING "key", "userId"
)
SELECT 
  uk.key,
  u.id      AS user_id,
  u.balance AS user_balance,
  u.mail    AS user_mail
FROM updated_keys uk
JOIN users u ON uk."userId" = u.id;

WITH updated_keys AS (
  UPDATE keys
  SET "lastCall" = NOW()
  WHERE "key" = ${token} 
  RETURNING "key", "userId"
)
SELECT 
  uk.key,
  u.id      AS user_id,
  u.balance AS user_balance,
  u.mail    AS user_mail
FROM updated_keys uk
JOIN users u ON uk."userId" = u.id;

AJR•2/27/25, 4:40 PM

Two reasons:

an UPDATE statement mutates database state, can't cache that.
the NOW() function is volatile, so that can't be cached either

If you were just querying the SELECT, separate from that CTE, that should cache fine.

kchro3•2/27/25, 7:54 PM

are there any recommendations on how to update hyperdrive if you want to rotate db passwords?

Kkchro3 are there any recommendations on how to update hyperdrive if you want to rotate ...

AJR•2/27/25, 7:55 PM

https://developers.cloudflare.com/hyperdrive/configuration/rotate-credentials/

Cloudflare Docs

Rotating database credentials · Hyperdrive

You can change the connection information and credentials of your Hyperdrive configuration in one of two ways:

Walshy•2/27/25, 7:57 PM

@Hyperdrive ^

Isaac McFadyen•2/27/25, 8:14 PM

@Nick I remember you asking about this before ^

JJikyu I'd like to use Neon with Hyperdrive, but I see conflicting documentation whethe...

AJ•2/28/25, 2:05 AM

I think Neon's doc says they do not recommend using Neon's pool with Hyperdrive, which is aligned with Hyperdrive's doc.

Jikyu•2/28/25, 2:06 AM

Yup using hyperdrive with direct connection to Neon, got set up in like 10 minutes and working great

WWalshy @Hyperdrive ^

Xpertfxglobal•2/28/25, 3:32 AM

Hello

Heliodorofl42•3/1/25, 9:33 AM

@Walshy

HHeliodorofl42 @Walshy

Isaac McFadyen•3/1/25, 9:10 PM

?pings

SuperHelpflare•3/1/25, 9:10 PM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

matt•3/2/25, 10:43 AM

does hyperdrive over cloudflared tunnel require dns records?

matt•3/2/25, 10:44 AM

no wait, it seems to want SSL. shouldn't the tunnel already be encrypting traffic?

matt•3/2/25, 10:58 AM

can i use self-signed certs? connection still failing

matt•3/2/25, 10:59 AM

very little info being provided from the web ui just says 403 forbidden

matt•3/2/25, 10:59 AM

cant see any activity in the 2 cloudflared instance logs

matt•3/2/25, 11:02 AM

version of cloudflared is 2024.9.12024.9.1 is that an issue? im using the cloudflare-operator for k8s and unsure how to upgrade the binary

matt•3/2/25, 11:06 AM

code=2015
Failed to connect to the provided database: Connecting to database via Cloudflare Tunnel failed: 403 Forbidden

code=2015
Failed to connect to the provided database: Connecting to database via Cloudflare Tunnel failed: 403 Forbidden

oh I would also like to see number of connections from Hyperdrive to the origin database. It'd be f

Similar Threads

Similar Threads

Similar Threads