Cloudflare Developers•12mo ago

Is Hyperdrive (during local dev) known to leak connections?

daveOP•1/7/25, 12:39 AM

Not sure if it’s me, Hyperdrive, or Google Cloud SQL Auth proxy to blame.

Ddave Is Hyperdrive (during local dev) known to leak connections?

AJR•1/7/25, 2:56 PM

No, that is not a known issue.

We do rely on the Postgres server closing connections when they disconnect. If some other component is holding them open after we disconnect, then it's possible you would see that behavior.

AJR•1/7/25, 2:57 PM

We do hold them open idle for 15 minutes, to prevent the overhead of having to spin up a new one after brief periods of inactivity.

Ssam happy new year!! i remember there being a release a few weeks ago that aimed to ...

AJR•1/7/25, 6:33 PM

Just to close the loop, this is now released. Cheers, all.

Maraciuca•1/12/25, 8:54 PM

hiya, im desperately trying to understand how to use drizzle, hyperdrive and nextjs on edge but i swear im not getting past the env.HYPERDRIVE.connectionString step

has anyone dealt with some like this before?

daveOP•1/13/25, 4:44 PM

Should I be using

ctx.waitUntil(sql.end());

ctx.waitUntil(sql.end());

when I'm using Hyperdrive, or should I never use

sql.end()

sql.end()

Ddave Should I be using `ctx.waitUntil(sql.end());` when I'm using Hyperdrive, or shou...

Isaac McFadyen•1/13/25, 4:46 PM

I think it would depend on how you're connecting? Are you making a connection for each Worker request (new client in the

fetch

fetch

each time)?

Isaac McFadyen•1/13/25, 4:46 PM

If so then likely, but if you're using some sort of global/persistent connection then probably not.

IIsaac McFadyen If so then likely, but if you're using some sort of global/persistent connection...

daveOP•1/13/25, 4:46 PM

This is what I'm thinking of doing, putting the session in the global scope..

daveOP•1/13/25, 4:46 PM

not sure if it's a good idea

Ddave not sure if it's a good idea

Isaac McFadyen•1/13/25, 4:47 PM

I've heard mixed things. I think it's probably fine for a new client per request since Hyperdrive is very fast to connect.

Isaac McFadyen•1/13/25, 4:47 PM

Confirmed by an engineer here: https://canary.discord.com/channels/595317990191398933/1150557986239021106/1322396253832609835

IIsaac McFadyen I've heard mixed things. I think it's probably fine for a new client per request...

daveOP•1/13/25, 4:50 PM

so it's not reopening connections on the backend?

Ddave so it's not reopening connections on the backend?

Isaac McFadyen•1/13/25, 4:53 PM

It re-opens connections to Hyperdrive, but Hyperdrive is a Durable Object running near your Worker so that's quite fast. Hyperdrive itself holds open connections even if you call

sql.end()

sql.end()

so you should be good.

daveOP•1/13/25, 5:07 PM

sweet, thanks!

AJR•1/13/25, 6:12 PM

All correct, yep. Not actually a DO, though. It runs as a separate service on our servers.

daveOP•1/13/25, 6:27 PM

In my Worker client, am I restricted to 6 max connections per instance?

Ddave In my Worker client, am I restricted to 6 max connections per instance?

Isaac McFadyen•1/13/25, 6:40 PM

Yes. All of the Postgres drivers (with the exception of like Neon WebSockets or certain non-Hyperdrive) connect via TCP which is subject to the 6 connection limit.

IIsaac McFadyen Yes. All of the Postgres drivers (with the exception of like Neon WebSockets or ...

daveOP•1/13/25, 6:50 PM

Ooo that’s good to know! So I should limit postgres.js to like 5 connections to be safe? (To avoid deadlocking unrelated http requests.)

Ddave Ooo that’s good to know! So I should limit postgres.js to like 5 connections to ...

Isaac McFadyen•1/13/25, 6:55 PM

I'd tentatively say yes unless hyperdrive has an exception applied within the runtime but I presume they do not. @AJR could confirm.

AJR•1/13/25, 6:59 PM

Hyperdrive does not have any exceptions in that way, same 6 connection limit applies here. If you're concerned you might want to set that limit on your postgres.js connection, yes.

daveOP•1/13/25, 7:12 PM

Do PostgreSQL channels work with hyperdrive?

daveOP•1/13/25, 7:13 PM

This stuff.

AJR•1/13/25, 7:15 PM

No, I'm afraid not. It's something I've poked at a little, but it's not likely to get added any time soon, unfortunately.

We document a bit of this here, if it's helpful: https://developers.cloudflare.com/hyperdrive/configuration/how-hyperdrive-works/#unsupported-postgresql-features

Cloudflare Docs

How Hyperdrive works · Hyperdrive

Connecting to traditional centralized databases from Cloudflare's global network which consists of over 300 data center locations

presents a few challenges as queries can originate from any of these locations.

AAJR No, I'm afraid not. It's something I've poked at a little, but it's not likely ...

daveOP•1/13/25, 7:56 PM

ah thank you, I was walking while trying to find that page

Does .execute and .cancel work with Hyperdrive? It's working locally, so not sure if that's a good sign or not. https://github.com/porsager/postgres?tab=readme-ov-file#execute

AJR•1/13/25, 8:03 PM

.execute()

.execute()

does (I believe, that's a Postgres.js internals thing but reading through it there's nothing about what it's doing that shouldn't, it's just firing off an

Execute

Execute

postgres message early, which we support).

.cancel()

.cancel()

does not, Hyperdrive is not able to support query cancellation.

AAJR `.execute()` does (I believe, that's a Postgres.js internals thing but reading t...

daveOP•1/13/25, 8:49 PM

If I do a .cancel(), will an error be thown?

daveOP•1/13/25, 8:49 PM

@AJR Can I get this IP list somewhere?

IP Ranges | Cloudflare

Ddave If I do a .cancel(), will an error be thown?

AJR•1/13/25, 9:08 PM

Yes, it should error out.

AJR•1/13/25, 9:09 PM

Well, it depends on how each individual driver implements it. Reading through the docs for postgres.js it (also) considers cancellations to be best-effort, so it may swallow the errors we throw.

daveOP•1/14/25, 2:40 AM

During local dev, is Hyperdrive supposed to do connection pooling?

Ddave During local dev, is Hyperdrive supposed to do connection pooling?

Hello, I’m Allie!•1/14/25, 2:40 AM

I forget, isn’t Hyperdrive completely disabled in local?

Hello, I’m Allie!•1/14/25, 2:41 AM

I thought it just passed in the URL directly

HHello, I’m Allie!I forget, isn’t Hyperdrive completely disabled in local?

daveOP•1/14/25, 3:09 AM

It gives a string like

4870f521c22c2295fdfaceef9b4aeca5.hyperdrive.local

4870f521c22c2295fdfaceef9b4aeca5.hyperdrive.local

for the host.

daveOP•1/14/25, 3:59 PM

Is there a way to see if a connection to Hyperdrive is working without binding it to a Worker?

AJR•1/14/25, 4:16 PM

We validate connections at create time. If the credentials/hostname provided don't connect successfully you'll get an error and it'll fail to create.

AAJR We validate connections at create time. If the credentials/hostname provided do...

daveOP•1/14/25, 4:37 PM

Can I validate a connection after it's created?

AJR•1/14/25, 4:42 PM

We re run it on updates. You could increase your cache ttl by 1 second or something.

Alternatively, you can bind the same Hyperdrive to multiple workers. Spin up a hello world worker and test it out that way with some small queries?

AAJR We re run it on updates. You could increase your cache ttl by 1 second or someth...

daveOP•1/14/25, 5:45 PM

Oh nice, so if an update works, that means for sure that the connection is good?

Ddave Oh nice, so if an update works, that means for sure that the connection is good?

AJR•1/14/25, 5:47 PM

Yep, that's correct. The point is to avoid having folks change a password or hostname or something and have a typo that they don't notice til their alerts blow up, but it can be used for this too

AJR•1/14/25, 5:48 PM

You can confirm this on the DB side by looking at logins, if you have that monitoring set up.

AJR•1/14/25, 5:54 PM

Hey everyone. I'm looking for some beta testers. We have a fairly large change going out soon, that will pretty dramatically improve performance for Hyperdrives with wide geographic distributions of their users.

If you're interested, please respond in the thread I'm about to create indicating your interest, and which Hyperdrive IDs you'd like me to enroll in this beta test. I expect that we'll get this rolling early next week.

Walshy•1/14/25, 6:00 PM

@Hyperdrive

if you want access to beta, see above!

oritwoen•1/14/25, 6:03 PM

I see that this is beta access to active hyperdrive instances. I am eagerly awaiting the possibility of connecting mysql. I have a very large service made on Nuxt 3 with Headless for WordPress and deploys on Cloudflare and hyperdrive would probably reduce costs and improve the performance of the site.

Ooritwoen I see that this is beta access to active hyperdrive instances. I am eagerly awai...

AJR•1/14/25, 6:10 PM

We hear you.

WWalshy @Hyperdrive 👀 if you want access to beta, see above!

Peppy•1/14/25, 6:17 PM

chapel1337•1/14/25, 8:42 PM

Cchimame Has Hyperdrive been updated recently? The number of connections to our database...

Isaac McFadyen•1/16/25, 12:25 AM

There is a beta going on at the moment but I believe it was opt-in meaning if you haven't given your account IDs you shouldn't be in the beta

Isaac McFadyen•1/16/25, 12:26 AM

One of the Hyperdrive engineers could tell you more whenever they see this, probably. Can you grab your account ID and hyperdrive ID (It's safe to share publicly)?

Is Hyperdrive (during local dev) known to leak connections?

Similar Threads

Similar Threads

Similar Threads