I personally use a neon database for testing, and get sub 100 millisecond latency on hot connections

I personally use a neon database for testing, and get sub 100 millisecond latency on hot connections without caching -- but your results will vary based on where your requests are coming from and where you neon database is located

EEmilio I personally use a neon database for testing, and get sub 100 millisecond latenc...

tester123•8/29/24, 5:13 AM

I created one in Frankfurt and I'm based in Malta, so I was getting 200-300ms for a single query (not cached I think), using the hyperdrive with postgres.js. Btw, I haven't managed making hyperdrive work with the serverless neondb driver (via drizzle orm), but only with postgres.js. Maybe the serverless driver of neondb is not supported in cloudflare?

tester123•8/29/24, 5:15 AM

also, which driver do you recommend using with hyperdrive? Are you using postgres.js yourself as well, instead of the serverless driver of neon?

Ttester123 I created one in Frankfurt and I'm based in Malta, so I was getting 200-300ms fo...

Matt Silverlock•8/29/24, 12:38 PM

The serverless Neon driver is supported… it’s just slower than Hyperdrive: https://blog.cloudflare.com/hyperdrive-making-regional-databases-feel-distributed/

The Cloudflare Blog

Hyperdrive: making databases feel like they’re global

Hyperdrive makes accessing your existing databases from Cloudflare Workers, wherever they are running, hyper fast.

Ttester123 also, which driver do you recommend using with hyperdrive? Are you using postgre...

Matt Silverlock•8/29/24, 12:38 PM

All of our docs recommend Postgres.js and our teams internally use it.

Matt Silverlock•8/29/24, 12:39 PM

https://developers.cloudflare.com/hyperdrive/configuration/connect-to-postgres/

Cloudflare Docs

Connect to PostgreSQL | Hyperdrive

Hyperdrive supports PostgreSQL and PostgreSQL-compatible databases, popular drivers and Object Relational Mapper (ORM) libraries that use those drivers.

MMatt Silverlock The serverless Neon driver is supported… it’s just slower than Hyperdrive: https...

tester123•8/29/24, 4:27 PM

Thanks for your kind reply. I was referring that I did not manage to use the serverless Neon driver together with Hyperdrive (not separately!). I don't think hyperdrive can work together with the serverless driver without changing it to postgres.js. More info here:
https://orm.drizzle.team/docs/get-started-postgresql#neon-postgres

Drizzle ORM - PostgreSQL

Drizzle ORM is a lightweight and performant TypeScript ORM with developer experience in mind.

Ttester123 Thanks for your kind reply. I was referring that I did not manage to use the ser...

Matt Silverlock•8/29/24, 4:41 PM

The Neon serverless driver uses WebSockets — because most serverless providers don't have something like Hyperdrive — so they aren't compatible and can't be.

WebSocket-per-request is still slower than using Hyperdrive's connection pooling (by a fair bit, as the blog lays out)

MMatt Silverlock The Neon serverless driver uses WebSockets — because most serverless providers d...

tester123•8/29/24, 5:41 PM

Thank you very much for your detailed reply, this clears a lot of the confusion I had

May I ask about any future plans for Hyperdrive? It's a really amazing product!
Thank you once again! I'll proceed with using postgres.js.

Lila Rest•8/31/24, 10:09 AM

Hello there! Has anyone managed to make a NextJS app hosted on Cloudflare Pages to fetch its Postgres database through Hyperdrive?

MMatt Silverlock https://developers.cloudflare.com/hyperdrive/configuration/connect-to-postgres/

anirudh•9/2/24, 2:30 PM

There was an issue with prepared statements and extra round trips to the DB with postgres.js. Has that been resolved?

anirudh•9/2/24, 2:30 PM

We saw a reduction in latency by using the node-pg driver

Aanirudh There was an issue with prepared statements and extra round trips to the DB with...

Matt Silverlock•9/2/24, 3:12 PM

Quite some time ago - we discussed that here too. https://developers.cloudflare.com/hyperdrive/platform/changelog/#2024-05-22

Cloudflare Docs

Changelog | Hyperdrive

anirudh•9/2/24, 3:16 PM

Oh. Let me check again. I remember trying it after sometime in June/July and still having the issue.

lifeiscontent•9/5/24, 6:39 PM

for hyperdrive, could I connect to it via a pages app or would I have to use worker sites?

AJR•9/5/24, 7:28 PM

Hyperdrive does work with Pages, yes.

lifeiscontent•9/5/24, 10:16 PM

does Hyperdrive have static IPs I can allow traffic from my RDS Postgres instance?

AJR•9/6/24, 12:52 PM

Not yet, no. It's on our radar but for now we're still on the shared pool Warp uses, that is not static

AJR•9/6/24, 12:52 PM

When that changes it'll warrant a changelog entry, for sure.

Corey•9/8/24, 2:18 PM

Has there been any progress in securing Hyperdrive? (sorry - wrote this before seeing the post indicating there are no static IPs yet)

I know Cloudflare has deemed Hyperdrive "producton ready", but it is unusable in its current state for anything more than a sandbox... and certainly not anything targeting the enterprise. The restriction to open 0.0.0.0/0 is a widely known security vulnerability. I did this (since there was no other way), and instantly regretted it. Within a day, my Google Cloud SQL server was hammered with connections attempting to gain access... enough so that the small scale test DB instance I had was shut down for memory consumption (deemed underprovisioned... when there was literally one record getting 5 requests/day in the tiny DB). Google has plenty of ways to secure the DB, but Cloudflare is essentially requiring users to bypass these mechanisms.

I know Neon, PlanetScale, & Supabase are supported... but just supporting Guillermo Rauch-backed startups is not enough to call it "production ready". Contrary to what has been stated, most databases are NOT publicly accessible. Only managed service providers do this, and even those have the ability/recommendation to add security rules limiting connections. I mention this because it was one of the arguments made in favor of allowing 0.0.0.0/0 a few months ago in this thread.

I'd really love to use Hyperdrive. While my servers were left alone, it seemed great. However; this is a deal-breaker if it's going to put my other infrastructure in jeopardy. If there's anything I can do to help, I'd be happy to.

@AJR - is the pool of IP's for warp accessible? If we can restrict by that, it would be a start.
cc @Matt

CCorey Has there been any progress in securing Hyperdrive? (sorry - wrote this before ...

Matt Silverlock•9/8/24, 3:35 PM

The pool of IPs used right now is not stable. Do not restrict by that. We’re working on a better approach here that will allow you to use Cloudflare Tunnel + Access for cases where you can’t open your firewall to the Internet.

IP ACLs aren’t/would not be scoped per customer, and we don’t think they’re the right approach.

Corey•9/8/24, 3:47 PM

@Matt - Timeframe?

AJR•9/8/24, 4:10 PM

@Corey this is something we're well aware of and addressing it has been our top feature priority. The Tunnel support and our move over to a stable IP pool are under active development. Matt will have to speak to timeframe/announcements etc, but I just wanted to chime in and say that we do hear you loud and clear on this one.

CCorey @Matt - Timeframe?

thomasgauvin•9/8/24, 11:43 PM

To give you an idea of timeline, we’re testing internally. So actually coming soon

thomasgauvin•9/10/24, 12:58 PM

If (and only if) you've been wanting to connect from Hyperdrive to private databases over tunnels:

@AJR and I talked it over and we're ready for you to try Hyperdrive with tunnel support for private databases early (if you're interested). Docs are still in progress, there may still be some rough edges and it's cli/api heavy (no UI yet), but we're looking forward to getting this in your hands and get your early feedback on it. If you're in,

this message we'll start a separate message thread for us to discuss this later this week.

CC @Corey @berkinovish @amcclosky (because you've brought it up in the past)

moody 💭•9/10/24, 1:14 PM

will we ever be able to set caching at the query level? since hyperdrive is parsing queries it seems like you could have a statement to set cache ttl

AJR•9/10/24, 1:15 PM

Yes, it's on our backlog. It's not something we've really set about yet, so the exact design and behavior of it is an open question, but disabling cache and setting max-age per query are both going to happen at some point.

Tthomasgauvin *If (and only if) you've been wanting to connect from Hyperdrive to private data...

Isaac McFadyen•9/10/24, 9:11 PM

This was awesome timing with the previous message :lul:

Isaac McFadyen•9/10/24, 9:11 PM

You weren't kidding

AJR•9/15/24, 11:26 AM

I can speak to the compatibility question, so I'm going to try to answer that one.

We're targeting MySQL. MariaDB will be handled to the extent that drivers and protocol compatibility with MySQL give it to us for free.

Explicit MariaDB support might be a future consideration but is not a current one.

piffie•9/18/24, 12:54 PM

the docs for the hyperdrive have some mistakes:
on create it says

wrangler hyperdrive create <ID> [OPTIONS]

wrangler hyperdrive create <ID> [OPTIONS]

but its not <ID> its <NAME>
vs on

wrangler hyperdrive update <ID> [OPTIONS]

wrangler hyperdrive update <ID> [OPTIONS]

it is actually the ID, that was created before.
also, on update, the --database is the only one who has no "origin" prefix - seems to be inconsistant, also why not just enable the same --connection-string parameter, when you anyway need to update everything

Noxydude•9/18/24, 7:32 PM

Hey team, is it possible to use Hyperdrive directly from Pages rather than through Workers? Or are there plans for this in the future?
For context, we are connecting to our

pg

pg

DB directly from Pages now, as shown possible in this recent announcement here: https://blog.cloudflare.com/more-npm-packages-on-cloudflare-workers-combining-polyfills-and-native-code/
But we were wondering if we could also leverage Hyperdrive.

kindaraffy•9/19/24, 3:14 PM

Hi Cloudflare team, we’ve been using hyperdrive for a while now and we really like it. Are there any plans on making hyperdrive available outside of workers?

piffie•9/19/24, 8:04 PM

a little bit more complicated but what i would wish:
that the localConnectionString would move out of the toml, maybe into the .dev.vars file - that i can give it a key. on our system it happens that the local strings get committed to the sourcesafe. not great.

kian•9/19/24, 8:51 PM

https://developers.cloudflare.com/hyperdrive/configuration/local-development/#configure-local-development

kian•9/19/24, 8:51 PM

Recommended Create a
WRANGLER_HYPERDRIVE_LOCAL_CONNECTION_STRING_<BINDING_NAME>
WRANGLER_HYPERDRIVE_LOCAL_CONNECTION_STRING_<BINDING_NAME>
environmental variable with the connection string of your database. <BINDING_NAME> is the name of the binding assigned to your Hyperdrive in your wrangler.toml or Pages configuration. This allows you to avoid committing potentially sensitive credentials to source control in your wrangler.toml, if your test/development database is not ephemeral. If you have configured multiple Hyperdrive bindings, replace <BINDING_NAME> with the unique binding name for each.

Tthomasgauvin *If (and only if) you've been wanting to connect from Hyperdrive to private data...

Corey•9/20/24, 6:02 AM

Thanks - I already implemented an alternative solution.

jam_zaw•9/20/24, 6:36 AM

MongoDB with Hyperdrive?

Is their a difference between:
connecting a MongoDB directly
connecting a MongoDB with Hyperdrive

Jjam_zaw MongoDB with Hyperdrive? Is their a difference between: connecting a MongoDB di...

Sam•9/20/24, 7:22 AM

MongoDB is not supported with Hyperdrive atm

SSam MongoDB is not supported with Hyperdrive atm

thomasgauvin•9/20/24, 12:25 PM

Confirming what Sam said

Luccas•9/24/24, 11:49 PM

Hyperdrive can be used from one aws lambda or only inside a worker?

AJR•9/25/24, 1:36 PM

Only from within a Worker.

AJR•9/26/24, 12:47 PM

@hyperdrive

For all of you who've asked about connecting to your database without exposing it to the public Internet, we're ready to go live. Say hello to Hyperdrive, now with support for Cloudflare Tunnels!

https://developers.cloudflare.com/hyperdrive/configuration/connect-to-private-database/

Cloudflare Docs

Connect to a private database using Tunnel | Hyperdrive

Hyperdrive can securely connect to your private databases using Cloudflare Tunnel and Cloudflare Access.

AAJR @hyperdrive For all of you who've asked about connecting to your database witho...

Sam•9/26/24, 12:48 PM

letsgo!

AAJR @hyperdrive For all of you who've asked about connecting to your database witho...

MassiveR3T4RD•9/26/24, 12:49 PM

damn!

AAJR @hyperdrive For all of you who've asked about connecting to your database witho...

Matt Silverlock•9/26/24, 1:14 PM

@Hyperdrive new feature just dropped!

complicated•9/26/24, 1:14 PM

MMatt Silverlock @Hyperdrive new feature just dropped!

AJR•9/26/24, 1:16 PM

Thanks Matt. Pings are hard, apparently....

AAJR @hyperdrive For all of you who've asked about connecting to your database witho...

Hard@Work•9/26/24, 1:17 PM

So if I am reading this correctly, Hyperdrive needs a public domain for the tunnel, correct? You can't point Hyperdrive directly at the ArgoTunnel domain(I don't remember the exact domain name off the top of my head)

HHard@Work So if I am reading this correctly, Hyperdrive needs a public domain for the tunn...

AJR•9/26/24, 1:17 PM

Correct.

I personally use a neon database for testing, and get sub 100 millisecond latency on hot connections

Similar Threads

Similar Threads

Similar Threads