Is there a need to create+close the connection on every request here, given that Hyperdrive does poo

Is there a need to create+close the connection on every request here, given that Hyperdrive does pooling and so it wouldn't exhaust connection limits?

EEmilio Yes in the context! Something like this middleware is recommended ```ts // Middl...

DaniFoldi•3/19/25, 11:18 PM

I'd also add a maximum pool size to the postgres<->hyperdrive part, since >6 queries can deadlock the worker

IIsaac McFadyen Is there a need to create+close the connection on every request here, given that...

AJR•3/20/25, 10:56 AM

Blog coming soon. TLDR: that's a different "kind" of connection than the ones to the origin, takes ~2ms to open, and closing it will avoid holding your Worker open doing any processing, helping keep your CPU time down. I'd recommend doing it the way Emilio showed.

AJR•3/20/25, 10:57 AM

Send me the Hyperdrive ID, I'll take a look

AJR•3/20/25, 10:57 AM

Was it serving queries successfully at all?

AJR•3/20/25, 10:58 AM

One sec

AJR•3/20/25, 11:01 AM

Ok, moving to DMs so I can collect some information

AJR•3/20/25, 11:02 AM

I do see your connection errors

James•3/20/25, 6:45 PM

Hyperdrive got a nice shoutout in our case study with Neon today :MeowHeartCloudflare: https://neon.tech/blog/nodecraft-cloudflare-neon

Neon

How Nodecraft Built a Scalable Game Server Platform with Cloudflare...

To improve their scalability and performance, Nodecraft transitioned to a serverless architecture built on Cloudflare and Neon.

AJR•3/20/25, 9:05 PM

Nice! That got posted around a bit internally before I came to check here. Love to see it!

Original message was deleted

Isaac McFadyenOP•3/20/25, 10:38 PM

?crossposting

SuperHelpflare•3/20/25, 10:38 PM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

Isaac McFadyenOP•3/20/25, 10:39 PM

@System/Library/ServerSetup/ I've deleted your message as this has no relation to either KV or Hyperdrive.

Silvan•3/21/25, 10:08 AM

oh? we getting there

AJR•3/21/25, 12:32 PM

Yep. SoonTm

Silvan•3/21/25, 6:22 PM

Highly interested in seeing Planetscale with hyperdrive

SSilvan oh? we getting there 👀

Isaac McFadyenOP•3/21/25, 6:59 PM

You've discovered the secret of Cloudflare :lul:

Silvan•3/21/25, 7:00 PM

i have been stalking the changelogs for a while hahaha. not me asking for methods added 4 hours ago with no docs yet

SSilvan Highly interested in seeing Planetscale with hyperdrive

AJR•3/21/25, 7:00 PM

>.>

MySQL is going to be in beta for a while, but Planetscale are definitely on our radar.

Silvan•3/21/25, 7:03 PM

Yea makes sense. I mean Planetscale is the best cloud db solution IMO and probably 90% of people asking for mysql support

SSilvan i have been stalking the changelogs for a while hahaha. not me asking for method...

Isaac McFadyenOP•3/21/25, 7:25 PM

What you've got to stalk is the PRs for

workerd

workerd

:lul:

Isaac McFadyenOP•3/21/25, 7:25 PM

They're even more revealing than the changelogs, sometimes.

Silvan•3/21/25, 7:28 PM

i do i do even the agents repo but that one dosent have changelogs so commits it is :^)

AAJR There's a few different things contributing to this, and picking apart which are...

kchro3•3/21/25, 7:29 PM

Any chance you have an update on this? Still curious to hear about what happened

Kkchro3 Any chance you have an update on this? Still curious to hear about what happened

AJR•3/21/25, 8:01 PM

Haven't forgotten, but we're actively investigating some of the moving parts. Here's what we have so far.

Recent incidents causing disconnects: a bug in some users' scripts have identified a noisy neighbor risk in our service. We're working to remedy that. A couple other smaller spikes have walked through the same ground
Observability gaps: the increase in disconnects from the above point has identified some gaps in our observability and error reporting. We've released some improvements to this, and are planning to work on more.

AJR•3/21/25, 8:07 PM

I do want to stress that the users in question were not malicious, this wasn't a DOS attack because I said something in discord. Honest mistake that highlighted a gap in our hardening we hadn't spotted, that we now need to address.

AJR•3/21/25, 8:14 PM

As we learn more, and are able to roll out improvements, I'll post another followup here.

Jökull Sólberg•3/25/25, 7:23 PM

Please make cache off by default. Took me a while to debug some stuff. Also maybe a security issue?

JJökull Sólberg Please make cache off by default. Took me a while to debug some stuff. Also mayb...

DaniFoldi•3/25/25, 8:24 PM

@thomasgauvin I second this, I remember also running in to this when I set up my first hyperdrive
or prompt the users if they have not specified --cache=true or =false, something like that

AAJR >.> MySQL is going to be in beta for a while, but Planetscale are definitely on...

antim8•3/25/25, 9:49 PM

Are there any estimates on when mysql is going to be in beta?

DDaniFoldi @thomasgauvin I second this, I remember also running in to this when I set up my...

AJR•3/25/25, 10:15 PM

While I would certainly entertain the idea that would have been a better default, I can't imagine we'd flip that behavior at this stage without a really strong reason to do so.

Aantim8 Are there any estimates on when mysql is going to be in beta?

AJR•3/25/25, 10:16 PM

We don't generally publish dates like that publicly, it doesn't usually help anyone and can cause issues if something delays us. I will say that it's actually soon, and not like months away or anything.

DDaniFoldi @thomasgauvin I second this, I remember also running in to this when I set up my...

AJR•3/25/25, 10:18 PM

A prompt is an interesting idea. I'll chat about that with the team, see how folks feel.

AAJR A prompt is an interesting idea. I'll chat about that with the team, see how fo...

Jökull Sólberg•3/26/25, 9:19 AM

If the default will remain unchanged, I would propose the following changes for an improved onboarding experience with fewer gotchas.

Update "Getting started" wording - currently it says "Hyperdrive [...] can cache the most common read queries, improving performance[...].". To me this strongly suggests that it defaults to off and is opt in.
Add a note to "Getting started" where the user is instructed to run
```
wrangler hyperdrive create
```
```
wrangler hyperdrive create
```
-- something like "To disable and opt out of caching add --caching-disabled--caching-disabled. You can also specify --max-age--max-age in seconds before query results are evicted (default 60 seconds)". Maybe the word "caching" would be linked to the cache docs.

I did notice that the --help--help has great documentation btw. I should have read through that before issuing the command

JJökull Sólberg If the default will remain unchanged, I would propose the following changes for ...

AJR•3/26/25, 11:41 AM

I think we can definitely add that language to the docs. Appreciate the suggestions!

AAJR A prompt is an interesting idea. I'll chat about that with the team, see how fo...

thomasgauvin•3/26/25, 1:51 PM

I think we could do this, yes, in the dashboard and/or in Wrangler

dave•3/27/25, 9:20 PM

@AJR is there any open source code out there that you know of that I could use to detect if a query is gonna be cachable or not?

AJR•3/27/25, 9:25 PM

Hmmm. We do a few different checks, no one off the shelf tool I can think of does all of them.

Parse the query down to an AST (any number of OSS tools do this)
Traverse the AST to check that it boils down to a single SELECT statement (probably stuck writing that yourself)
Check against the list of volatile builtin Postgres functions (can check pg_proc, the provolatile field)
Check size of query string + query results (we have very large limits there, unlikely to come up much I think)
Check whether you're in a transaction (implicit transaction doesn't count)

You're running into queries not being cacheable that you think should be, or vice versa?

Jikyu•4/1/25, 7:20 PM

https://blog.cloudflare.com/instant-purge-for-all/ is that relevant to hyperdrive cache

The Cloudflare Blog

“You get Instant Purge, and you get Instant Purge!” — all pur...

Following up on having the fastest purge in the industry, we have now increased Instant Purge quotas across all Cloudflare plans.

JJikyu https://blog.cloudflare.com/instant-purge-for-all/ is that relevant to hyperdriv...

AJR•4/1/25, 7:21 PM

No, afraid not.

commanderfrank447•4/1/25, 7:25 PM

Franco Romano Losada•4/3/25, 12:36 PM

Hey everyone, is it possible to get the hyperdrive connection string in process.env?

Franco Romano Losada•4/3/25, 12:37 PM

Right now I'm using async local storage to get it but I want to have a clean db package separated from the http layer (hono)

AJR•4/3/25, 2:02 PM

The Hyperdrive connection string is generated at runtime when you invoke the binding, so you'd need to get it from the created env.Hyperdrive object and then stash it where you need it.

It will not be valid beyond the request within which it is generated.

Franco Romano Losada•4/3/25, 9:18 PM

Thanks. I think I found a nice pattern to avoid this

James•4/5/25, 5:42 PM

Interesting question/observation from this user: https://community.cloudflare.com/t/hyperdrive-postgres-js-not-caching-queries-with-parameters/786452?u=cherryjimbo. Not sure if there's an issue with their testing, or just a limitation? I would have expected both to be cached fine

JJames Interesting question/observation from this user: https://community.cloudflare.co...

AJR•4/5/25, 5:43 PM

That should be cacheable, yes. Wonder what's up there.

My first bet would be that they're using prepare: falseprepare: false, which causes postgres.js to behave in a way that would render most extended-protocol queries uncacheable, but that's just a guess.

James•4/5/25, 5:44 PM

Oh that's a great bet, good call

Isaac McFadyenOP•4/5/25, 5:44 PM

IIRC it used to be the recommendation to use prepare: falseprepare: false on certain DBs but no longer

IIsaac McFadyen IIRC it *used* to be the recommendation to use `prepare: false` on certain DBs b...

AJR•4/5/25, 5:46 PM

Yeah, before we added support for prepared statements you couldn't use postgres.js at all without it. Happy to have that sorted out now.

Walshy•4/5/25, 5:47 PM

Info like this is good for the knowledge bank and runbook

Is there a need to create+close the connection on every request here, given that Hyperdrive does poo

Similar Threads

Similar Threads

Similar Threads