No I was just pointing out that the docs may potentially be misleading when it mentions drizzle only

No I was just pointing out that the docs may potentially be misleading when it mentions drizzle only works with node postgres when you can run it using the recommended postgres-js client.

Kkindaraffy No I was just pointing out that the docs may potentially be misleading when it m...

AJR•6/21/24, 4:04 PM

Ah good catch, thank you!

Elektra•6/24/24, 4:10 PM

Is hyperdrive down?

Elektra•6/24/24, 4:11 PM

For the past 40 to 50 minutes. Out of nowhere I get cannot get it...failed to aquire a connection from the pool.

Elektra•6/24/24, 4:11 PM

Nothing changed. I haven't touched code for the last 6h ...

Elektra•6/24/24, 4:12 PM

All was working...and I can connect directly to the db.

AJR•6/24/24, 4:12 PM

Taking a look

Elektra•6/24/24, 4:12 PM

Thank you AJR

AJR•6/24/24, 4:13 PM

What's your hyperdrive ID?

AJR•6/24/24, 4:13 PM

I'm still seeing normal global traffic levels, no elevated error rates.

Elektra•6/24/24, 4:14 PM

sent DM

Divyendu•6/26/24, 12:15 PM

Does hyperdrive work with Cloudflare pages or just workers for now?

Walshy•6/26/24, 12:18 PM

it's supported on Pages

Divyendu•6/26/24, 12:22 PM

Thanks, I get this error in the build logs, I have the binding defined in my wrangler.toml. Investigating

. I asked the question becuase I didn't see the binding in pages UI, but good to know that it works!

Divyendu•6/26/24, 4:11 PM

Aha, got it working, for anyone who runs into this, in the end it was simpler than I thought, just need

compatibility_flags = [ "nodejs_compat" ]

compatibility_flags = [ "nodejs_compat" ]

wrangler.toml

wrangler.toml

and then normal functions directory just works™. It took me a while to figure it out because most of the community resources, gh issues etc are slightly outdated and took me a while to understand that node_compat = truenode_compat = true is a build time thing not supported by pages and likely won't be (as it is legacy) and

compatibility_flags

compatibility_flags

is the way to go!

Divyendu•6/27/24, 10:18 AM

I am not sure if this fix should happen in Cloudflare or Remix but I need to provide a "fake" env var "WRANGLER_HYPERDRIVE_LOCAL_CONNECTION_STRING_HYPERDRIVE" for remix vite:buildremix vite:build to succeed in CI.

I think this should be fixed in Cloudflare (it should detect that it is running in the CI and not fail with the "when running locally" message)

Matt Silverlock•6/28/24, 2:43 PM

If you're interested in how Hyperdrive works under the hood, @AJR just published a blog: https://blog.cloudflare.com/postgres-named-prepared-statements-supported-hyperdrive

The Cloudflare Blog

Supporting Postgres Named Prepared Statements in Hyperdrive

Hyperdrive (Cloudflare’s globally distributed SQL connection pooler and cache) recently added support for Postgres protocol-level named prepared statements across pooled connections. We dive deep on what it took to add this feature.

kindaraffyOP•6/29/24, 11:54 AM

Is there a way to specify read replicas for a hyperdrive configuration?

thomasgauvin•6/30/24, 11:53 PM

Not currently possible, how many replicas do you have? Which db provider are you using?

Tthomasgauvin Not currently possible, how many replicas do you have? Which db provider are you...

Sam•7/1/24, 1:09 AM

Will read replicas be supported in the near future, like when using SELECT queries Hyperdrive automatically uses the nearest Postgres servers? Ideally with the same set-up as HTTP load balancing

anirudh•7/1/24, 4:31 AM

We are using Hyperdrive, but it seems to be very slow. A query that should take 20ms-30ms is actually taking 800-900ms. The dashboard reports a query latency of 150ms, but it should still be less than 800ms. The database is located in Bangalore (BLR) and the worker is in Chennai (MAA), so they are quite close to each other.

anirudh•7/1/24, 4:48 AM

Is there a way to check in which location the hyperdrive is?

AJR•7/1/24, 2:19 PM

@anirudh What is your hyperdrive ID? Send it in a DM?

Is this consistently the latency you're seeing, or is this a spike?

AJR•7/2/24, 12:28 PM

We have made some changes since June 15th, yes. Please DM me with some details of your setup, if you wouldn't mind. Where's your origin DB, where are most of your users, what driver/version are you using, and any other info you're able to share.

AJR•7/2/24, 12:32 PM

Also, is this slowdown still going, or is it back to normal when connected with Hyperdrive now?

Cchimame Thank you for your reply. I was having trouble with the slowdown. - Supabase is...

AJR•7/2/24, 5:28 PM

If you wouldn't mind DM'ing me the Hyperdrive ID, I can confirm. Based on what you've said so far, no I don't think you should switch back at this time if you have a reasonably workable alternative. I have a suspicion about root cause here, but will confirm.

ExtraFatBacon•7/2/24, 8:34 PM

There is any list that I can use to limit hyperdrive connections to my postgres to be only accept cloudflare ips? , I'm running a postgres server but not very confortable to be too open to internet.

João Castro•7/2/24, 11:47 PM

Hi! Any updates about supporting tunnels?

AJR•7/3/24, 12:51 AM

In progress, currently being actively worked on. We'll make announcements when they're good to go.

At the moment I'm able to run most of our test suite across a tunnel, so that's exciting. Not quite ready for prime time yet, though.

Ping for toast•7/3/24, 1:51 PM

I'm sorry to have so many things go wrong, but I'm also seeing latency issues with hyperdrive. The pictures, in order:

localhost
me → cf hosted worker
me → VPN to europe → cf hosted worker
All three of these are connecting to the same database. So, it would appear, just by connecting to a cloudflare server within a 50 mile radius of me, the response time has doubled. The VPN has a 100ms overhead. Obviously in all cases its not fast, but the difference is staggering. For the record, a query not involving the database takes 50-59ms without the VPN, and 150ms with the VPN

Ping for toast•7/3/24, 1:53 PM

Concidently I'll be in europe tonight (US east rn) so I'll be curious to see the speeds there

Ping for toast•7/3/24, 1:55 PM

Of course, all of these are on a warm connection

Ping for toast•7/3/24, 1:57 PM

if you'd like, I could run a test of CF worker → database without hyperdrive

AJR•7/3/24, 2:00 PM

Sure, that'd at least test how much of this is due to where your pool is being placed, and how much is the overhead of the VPN/routing itself.

AJR•7/3/24, 2:00 PM

Jog my memory, you're putting your DB in Europe?

AAJR Jog my memory, you're putting your DB in Europe?

Ping for toast•7/3/24, 2:00 PM

Yeah, germany

Ping for toast•7/3/24, 2:01 PM

I have a lot of customers who would prefer it there, but I would be willing to switch cloud providers at least if that could cut down on latency (eg it looks like just from a ping test that aws has 200ms faster from here to germany)

AJR•7/3/24, 2:04 PM

My immediate guess is that the VPN to Europe is doing a lap back to a pool in the US based on your fairly irregular access patterns. All clients in a region are meant to share a pool node so the EU client should be basically all EU->EU and fairly quick, but I wonder if the VPN is passing origin info such that it's being treated as a US source. I'm curious what the non-Hyperdrive latencies look like.

Individual providers are going to have different peering arrangements and different latencies to some degree. Obviously there's a limit to what we can do there. I'm surprised to see AWS be that much faster, though.

Ping for toast•7/3/24, 2:06 PM

yeah me as well, its shocking but ping tests show similar. So the 350-500ms makes sense, just the local cf looks a bit odd. I'm deploying without hyperdrive now

Ping for toast•7/3/24, 2:11 PM

No hyperdrive (US), No hyperdrive (VPN to EU)

Ping for toast•7/3/24, 2:12 PM

So it is reducing the time by roughly 100ms in the US, and increasing the time by 100ms in europe

Ping for toast•7/3/24, 2:12 PM

look at that sweet sweet likely ~100ms actual response time in europe though!

AJR•7/3/24, 2:13 PM

Cache misses at about 100-125ms and Cache hits below 50ms are what we often see in our tests, yeah.

AJR•7/3/24, 2:14 PM

I'm interested in seeing what you get when you're in EU tonight, should be pretty slick

Ping for toast•7/3/24, 2:14 PM

that's another interesting thing, my caches are missing 100% of the time

Ping for toast•7/3/24, 2:15 PM

I suspect this could be due to query complexity

AJR•7/3/24, 2:16 PM

We only cache non-volatile SELECT statements. You have some non-deterministic function in there?

AAJR We only cache non-volatile SELECT statements. You have some non-deterministic f...

Ping for toast•7/3/24, 2:16 PM

not positive? like randomrandom?

AJR•7/3/24, 2:17 PM

https://www.postgresql.org/docs/current/xfunc-volatility.html

PostgreSQL Documentation

38.7. Function Volatility Categories

38.7. Function Volatility Categories # Every function has a volatility classification, with the possibilities being VOLATILE, STABLE, or IMMUTABLE. VOLATILE is …

No I was just pointing out that the docs may potentially be misleading when it mentions drizzle only

Similar Threads