We're seeing a spike of errors causing `postgres` to internally explode: https://i.james.pub/file/20

We're seeing a spike of errors causing

postgres

postgres

postgres

postgres to internally explode: https://i.james.pub/file/2025/01/d4f49e0e-2876-40a2-98e3-a84eaa719bdc.png. DB ID

edbe490e790c44389774f0c88667e221

edbe490e790c44389774f0c88667e221

. Anyone else?

JJames We're seeing a spike of errors causing `postgres` to internally explode: https:/...

dave•1/31/25, 12:33 AM

In what timeframe?

JamesOP•1/31/25, 12:34 AM

starting around 25 minutes ago, at 00:07 UTC. It's looking like our DB at Neon might be the cause here though and not Hyperdrive

JJames starting around 25 minutes ago, at 00:07 UTC. It's looking like our DB at Neon m...

dave•1/31/25, 12:34 AM

ah yeah, that's Neon for you.

JJames starting around 25 minutes ago, at 00:07 UTC. It's looking like our DB at Neon m...

dave•1/31/25, 12:34 AM

I would recommend looking at AWS RDS Aurora Serverless v2. It's really nice IMO.

dave•1/31/25, 12:35 AM

we did have PostgreSQL errors around this time, but I don't know if it was the database or Hyperdrive causing the errors.

AJR•1/31/25, 12:36 AM

Let me take a look

AJR•1/31/25, 12:44 AM

@James what's your Hyperdrive ID?

AAJR Let me take a look

AJR•1/31/25, 12:45 AM

Not seeing anything widespread in our logging or metrics

JamesOP•1/31/25, 12:45 AM

edbe490e790c44389774f0c88667e221

edbe490e790c44389774f0c88667e221

but after disabling Hyperdrive it looks like we're just timing out to Neon us-east-2

JamesOP•1/31/25, 12:45 AM

So not a Hyperdrive issue thankfully, but thank you

AJR•1/31/25, 12:46 AM

Sucks, hope you get it sorted.

JJames `edbe490e790c44389774f0c88667e221` - but after disabling Hyperdrive it looks lik...

Isaac McFadyen•1/31/25, 12:48 AM

I checked Neon's status page and there's nothing, annoying that there's random errors :\

Ddave I would recommend looking at AWS RDS Aurora Serverless v2. It's really nice IMO.

Max (@rozenmd)•1/31/25, 6:28 AM

just basic RDS Postgres has been brilliant for my side project, 4 years without downtime

MMax (@rozenmd)just basic RDS Postgres has been brilliant for my side project, 4 years without ...

dave•1/31/25, 12:40 PM

Look at switching to Aurora Serverless v2; it now supports scaling to zero, which is great for side projects that don't need to be on all the time. (Takes <30 seconds to turn back on.)

https://aws.amazon.com/blogs/database/introducing-scaling-to-0-capacity-with-amazon-aurora-serverless-v2/

And it also has zero-downtime patching (ZDP)!

https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_UpgradeDBInstance.PostgreSQL.MinorUpgrade.html#USER_UpgradeDBInstance.PostgreSQL.Minor.zdp

Ddave Look at switching to Aurora Serverless v2; it now supports scaling to zero, whic...

Hard@Work•1/31/25, 7:50 PM

I don't know if I'm looking in the right place, but $132.54 a month for a Side Project seems very expensive...

HHard@Work I don't know if I'm looking in the right place, but $132.54 a month for a Side P...

dave•1/31/25, 7:52 PM

Should be $43.8/m for 0.5 ACUs (assuming you never scale to zero) + $3.65/m for IPv4. Then there's some extra costs for bandwidth and I/O, but it's pretty small for (most?) workloads.

Ddave Should be $43.8/m for 0.5 ACUs (assuming you never scale to zero) + $3.65/m for ...

Hard@Work•1/31/25, 7:53 PM

Yeah, idk what Max is running, but side project, in my mind at least, is something that would fit on a free-tier Supabase/Xata/Neon(also since you probably don't need redundancy or other jazz)

Hard@Work•1/31/25, 7:54 PM

If you bundled many projects together onto a single database, it might be more worth it, but imo it's still a lot more pricy than the hobby alternatives.

HHard@Work Yeah, idk what Max is running, but side project, in my mind at least, is somethi...

dave•1/31/25, 8:45 PM

Neon is $69/m for 750 hours

Ddave Neon is $69/m for 750 hours 😦

Hard@Work•1/31/25, 8:51 PM

Not necessarily? You should be fine for a whole month if you go 0.25 vCPU, 2 GB RAM. Or, too, there is the scale to zero, which again, for a side project, you might not need 24/7 uptime

Hard@Work•1/31/25, 8:52 PM

I sure know every project I have deployed(other than WDOL) has DBs cold-starting, because I definitely don't have enough usage to keep them alive all the time. YMMV may vary of course, depending on your project

HHard@Work Not necessarily? You should be fine for a whole month if you go 0.25 vCPU, 2 GB ...

dave•1/31/25, 10:12 PM

RDS can scale down to about $5/m in that case though.

HHard@Work If you bundled many projects together onto a single database, it might be more w...

dave•1/31/25, 10:13 PM

Ah agreed, if you want a bunch of separate instances/projects, Neon is cheaper for dev use.

dave•1/31/25, 10:14 PM

Is it possible for Hyperdrive to pool connections from different databases if the username/password is the same? Or is this a PostgreSQL limitation?

Ddave Is it possible for Hyperdrive to pool connections from different databases if th...

dave•1/31/25, 10:56 PM

Answer: PostgreSQL limitation.

Ddave Is it possible for Hyperdrive to pool connections from different databases if th...

AJR•2/1/25, 12:00 PM

Well, we get to cheat a little, with the runtime-generated connection strings.

We probably could if we wanted to. Not saying it's something we'll do, but I'm curious and have never considered that before. What would be the use case for something like that?

Fernanda lustosa•2/1/25, 4:21 PM

I just entered the app, I don’t understand anything yet

letincho5•2/3/25, 11:07 AM

Hi, I can see only 20 hyperdrive connections's on Cloudflare Console. There is any way to see all of them?

letincho5•2/3/25, 11:21 AM

With wrangler's command, I can't see more than 20 too

letincho5•2/3/25, 11:21 AM

The max number is 25

letincho5•2/3/25, 11:39 AM

Another topic, I think there is a bug in delete hyperdrive feature: after delete a hyperdrive, I can't create another hyperdrive with the same name, because it's already exists.

Lletincho5 Another topic, I think there is a bug in delete hyperdrive feature: after delete...

AJR•2/3/25, 12:27 PM

Known bug, the fix for that is releasing this week.

Lletincho5 The max number is 25

AJR•2/3/25, 12:28 PM

Sorry, I'm not following. Historically Hyperdrive has allowed 20 connections per region per Hyperdrive. What maximum are you referring to?

letincho5•2/3/25, 12:29 PM

The maximum is 25 (right now I've 24, but I can see only 20)

AJR•2/3/25, 12:29 PM

What maximum?

letincho5•2/3/25, 12:30 PM

The quantity of Hyderdrive objects

AJR•2/3/25, 12:47 PM

Oh, you're referring to the number of Hyperdrive configs! Sorry, took me a second.

You can use the list API to see them all.

letincho5•2/3/25, 12:48 PM

but with wrangler hyderdrive list I can't see all

letincho5•2/3/25, 12:48 PM

API list by postman you say?

AJR•2/3/25, 12:54 PM

Not sure why wrangler would be truncating those, I'll check with the team.

Any http client really. I just use curl

letincho5•2/3/25, 12:55 PM

Okki! I need retrieve de config Id... I'll try

AJR•2/3/25, 12:55 PM

List API for your account should return the IDs as part of the json

Lletincho5 Hi, I can see only 20 hyperdrive connections's on Cloudflare Console. There is a...

Max (@rozenmd)•2/3/25, 3:41 PM

You should be able to see multiple pages of results now (in the dashboard)

letincho5•2/3/25, 3:42 PM

Yeah, thanks!

Lletincho5 Okki! I need retrieve de config Id... I'll try

dave•2/3/25, 6:25 PM

There’s also nice typescript bindings now.

You can see me using them here: https://www.ai.moda/en/blog/automate-hyperdrive-iam-auth-with-workers

AAJR Known bug, the fix for that is releasing this week.

AJR•2/3/25, 8:37 PM

This is fixed now.

FYI also @dave | ai.moda

AJR•2/3/25, 11:55 PM

Hey all! Today we released the final step in a fairly large rearchitecture of Hyperdrive. We'll be getting into the details in a full length blog post a little down the road, but for now here are the takeaways.

All newly created Hyperdrives will perform substantially more efficiently. This goes double for users with the origin database in APAC.
This should primarily manifest as lower latencies and fewer disconnects.
This will affect all Hyperdrives with or without caching.
We will be backfilling this solution to existing Hyperdrives progressively, over the course of the next couple weeks, starting next Monday. If you want yours handled sooner, please feel free to message me or respond in a thread here.

This one took the whole team quite a bit of work, it's been fun to ship. I'm excited to finally have it going out the door.

dan•2/4/25, 8:34 PM

I've done some search on this channel and it seems like cache busting/purging is still WIP? I ran into a bug today that took me awhile to figure out it was being caused by hyperdrive - user creates a comment, the query client then invalidates the comments query, it refetches the stale data causing my optimistic comment to disappear. This makes sense given hyperdrive caching. I'm just curious as to what my workaround should be given that cache purging isn't a thing (yet).

dan•2/4/25, 8:35 PM

It'd be a little contrived for me to add some volatile function to the query given that it'd have to originate from the client and then drill through the api router and modify queries in a weird way

Ddan I've done some search on this channel and it seems like cache busting/purging is...

AJR•2/4/25, 8:44 PM

The alternative is likely just a second hyperdrive config with caching disabled, and direct your queries to whichever is appropriate at the application level.

Not a great alternative, we're aware.

We're seeing a spike of errors causing `postgres` to internally explode: https://i.james.pub/file/20

Similar Threads