Aha interesting - glad to know it's not just me, though sorry it's affecvting you too. How did you d

Aha interesting - glad to know it's not just me, though sorry it's affecvting you too. How did you disable caching? Presumably this defeats the point of HD in general since it's essentially a DB cacher?

MityaOP•1/8/24, 5:58 PM

If I'm right that running a Worker app locally in dev mode bypasses HD entirely anyway (i.e. simply connects to the DB conventionally), then possibly (at least in my case) it's not a HD issue but a Workers one.

MityaOP•1/8/24, 6:03 PM

Hmm, info but no option to change settings. Perhaps this has to be done via Wrangler CLI

MityaOP•1/8/24, 6:05 PM

And you're right re:

--remote

--remote

implying usage of HD, just checked.

MMitya Hmm, info but no option to change settings. Perhaps this has to be done via Wran...

MityaOP•1/8/24, 6:08 PM

Here's the commands to do that

MityaOP•1/8/24, 6:10 PM

Anyway I've formally DB sometimes returns rows, sometimes returns nothing up this issue in #workers-help. Gonna disappear for dinner but will check back later/tomorrow in case there's any update on this problem. Hopefully a CF dev can shed some light/a fix.

MMitya [Here's the commands](https://developers.cloudflare.com/workers/wrangler/command...

Colin•1/8/24, 7:37 PM

Hey, just wanted to clarify on this (and Connor is one of my coworkers, thank you connor!!) - I've been talking with xortive in DMs + helping reproduce this. We're currently working around this w/ 2 Hyperdrives (one with caching, one without).

Also confirmed that using SQL queries w/o any parameters (IE doing string concatenation instead of using $1/$2/etc) doesn't trigger the issue; it's only with the parameterized queries

Colin•1/8/24, 7:37 PM

Obviously if string concatenation works for you or not is based on what kind of queries you have (SQL injection and all)

Colin•1/8/24, 7:37 PM

Also got linked this branch of Wrangler: https://github.com/xortive/workers-sdk/tree/malonso/caching-options which provides options to change caching settings . Not sure if includes enabling/disabling as i haven't looked yet, but we're running with two hyperdrives anyways (we have enough cacheable volume that we'd blow up our DB if we disabled it entirely), so I just made a new one with it disabled

MMitya Aha interesting - glad to know it's not just me, though sorry it's affecvting yo...

Matt Silverlock•1/8/24, 11:57 PM

Separate from the caching bug, the connection pooling part of Hyperdrive is a very substantial benefit — otherwise you pay connection setup overhead/latency back to your DB over and over.

MityaOP•1/9/24, 10:59 AM

Thanks, everyone! Appreciate the suggestions, @Colin and interesting that it's only parameterised queries. And great news about the fix, @Matt - look forward to getting confirmation that that's live

MityaOP•1/9/24, 2:34 PM

This page in the HD docs says you can disable caching "using the wrangler CLI or the Cloudflare dashboard". It then gives this example:

npx wrangler hyperdrive update my-hyperdrive --disable-caching

npx wrangler hyperdrive update my-hyperdrive --disable-caching

However the

--disable-caching

--disable-caching

option isn't documented in the

hyperdrive update

hyperdrive update

docs, and the HD dashboard doesn't seem to provide any means to edit settings (see my hyperdrive). So is this just a case of the docs being out of sync?

MityaOP•1/9/24, 4:09 PM

(The docs also don't mention that you need to pass

--origin-password

--origin-password

with the above command, too.)

kian•1/9/24, 4:11 PM

Yeah, the Wrangler docs tend to get outdated quickly

MityaOP•1/9/24, 4:11 PM

Is that why I'm getting "Error - Unknown arguments: disable-caching, disableCaching" i.e. this option isn't live yet?

MityaOP•1/9/24, 4:16 PM

Yeah that command given by the docs is definitely not working, even with latest Wrangler. Command I'm using is

wrangler hyperdrive update my-hyperdrive-name --origin-password mypassword --disable-caching

wrangler hyperdrive update my-hyperdrive-name --origin-password mypassword --disable-caching

kian•1/9/24, 4:19 PM

it’s —caching-disabled (pass true/false)

kian•1/9/24, 4:19 PM

docs are wrong

MityaOP•1/9/24, 4:22 PM

I took that to be a different option, which tells you whether caching is disabld but doesn't allow you to set it. Are you saying that I can set it via that option, and if so do I just follow it with true/false?

MityaOP•1/9/24, 4:22 PM

Ah I see your edit.

kian•1/9/24, 4:22 PM

--caching-disabled  Whether caching query results is disabled for this Hyperdrive config  [boolean]

--caching-disabled  Whether caching query results is disabled for this Hyperdrive config  [boolean]

kian•1/9/24, 4:22 PM

honestly I'd recommend doing

wrangler <cmd> --help

wrangler <cmd> --help

over using the docs

kian•1/9/24, 4:23 PM

the docs fall out of sync

MityaOP•1/9/24, 4:23 PM

Ah OK cool. Wherever I found the

--caching-disabled

--caching-disabled

option I didn't see the boolean reference following it (or it wasn't there). I see it is there in

--help

--help

MityaOP•1/9/24, 4:31 PM

I've edited the docs and submitted a PR.

MMatt Silverlock We’re working with Mongo. Their driver is not simple to run in a (proper) server...

bryan•1/10/24, 4:40 AM

Is there any timeline for this support? Or even any other workarounds. Their data API is definitely not super performant (random 20sec spikes) and it doesn't support some crucial basics...like transactions (!)

Bbryan Is there any timeline for this support? Or even any other workarounds. Their dat...

Matt Silverlock•1/10/24, 10:16 AM

No. It’s dependent on Mongo’s driver — which we don’t control.

bryan•1/10/24, 2:15 PM

understood, but was hopeful you'd just enable TCP in a place I could write my own

any other workarounds you are aware of? do you know anyone successfully using an external connection pooler like prisma accelerate? i came across that last night

Bbryan understood, but was hopeful you'd just enable TCP in a place I could write my ow...

Matt Silverlock•1/10/24, 2:32 PM

You can write your own. Hyperdrive uses the socket API in Workers - the Postgres (and soon) MySQL drivers we support adopted that. MongoDB’s driver a) doesn’t yet run in any edge serverless runtime and b) holds a lot of client state. Both of these are big blockers to us.

https://blog.cloudflare.com/hyperdrive-making-regional-databases-feel-distributed

The Cloudflare Blog

Hyperdrive: making databases feel like they’re global

Hyperdrive makes accessing your existing databases from Cloudflare Workers, wherever they are running, hyper fast.

Bbryan understood, but was hopeful you'd just enable TCP in a place I could write my ow...

Matt Silverlock•1/10/24, 2:33 PM

IIRC Prisma Accelerate also doesn’t support Mongo, likely for many of the same architectural reasons (running a highly stateful Mongo proxy is non-trivial)

bryan•1/10/24, 2:37 PM

Good to know re: socket API, am I able to create connections that survive worker requests and selectively pool? Not seeing anything in the API docs for that specifically

bryan•1/10/24, 2:43 PM

I'll stop bugging, but are you aware of any active mongodb projects (from mong) to make the driver edge-compatible? Happy to go bark up their tree

MityaOP•1/10/24, 5:56 PM

Is there an issue with HD right now? Suddenly all my requests are giving this

MityaOP•1/10/24, 5:58 PM

Tried restarting the server, same deal

MityaOP•1/10/24, 5:59 PM

It's just come back up (with no code changes) but for ~5-10 mins that was all I was getting for every DB request.

MMitya It's just come back up (with no code changes) but for ~5-10 mins that was all I ...

Chaika•1/10/24, 6:13 PM

Intermittent API Availability

MityaOP•1/10/24, 6:22 PM

Thanks @Chaika

Bbryan Good to know re: socket API, am I able to create connections that survive worker...

Matt Silverlock•1/10/24, 7:38 PM

No, because pooling needs to be application-aware - there's not really a concept of a "generic TCP connection pooler" because any pooling needs to understand the application protocol layered on top - e.g. when a connection is "done" and can be re-used.

bryan•1/10/24, 9:01 PM

agreed, was hoping "mark for reuse" to be a part of the API! Otherwise, it should just close all connections at termination

ernest•1/12/24, 7:28 AM

Hey I am new to using Hyperdrive, but how do I get the IP range to whitelist for creating a hyperdrive? I have a public IP on Cloud SQL that i want to connect to but it's currently limiting access to a white listed IP range.

ernest•1/12/24, 7:49 AM

Ah okay read that we will need to wait for Tunnel to work with Hyperdrive, until then only fully public IP access is allowed

Eernest Hey I am new to using Hyperdrive, but how do I get the IP range to whitelist for...

Matt Silverlock•1/13/24, 12:14 AM

Correct, right now we require the server is publicly reachable. You can (if you want to) still do that with a Google Cloud SQL server - 0.0.0.0/00.0.0.0/0

MityaOP•1/24/24, 2:35 PM

Minor bug. If you enter an invalidly-formed connection string when creating a HD via the dashboard, you get a 400 but no UI feedback.

MityaOP•1/24/24, 2:50 PM

Are there plans to enable toggling of caching via the dashboard? As far as I can see this is achievable via CLI only (the dashboard reports the caching status, but you can't change it.)

MityaOP•1/24/24, 2:51 PM

Finally (sorry for all the questions at once), am I right in thinking that any HD-powered DB would need to be globally accessible i.e. no IP restrictions? Normally we restrict IPs only to the users/servers that connect to it, but I assume this isn't possible with Workers since the IPs would be unpredictable?

kian•1/24/24, 2:52 PM

am I right in thinking that any HD-powered DB would need to be globally accessible i.e. no IP restrictions?

Yes, but Cloudflare Tunnels/Magic WAN integrations are on the way.

MityaOP•1/25/24, 11:50 AM

If I want to specify a different HD binding for different environments, is the following the correct format?

[env.stage]
[[hyperdrive]]
binding = ...
id = ...

[env.prod]
[[hyperdrive]]
binding = ...
id = ...

[env.stage]
[[hyperdrive]]
binding = ...
id = ...

[env.prod]
[[hyperdrive]]
binding = ...
id = ...

(I'm a little shakey on TOML syntax.) Thank you.

kian•1/25/24, 11:50 AM

[[env.stage.hyperdrive]][[env.stage.hyperdrive]]