Cloudflare Developers•5mo ago

To let us check, which database size are you referring to exactly? From API responses, billing, dash

To let us check, which database size are you referring to exactly? From API responses, billing, dashboard, etc.

Llambrospetrou To let us check, which database size are you referring to exactly? From API resp...

nejc•8/15/25, 2:13 PM

I am getting the same results from API and Dashboard

Nnejc I am getting the same results from API and Dashboard

lambrospetrouOP•8/15/25, 2:16 PM

Which API exactly? I checked your known accounts and don't see any drop in total size from our analytics. Please DM me more details instead of publicly here.

Llambrospetrou D1 is a more managed database over using SQLite Durable Objects directly, so it'...

Mech•8/15/25, 2:22 PM

I see

Mech•8/15/25, 2:22 PM

I was under the impression that kv was for small projects

Mech•8/15/25, 2:22 PM

D1 was if you want to scale

Mech•8/15/25, 2:23 PM

But most of my data is actually in r2

Mech•8/15/25, 2:23 PM

D1 holds references only

Mech•8/15/25, 2:23 PM

So that's ok

Mech•8/15/25, 2:23 PM

Cool

ac•8/18/25, 3:26 PM

We are having tons of D1 issues this morning. Anyone else?

Aac We are having tons of D1 issues this morning. Anyone else?

lambrospetrouOP•8/18/25, 5:09 PM

Any details to help any investigation? account/database IDs, timeranges?
There isn't any ongoing D1 service incident. There was a transient network blip a few hours ago, but not consistent and only in some locations.

onewug•8/18/25, 10:44 PM

hi!

if i have the following monorepo:

├── packages/
│   ├── worker/  
│   └── db/ 
└── apps/   
    └── app1/
    └── app2/

├── packages/
│   ├── worker/  
│   └── db/ 
└── apps/   
    └── app1/
    └── app2/

where app1 and app2 are two separate workers with separate wrangler files that share the same db instance and generally share the same worker logic implemented in packages/worker. can i somehow point the local db to the same db? or are they forced to be generated in their own local .wrangler folder?

Oonewug hi! if i have the following monorepo: ``` ├── packages/ │ ├── worker/ │ ...

James•8/19/25, 1:43 AM

--persist-to= flag on wrangler dev

Miku•8/19/25, 11:19 AM

Hi! I'm having trouble exporting a D1 database. What should I do?

MMiku Hi! I'm having trouble exporting a D1 database. What should I do?

gruntlord6•8/19/25, 1:33 PM

have a worker dump the tables

Samantas5855•8/19/25, 8:44 PM

Is the Maximum SQL statement length not a thing anymore? I was able to write over 200kb in a single cell with a single bind statement

SSamantas5855 Is the Maximum SQL statement length not a thing anymore? I was able to write ove...

lambrospetrouOP•8/19/25, 8:56 PM

Each row fits 2MB. Did you have the full 200KB hardcoded in the query SQL statement or you said you used the

bind()

bind()

?
What was your query?

Llambrospetrou Each row fits 2MB. Did you have the full 200KB hardcoded in the query SQL statem...

Samantas5855•8/19/25, 9:13 PM

Does the query with variables count the questionmarks only for length? I did use variables and put a bunch of data in bind()

SSamantas5855 Does the query with variables count the questionmarks only for length? I did use...

lambrospetrouOP•8/19/25, 10:20 PM

Yes, the limit applies to the statement, not the data bound.

Jun•8/20/25, 5:00 PM

FYI: We've updated the D1 error docs today!

https://developers.cloudflare.com/d1/observability/debug-d1/#error-list

Ccloudkite We are building a db per customer architecture and were holding out for dynamic ...

flof.fly•8/20/25, 10:02 PM

Tom•8/21/25, 8:54 AM

Hey, yesterday, during our burst load, we received 153 "D1_ERROR: D1 DB is overloaded. Too many requests queued." on our d1 db while serving about 161k queries for ~30 minutes. It's a lot of queries and it seems like we managed to just stand of the edge of a single D1 db capacity. Do you guys at Cloudflare see more statistics about databases hidden to us users that ought to be interesting?

Tom•8/21/25, 8:54 AM

The ID is 94f2eff2-6fa1-4350-bb8f-121c5da3ed3e

GuillaumeLakano•8/22/25, 3:59 PM

Hi! On a internal computer of our company, we would like to export our production D1 database every 10 minutes ( from the CLI wrangler d1 export ). Is someone from the CF staff can confirm us it's tolerated and this will not be blocked or against the CF policies please?

GGuillaumeLakano Hi! On a internal computer of our company, we would like to export our productio...

lambrospetrouOP•8/22/25, 4:06 PM

There is no policy against doing that, but keep in mind that whle exporting your database is blocked from serving any queries, so doing it every 10 minutes, especially if it's more than a few hundred MBs, it's not going to be a nice experience to your users.

Original message was deleted

lambrospetrouOP•8/22/25, 5:31 PM

Not at the moment. Hopefully we will get to refactoring the whole export flow soon, and that won't be necessary.

Larry•8/22/25, 5:31 PM

With read-replicas, it should be a lot easier. Detach a replica and export that.

GGuillaumeLakano Hi! On a internal computer of our company, we would like to export our productio...

gruntlord6•8/22/25, 10:32 PM

Every 10 minutes seems excessive since you can just read the database directly or use time travel for restores between your backup periods. Is there something in the use case that requires that frequency?

Ggruntlord6 have a worker dump the tables

Miku•8/23/25, 11:13 AM

use worker to export?

MMiku use worker to export?

gruntlord6•8/23/25, 1:20 PM

workers can read table entries so you can just have it read the tables and save it to r2

Advany•8/25/25, 9:08 AM

how can I protect d1 that it can't be access using wrangler? (I want to prevent claude code from deleting data or dropping tables etc)

Devoto•8/25/25, 10:45 AM

Hey there, just wondering, for highly relational data, how does 10GB size limit make sense? How do production apps go around that?

DDevoto Hey there, just wondering, for highly relational data, how does 10GB size limit ...

Larry•8/25/25, 12:33 PM

Tricky question. To get scale, what many people on here do is they switch from using D1 to using Durable Objects which allow you to spit the work and data storage up across many instances. However, you said "highly relational data" and that's more complex when your relationships are on the other side of a network hop. There are strategies for doing that like the Actors model (and Cloudflare has an Actor base class for Durable Object now). Even so, I would only recommend that if there is a relatively clean way to split up the work/storage (per user, per tenant, etc.). So for consistently "highly relational data", your best choice might be to use an external scale-up style database solution. Cloudflare uses Postgres for some of its own internal needs so there is good support for doing that. Check out Cloudflare's Hyperdrive offering if you think that's the way to go for you: https://developers.cloudflare.com/hyperdrive/

Cloudflare Docs

Hyperdrive

Hyperdrive is a service that accelerates queries you make to existing databases, making it faster to access your data from across the globe from Cloudflare Workers, irrespective of your users' location.

LLarry Tricky question. To get scale, what many people on here do is they switch from u...

Devoto•8/25/25, 2:37 PM

Thank you very much, this makes a lot of sense, I was actually looking at the exact same page you linked before seeing your message, and indeed it perfectly fits our needs as we have a postgres database already and it is almost impossible to break up the data model to an actor model since data model is tightly coupled. However, I have two questions:

1. Will cloudflare support higher DO or D1 in a pay per usage model similar to something like R2 in the future?
2. Does hyperdrive cache the transaction queries (select statements in a transaction) or is it just caching select statements outside transactions?

Many thanks!

DDevoto Thank you very much, this makes a lot of sense, I was actually looking at the ex...

Larry•8/25/25, 5:49 PM

1. I don’t know of any plans for that but I don’t work for Cloudflare and I never say never
2. My knowledge of hyperdrive consists of being aware that it exits and skimming that page a few times in the past. Sorry. Others on here may have hands on experience.

DDevoto Thank you very much, this makes a lot of sense, I was actually looking at the ex...

knickish•8/25/25, 5:54 PM

Only select statements outside of transactions are cached in Hyperdrive.

LLarry 1. I don’t know of any plans for that but I don’t work for Cloudflare and I neve...

Devoto•8/25/25, 7:26 PM

Excellent, thank you very much.

Kknickish Only select statements outside of transactions are cached in Hyperdrive.

Devoto•8/25/25, 7:26 PM

Appreciated!

Isaac McFadyen•8/25/25, 7:27 PM

Note that D1's existing limits are currently hard architectural limits (the 10GB limit I mean), it's not an artificial limit.

Sathyamshu•8/26/25, 7:02 AM

How to plan the database split for an application with more writes and reads? (cause the hard limit for a db is just 10 GB)
1. create databases with limited number of releatable tables
2. replicate the whole db structure, scale them horizontally and query them using the workers to map the right db
3. Please answer

which is the best practice? what does cloudflare recommend?
what's the next best alternative for this ?

SSathyamshu How to plan the database split for an application with more writes and reads? (c...

lambrospetrouOP•8/26/25, 8:04 AM

If you need a handful of DBs, D1 works fine, pre-create all the DBs upfront and attach them to your worker and use them as you wish.

If you need hundreds/thousands/millionds of these DBs, then it's much better to use SQLite Durable Objects. It's the same underlying storage and SQLite engine, but you have a much easier dev experience to use as many DBs as you wish.

Mech•8/26/25, 5:55 PM

Hey, is there a way to increase the 10 databases limit?

Llambrospetrou If you need a handful of DBs, D1 works fine, pre-create all the DBs upfront and ...

Mech•8/26/25, 5:56 PM

Oh, I see.

MMech Hey, is there a way to increase the 10 databases limit?

Chaika•8/26/25, 5:57 PM

Upgrade to Workers paid for 50k databases limit and you can ask for more after

Mech•8/26/25, 5:58 PM

Aha

Mech•8/26/25, 5:58 PM

I couldn't find in the docs

Chaika•8/26/25, 5:59 PM

ah all the limits are here: https://developers.cloudflare.com/d1/platform/limits/
Databases is top line

Cloudflare Docs

Limits

Cloudflare also offers other storage solutions such as Workers KV, Durable Objects, and R2. Each product has different advantages and limits. Refer to Choose a data or storage product to review which storage option is right for your use case.

Mech•8/26/25, 5:59 PM

Thank you

Silvan•8/27/25, 5:43 PM

So about the topic of d1 being able to randomly fail a query once in a blue moon. what is the exact error that it spits out? is it just a D1_ERRORD1_ERROR ?

To let us check, which database size are you referring to exactly? From API responses, billing, dash

Similar Threads

Similar Threads

Similar Threads