Cloudflare Developers•5mo ago

Is Cloudflare working on removing the 10 GB limit from D1? This feels quite limiting for a productio

Is Cloudflare working on removing the 10 GB limit from D1? This feels quite limiting for a production database…

LengoOP•8/15/25, 4:34 AM

Also, will D1 auto scale to any number of requests?

LLengo Is Cloudflare working on removing the 10 GB limit from D1? This feels quite limi...

lambrospetrou•8/15/25, 6:37 AM

No, 10GB is a hard limit at the moment. No immediate plans to change that.

LLengo Also, will D1 auto scale to any number of requests?

lambrospetrou•8/15/25, 6:38 AM

Also no, see my answer a few messages above for the same question: d1-database

If you need a traditional "big machine" database, you might be better off with Hyperdrive + any database provider of your choice.

LengoOP•8/15/25, 6:40 AM

okay thanks

LengoOP•8/15/25, 6:40 AM

I'm probably just going to use Neon... if I could provide a suggestion, a service like theirs in the Cloudflare dev platform would be very cool

LengoOP•8/15/25, 6:44 AM

I'm curious... who is D1 intended for?

LLengo I'm curious... who *is* D1 intended for?

lambrospetrou•8/15/25, 6:47 AM

D1 is a more managed database over using SQLite Durable Objects directly, so it's great when you can shard your application data model across several of them. Sweet spot is a few tens so not exactly per user but not limited by the 10GB limit either, if you need more than that in the thousands you are better to use DOs directly.

Imagine apps like the trendy vibe coding platforms nowadays where you need a database for millions of independent projects and each one is self-contained and small, just as an example where it fits great. Or internal projects that fit within 10GB (or N multiples of them where sharding comes naturally) and the traffic is not crazy.

LengoOP•8/15/25, 6:49 AM

Ah, so not for something like a social media app for example?

LLengo Ah, so not for something like a social media app for example?

lambrospetrou•8/15/25, 6:51 AM

Well, social media is broad. If you are building Facebook, no. If you are building your own version of a small social media platform you could involve D1 in certain aspects for sure, e.g. for things that are private to a user. But then it also depends no usage, so just by a 2-word description it's not obvious. Again, my guideline rule is that if you are fine with 0-100GB of total storage and requests are not tens of thousands per second, D1 can work.
Otherwise, if sharding is natural to your app, SQLite DOs, otherwise Hyperdrive + any external traditional database.

LengoOP•8/15/25, 6:51 AM

Okay, got it. Thanks!

nejc•8/15/25, 1:04 PM

Did something change in how Cloudflare is calculating D1 DB size. All of the sudden all databases are half of the size that they were in the past. Any insights into what is happening? Thank you

Nnejc Did something change in how Cloudflare is calculating D1 DB size. All of the sud...

lambrospetrou•8/15/25, 1:53 PM

To let us check, which database size are you referring to exactly? From API responses, billing, dashboard, etc.

Llambrospetrou To let us check, which database size are you referring to exactly? From API resp...

nejc•8/15/25, 2:13 PM

I am getting the same results from API and Dashboard

Nnejc I am getting the same results from API and Dashboard

lambrospetrou•8/15/25, 2:16 PM

Which API exactly? I checked your known accounts and don't see any drop in total size from our analytics. Please DM me more details instead of publicly here.

Llambrospetrou D1 is a more managed database over using SQLite Durable Objects directly, so it'...

Mech•8/15/25, 2:22 PM

I see

Mech•8/15/25, 2:22 PM

I was under the impression that kv was for small projects

Mech•8/15/25, 2:22 PM

D1 was if you want to scale

Mech•8/15/25, 2:23 PM

But most of my data is actually in r2

Mech•8/15/25, 2:23 PM

D1 holds references only

Mech•8/15/25, 2:23 PM

So that's ok

Mech•8/15/25, 2:23 PM

Cool

ac•8/18/25, 3:26 PM

We are having tons of D1 issues this morning. Anyone else?

Aac We are having tons of D1 issues this morning. Anyone else?

lambrospetrou•8/18/25, 5:09 PM

Any details to help any investigation? account/database IDs, timeranges?
There isn't any ongoing D1 service incident. There was a transient network blip a few hours ago, but not consistent and only in some locations.

onewug•8/18/25, 10:44 PM

hi!

if i have the following monorepo:

├── packages/
│   ├── worker/  
│   └── db/ 
└── apps/   
    └── app1/
    └── app2/

├── packages/
│   ├── worker/  
│   └── db/ 
└── apps/   
    └── app1/
    └── app2/

where app1 and app2 are two separate workers with separate wrangler files that share the same db instance and generally share the same worker logic implemented in packages/worker. can i somehow point the local db to the same db? or are they forced to be generated in their own local .wrangler folder?

Oonewug hi! if i have the following monorepo: ``` ├── packages/ │ ├── worker/ │ ...

James•8/19/25, 1:43 AM

--persist-to= flag on wrangler dev

Miku•8/19/25, 11:19 AM

Hi! I'm having trouble exporting a D1 database. What should I do?

MMiku Hi! I'm having trouble exporting a D1 database. What should I do?

gruntlord6•8/19/25, 1:33 PM

have a worker dump the tables

Samantas5855•8/19/25, 8:44 PM

Is the Maximum SQL statement length not a thing anymore? I was able to write over 200kb in a single cell with a single bind statement

SSamantas5855 Is the Maximum SQL statement length not a thing anymore? I was able to write ove...

lambrospetrou•8/19/25, 8:56 PM

Each row fits 2MB. Did you have the full 200KB hardcoded in the query SQL statement or you said you used the bind()bind()?
What was your query?

Llambrospetrou Each row fits 2MB. Did you have the full 200KB hardcoded in the query SQL statem...

Samantas5855•8/19/25, 9:13 PM

Does the query with variables count the questionmarks only for length? I did use variables and put a bunch of data in bind()

SSamantas5855 Does the query with variables count the questionmarks only for length? I did use...

lambrospetrou•8/19/25, 10:20 PM

Yes, the limit applies to the statement, not the data bound.

Jun•8/20/25, 5:00 PM

FYI: We've updated the D1 error docs today!

https://developers.cloudflare.com/d1/observability/debug-d1/#error-list

Ccloudkite We are building a db per customer architecture and were holding out for dynamic ...

flof.fly•8/20/25, 10:02 PM

Tom•8/21/25, 8:54 AM

Hey, yesterday, during our burst load, we received 153 "D1_ERROR: D1 DB is overloaded. Too many requests queued." on our d1 db while serving about 161k queries for ~30 minutes. It's a lot of queries and it seems like we managed to just stand of the edge of a single D1 db capacity. Do you guys at Cloudflare see more statistics about databases hidden to us users that ought to be interesting?

Tom•8/21/25, 8:54 AM

The ID is 94f2eff2-6fa1-4350-bb8f-121c5da3ed3e

GuillaumeLakano•8/22/25, 3:59 PM

Hi! On a internal computer of our company, we would like to export our production D1 database every 10 minutes ( from the CLI wrangler d1 export ). Is someone from the CF staff can confirm us it's tolerated and this will not be blocked or against the CF policies please?

GGuillaumeLakano Hi! On a internal computer of our company, we would like to export our productio...

lambrospetrou•8/22/25, 4:06 PM

There is no policy against doing that, but keep in mind that whle exporting your database is blocked from serving any queries, so doing it every 10 minutes, especially if it's more than a few hundred MBs, it's not going to be a nice experience to your users.

Original message was deleted

lambrospetrou•8/22/25, 5:31 PM

Not at the moment. Hopefully we will get to refactoring the whole export flow soon, and that won't be necessary.

Larry•8/22/25, 5:31 PM

With read-replicas, it should be a lot easier. Detach a replica and export that.

GGuillaumeLakano Hi! On a internal computer of our company, we would like to export our productio...

gruntlord6•8/22/25, 10:32 PM

Every 10 minutes seems excessive since you can just read the database directly or use time travel for restores between your backup periods. Is there something in the use case that requires that frequency?

Ggruntlord6 have a worker dump the tables

Miku•8/23/25, 11:13 AM

use worker to export?

MMiku use worker to export?

gruntlord6•8/23/25, 1:20 PM

workers can read table entries so you can just have it read the tables and save it to r2

Advany•8/25/25, 9:08 AM

how can I protect d1 that it can't be access using wrangler? (I want to prevent claude code from deleting data or dropping tables etc)

Devoto•8/25/25, 10:45 AM

Hey there, just wondering, for highly relational data, how does 10GB size limit make sense? How do production apps go around that?

DDevoto Hey there, just wondering, for highly relational data, how does 10GB size limit ...

Larry•8/25/25, 12:33 PM

Tricky question. To get scale, what many people on here do is they switch from using D1 to using Durable Objects which allow you to spit the work and data storage up across many instances. However, you said "highly relational data" and that's more complex when your relationships are on the other side of a network hop. There are strategies for doing that like the Actors model (and Cloudflare has an Actor base class for Durable Object now). Even so, I would only recommend that if there is a relatively clean way to split up the work/storage (per user, per tenant, etc.). So for consistently "highly relational data", your best choice might be to use an external scale-up style database solution. Cloudflare uses Postgres for some of its own internal needs so there is good support for doing that. Check out Cloudflare's Hyperdrive offering if you think that's the way to go for you: https://developers.cloudflare.com/hyperdrive/

Cloudflare Docs

Hyperdrive

Hyperdrive is a service that accelerates queries you make to existing databases, making it faster to access your data from across the globe from Cloudflare Workers, irrespective of your users' location.

LLarry Tricky question. To get scale, what many people on here do is they switch from u...

Devoto•8/25/25, 2:37 PM

Thank you very much, this makes a lot of sense, I was actually looking at the exact same page you linked before seeing your message, and indeed it perfectly fits our needs as we have a postgres database already and it is almost impossible to break up the data model to an actor model since data model is tightly coupled. However, I have two questions:

1. Will cloudflare support higher DO or D1 in a pay per usage model similar to something like R2 in the future?
2. Does hyperdrive cache the transaction queries (select statements in a transaction) or is it just caching select statements outside transactions?

Many thanks!

DDevoto Thank you very much, this makes a lot of sense, I was actually looking at the ex...

Larry•8/25/25, 5:49 PM

1. I don’t know of any plans for that but I don’t work for Cloudflare and I never say never
2. My knowledge of hyperdrive consists of being aware that it exits and skimming that page a few times in the past. Sorry. Others on here may have hands on experience.

DDevoto Thank you very much, this makes a lot of sense, I was actually looking at the ex...

knickish•8/25/25, 5:54 PM

Only select statements outside of transactions are cached in Hyperdrive.

LLarry 1. I don’t know of any plans for that but I don’t work for Cloudflare and I neve...

Devoto•8/25/25, 7:26 PM

Excellent, thank you very much.

Is Cloudflare working on removing the 10 GB limit from D1? This feels quite limiting for a productio

Similar Threads

Similar Threads

Similar Threads