Cloudflare Developers•7mo ago

Is it still subject to the normal API Rate Limits? (1200/5m)?

CChaika Is it still subject to the normal API Rate Limits? (1200/5m)?

lambrospetrou•5/30/25, 3:56 PM

No changes were done there, yes.

Llambrospetrou No changes were done there, yes.

ChaikaOP•5/30/25, 4:23 PM

aw, that's a pretty big blocker for using the API for Dynamic D1 stuff, hopefully in the future it will be adjusted

CChaika aw, that's a pretty big blocker for using the API for Dynamic D1 stuff, hopefull...

lambrospetrou•5/30/25, 4:25 PM

Yeah there is a bit more work to do there, but if you have high traffic going through a worker is still best. REST API has the rate limiting, still needs to do auth, check your plan status, etc, so it will always have some delay even if rate limiting was higher. But yes, rate limiting is a common issue with the REST API. It's a thing folks want to improve across CF overall.

Muhammad nisar 0372•6/1/25, 6:32 AM

Muhammad nisar 0372•6/1/25, 6:33 AM

@lambrospetrou @lambrospetrou

Joe•6/3/25, 10:44 AM

Hello! I'm strugling to create a new D1 database (via wrangler and the web dashboard). I get an error about not being able to create more than 10, despite being a paid user with a limit of 50,000.

Any ideas?

JJoe Hello! I'm strugling to create a new D1 database (via wrangler and the web dashb...

Brayden•6/3/25, 2:29 PM

Are you still experiencing a problem here? Can you DM me your account ID?

Melissa1181•6/4/25, 5:51 AM

Hey

Rripes Claude integrations support was just released on Pro plan, and I really want to ...

lambrospetrou•6/4/25, 6:22 AM

Not at the moment, unfortunately, you will have to make sure all queries going through are read only.

Rripes Claude integrations support was just released on Pro plan, and I really want to ...

gruntlord6•6/5/25, 2:38 PM

could you have a worker in the middle that prevents writes from being passed?

gruntlord6•6/5/25, 2:38 PM

alternatively you could download the d1 export and spin up a local sqlite database

dsds10•6/5/25, 7:57 PM

Regarding the 50k db (soft) limit, how likely is this limit to be increased for non-enterprise customers?

davidbarratt•6/7/25, 12:55 AM

can you dynamically bind a D1 database? I'd like to have a database per-tennat that gets selected based on the request, but it doesn't look like that is posible without just using the REST API directly? Is that right?

Ddavidbarratt can you dynamically bind a D1 database? I'd like to have a database per-tennat t...

1984 Ford Laser•6/7/25, 12:57 AM

Durable Objects will be your best solution

11984 Ford Laser Durable Objects will be your best solution

davidbarratt•6/7/25, 1:02 AM

TIL about the SQL storage of Durable Objects... thanks!

Ddavidbarratt TIL about the SQL storage of Durable Objects... thanks!

1984 Ford Laser•6/7/25, 1:02 AM

You'll probably need a bit more boilerplate than with D1 but its a far better solution overall

Brayden•6/7/25, 1:23 AM

https://github.com/outerbase/starbasedb <- A project I made before joining Cloudflare but helps with the boilerplate on top of DO's for a D1 like experience.

BBrayden https://github.com/outerbase/starbasedb <- A project I made before joining Cloud...

dsds10•6/7/25, 8:44 AM

hmm that's interesting. somehow I had the "sqlite in do" stored as "ephemeral" in my mind, but checking the docs that's not the case. I also read that the max size in DO was 1GB, but this doesn't seem the case anymore (or never was)

what are the pro/cons of using sqlite in DO vs using D1?

bkyerv•6/7/25, 9:01 AM

why does wrangler d1 create [name] not work with oauth token (results in auth error) and requires api token? is it by design? or is it a known bug?

Ddsds10 hmm that's interesting. somehow I had the "sqlite in do" stored as "ephemeral" i...

Brayden•6/7/25, 11:04 AM

D1 is actually built on top of DO's as an interesting note. D1 uses the SQLite storage layer of DO's but as part of D1 there are also a bunch of boilerplate and helper functionality built on top to make it easier to interact with.

I also read that the max size in DO was 1GB

They did use to be 1GB not too long ago, but not it is 10GB

what are the pro/cons of using sqlite in DO vs using D1

Pros of DO: you have a lot more flexibility to do what you want. Compute & storage all at the same time. Cons of DO: you have to build the boilerplate interfacing systems to inspect them at the moment (but there are libraries that do this). From a storage layer perspective.. they are both DO SQLite!

Ddsds10 hmm that's interesting. somehow I had the "sqlite in do" stored as "ephemeral" i...

Larry•6/7/25, 11:12 AM

Pros: dynamic binding, hibernating WebSockets, ACID with stored procedures written in JavaScript

Cons: mental model shift from traditional 3 tier architecure

LLarry Pros: dynamic binding, hibernating WebSockets, ACID with stored procedures writt...

1984 Ford Laser•6/7/25, 11:56 AM

That mental model shift can be really hard for some people

dsds10•6/7/25, 1:26 PM

@Brayden thanks! what libraries are you referring to? Just made some tests to auto create instances of my backend system on demand and it works surprisingly well! kinda feels like making a cloud self service in a day

Am I right to assume read/writes are not counted like in D1 as it's effectively querying it "locally"? I think just the requests to the DO and the duration it lives is billed afaik.

@Larry seems like everything has it's pro's and con's

only scratched the surface of DO's so far, but it works great

dsds10•6/7/25, 2:37 PM

works like a charm! in case anyone curious, here is an example: https://example.bknd.run/ (ACL enabled)
you can create your own instance by changing the subdomain to whatever you like

really cool what D1 and DO enables us to create :cloudflare:

thipperz•6/7/25, 3:55 PM

My D1 is dead has been 10 hours

Apparently this happens if you try to export a remote database that has fts5 tables on it.

I would appreciate if someone from Cloudflare could take a look at workers-and-pages-helpD1 ERROR: Currently processing a long-running export

Ddsds10 works like a charm! in case anyone curious, here is an example: https://example....

1984 Ford Laser•6/8/25, 12:46 AM

Love to see when people 'figure out' DOs and realise how powerful and interesting they are
Just a note that you are still charged for SQL reads/writes in DOs, but the read pricing is very reasonable

Ddsds10 works like a charm! in case anyone curious, here is an example: https://example....

bkyerv•6/8/25, 4:31 AM

what?

gabrielstuff•6/9/25, 7:21 AM

Hello, are D1 database compatible with RGPD ?

Any DPA link or documentation about this CF product ?

Thanks

Tthipperz 🔴 My D1 is dead has been 10 hours 😭 Apparently this happens if you try to ex...

thipperz•6/9/25, 10:03 AM

My D1 and therefore my whole project is still down.

Its been down for more than 50 hours right now, hopefully I can get a fix today, PLEASE

Tthipperz My D1 and therefore my whole project is still down. Its been down for more than...

lambrospetrou•6/9/25, 10:57 AM

I rebooted your database now, so the stuck export should be gone. Sorry for the annoying behavior, it's been one of the things we need to prioritize. Please let me know if it looks fine on your side now too.

Llambrospetrou I rebooted your database now, so the stuck export should be gone. Sorry for the ...

thipperz•6/9/25, 10:59 AM

It is back now, thank you!!

parisholley•6/9/25, 5:50 PM

how much downtime can i expect if turning replication off on D1? i enabled for a portion of our customers and it just isn't realiable. at least once a week i feel like there are 10-20min outages

Pparisholley how much downtime can i expect if turning replication off on D1? i enabled for a...

lambrospetrou•6/9/25, 6:22 PM

What do you mean downtime? There shouldn't be a downtime. The replica information is cached in the locations where it has been used once, so it needs a few hours for them to completely stop being used, though.

at least once a week i feel like there are 10-20min outages

Can you give me details about this? What kind of outages? Was it due to replicas? In all regions, or specific ones? I don't recall some past message here. Feel free to DM me the database and account IDs and will check it.

parisholley•6/9/25, 6:26 PM

i'm not using any replica functionality, i just turned it on for some of our smaller clients as a test. the clients where we have turned it on keep reporting worker errors due to outages

Pparisholley i'm not using any replica functionality, i just turned it on for some of our sma...

lambrospetrou•6/9/25, 6:28 PM

the clients where we have turned it on keep reporting worker errors due to outages

What kind of errors? Can you provide me with some timeranges when these happened?

parisholley•6/9/25, 6:29 PM

sure, i'll dm you

Llambrospetrou > Also is there any way to prevent this replication? Like when does that happen?...

planet•6/10/25, 7:04 AM

just seen this. any news on EU jurisdiction yet - for gdpr?

Pplanet just seen this. any news on EU jurisdiction yet - for gdpr?

lambrospetrou•6/10/25, 7:18 AM

It's on the roadmap for next quarter, but no exact release date yet, depending on priority changes.

C•6/10/25, 12:37 PM

Hi, anyone have experiences on this?

D1 [ERROR] Currently processing a long-running export.

Database stucks during export, can not view from Cloudflare dashboard as well. (API error 500)

Now my website crashed due to this.
https://community.cloudflare.com/t/d1-error-currently-processing-a-long-running-export/806216

scotto•6/10/25, 4:36 PM

how do use d1 dynamically from a worker? for example passing a string with the id instead of the normal binding? for context, in a multi tenant where each tenant has a d1 database

CC Hi, anyone have experiences on this? D1 [ERROR] Currently processing a long-run...

lambrospetrou•6/10/25, 4:57 PM

Can you send me your account ID and database ID and I can restart the DB for you, if it's still stuck?
Is this the first time you tried to export and faced this issue or did this happen again another time for the specific database?
I am trying to pinpoint some common cases where exports take much longer than usual, hence why I am asking.

Sscotto how do use d1 dynamically from a worker? for example passing a string with the i...

dsds10•6/10/25, 8:57 PM

Afaik you have 3 ways to achieve this:

update worker bindings via the API to add an additional d1 database (docs states that you can theoretically bind up to 5k dbs, env limits)
use d1 over http (but queries are way slower)
use durable objects with sql storage (downside is that you can‘t use the tooling d1 offers)

Ddsds10 Afaik you have 3 ways to achieve this: 1. update worker bindings via the API to...

scotto•6/10/25, 8:59 PM

thanks, regarding DO with sql storage, it's actually possible to use N sql storages each one with the 1 gb limit?

Sscotto thanks, regarding DO with sql storage, it's actually possible to use N sql stora...

dsds10•6/10/25, 9:06 PM

Actually it‘s now 10gb, I just found out a few days ago that this limit was lifted. Afaik you can create unlimited DO‘s but each can only have a single sql storage

Llambrospetrou Can you send me your account ID and database ID and I can restart the DB for you...

C•6/10/25, 11:19 PM

My database back to normal now after 8 hours. It has around 400k rows and total size is 37 MB. Thank you!

FYI My account ID
32c307ab568d8c7e7f64f6694bce4ee4

Database ID
c932e1d8-5c3f-4c4b-b8d4-cd9352b58a85

Is it still subject to the normal API Rate Limits? (1200/5m)?

Similar Threads

Similar Threads

Similar Threads