Cloudflare Developers•8mo ago

Did the concept of D1 Procedures ever get implemented? (https://blog.cloudflare.com/whats-new-with-d

Did the concept of D1 Procedures ever get implemented? (https://blog.cloudflare.com/whats-new-with-d1/)

The Cloudflare Blog

D1: our quest to simplify databases

Get an inside look on the D1 experience today, what the team is currently working on and what’s coming up!

Vverdverm.com Did the concept of D1 Procedures ever get implemented? (https://blog.cloudflare....

Larry•5/26/25, 12:08 AM

I'm not sure if they ever intended differently but a version of that was implemented when they brought the SQLite storage engine to Durable Objects. My impression is that the success of DOs is the reason why features like D1 Procedures and Dynamic Binding have not been implemented.

gruntlord6•5/26/25, 1:59 AM

I think they more or less said DOs will support the same things as D1 at some point, but they each have some features that the other does not

gruntlord6•5/26/25, 1:59 AM

I could be remembering what they said wrong though

cosbgn•5/26/25, 12:42 PM

Hey id d1 down or something?

cosbgn•5/26/25, 12:42 PM

I keep getting :D1 DB exceeded its CPU time limit and was reset. [code: 7500] when trying to run a migration

cosbgn•5/26/25, 12:46 PM

I'm stuck - migration passed locally but d1 just runs out of cpu

aliendev•5/26/25, 8:21 PM

Hi, I've just discovered Outerbase Studio from the recent Acquisition announcement, it's great news to see it become part of CloudFlare. I was thinking about implementing it in a project I'm working on, but I found that the license is AGPL which prevents me from doing that without making my codebase public. Since the original cloud offering is now closed for new users and sunsetting soon, and seeing that the original repo is no longer active, would it be possible to make the license less prohibitive ?

Aaliendev Hi, I've just discovered Outerbase Studio from the recent Acquisition announceme...

lambrospetrou•5/27/25, 9:19 AM

I was thinking about implementing it in a project I'm working on

Do you mean using the Outerbase Studio with your D1 databases, or do you just want to use it in a completely different project unrelated to D1? Just clarifying since this the D1 channel.

aliendev•5/27/25, 11:36 AM

I want to make it part of my hosted dashboard, so that my users can access and edit their own DBs, which are all part of a single multi-tenant D1 database (and the project itself will be deployed using CF workers).
so to answer your question, my use case is for a different project, but related to D1 and fully part of the CF ecosystem.

Aaliendev I want to make it part of my hosted dashboard, so that my users can access and e...

lambrospetrou•5/27/25, 11:55 AM

I will ask the outerbase folks and let you know (or they will reply directly)

aliendev•5/27/25, 12:15 PM

thank you

Brayden•5/27/25, 2:56 PM

@aliendev At the moment there are no plans to change the license on the repositories, sorry...

BBrayden @aliendev At the moment there are no plans to change the license on the reposito...

aliendev•5/27/25, 3:11 PM

got it, no worries. thanks !

Paul Mihai•5/28/25, 2:23 PM

Hi everyone, I have a 3gb database with multiple keys (one line can be quite large - a few kb - but the blobs are not part of any keys), the maximum size is 10gb, but for some reason querying even this small DB is very slow (even simple queries take up to a minute). I use composite keys. Anybody else seeing this type of behavior? Noteworthy is the fact that this db experiences a lot of writes as it is a live stats marting table.

Spencer•5/28/25, 2:39 PM

hey, i need some help please, got an error D1 ERROR: Currently processing a long-running export, how to cancel this operation ? cause because of it my app stops working

SSpencer hey, i need some help please, got an error D1 ERROR: Currently processing a long...

lambrospetrou•5/28/25, 3:40 PM

If you are doing an export the whole DB is blocked until it uploads everything to R2. If you want to abort the export, then unfortunately you need to stop polling and wait a few seconds for it to stop.

PPaul Mihai Hi everyone, I have a 3gb database with multiple keys (one line can be quite lar...

lambrospetrou•5/28/25, 3:42 PM

What is the

.meta

.meta

information telling you about the duration of the query itself? 1 minute is very long either way and probably hints to other issues, commonly overloaded DB due to traffic or slow-ish consecutive queries.
Also, are all your queries slow, or just that specific one?

Paul Mihai•5/28/25, 3:42 PM

Writing seems to be perfectly fine, but querying especially on high writing load is suuuuper slow

Paul Mihai•5/28/25, 3:43 PM

we have a few million writes / day

PPaul Mihai Writing seems to be perfectly fine, but querying especially on high writing load...

lambrospetrou•5/28/25, 3:43 PM

Keep in mind that D1 is single threaded. Only one query executes at a time.

Paul Mihai•5/28/25, 3:43 PM

but just a few reads a day

Paul Mihai•5/28/25, 3:43 PM

so the problem may be the queue

Paul Mihai•5/28/25, 3:43 PM

because we have so many writes?

PPaul Mihai so the problem may be the queue

lambrospetrou•5/28/25, 3:44 PM

Yes, maybe. Check the

meta

meta

field of the responses for the duration listed. If that's small (a few milliseconds) then the issue is not the query itself. It can be either the volume of your load (number of requests and time each write query takes to finish) or some networking issue. The latency of the query is also available in the UI and through wrangler insights.

Paul Mihai•5/28/25, 3:45 PM

I'll do that! Thanks! Also I understood there is a "new" version of D1?

Paul Mihai•5/28/25, 3:46 PM

is that still a thing or were all migrated to the new backend?

Llambrospetrou If you are doing an export the whole DB is blocked until it uploads everything t...

Spencer•5/28/25, 3:46 PM

but i am not polling atm, it's just stuck, there is a way to cancel the process somehow ?

PPaul Mihai I'll do that! Thanks! Also I understood there is a "new" version of D1?

lambrospetrou•5/29/25, 10:30 AM

You probably mean a new version of Durable Objects, not D1. The SQLite based DOs are new-ish yes, but D1 was already built ontop of those. There is no new version of D1.

Zig•5/29/25, 6:23 PM

Does anyone have experience troubleshooting D1_ERROR: Failed to parse body as JSON, got: Error: internal error;D1_ERROR: Failed to parse body as JSON, got: Error: internal error; or D1_ERROR: database is locked: SQLITE_BUSYD1_ERROR: database is locked: SQLITE_BUSY in local development? im hoping this goes away when i deploy it...

Zig•5/29/25, 6:36 PM

Im running a pages app with D1 locally, and a DO thats accessed through both a DO binding in pages and a separate worker for the DO thats sometimes called by pages. The DO worker is ran with wrangler persisting the state to the pages worker D1 instance. The pages worker calls the DO to do some work and it modifies D1, the DO sends web socket messages to pages occasionally as it runs forcing pages to fetch D1 data.

I am getting seemingly random SQLITE and D1 errors that appear in random order, and arent confined to any one section of my code. Is this just a byproduct of trying to use 2 instances of wrangler, one with the persist-to flag on local environments? Or is this indicative of a problem with my usage patterns? Will this still happen on deployed instances?

Zig•5/29/25, 9:45 PM

Update: Deployed version works flawlessly. Guessing its some issue with 2 wrangler instances trying to use the D1 file at the same time

lambrospetrou•5/30/25, 3:19 PM

We released some improvements to the D1 REST API a few days ago and now most endpoints should have some speedup. The query endpoints especially now should be much faster if you are outside the US.

Read more in the changelog: https://developers.cloudflare.com/changelog/2025-05-30-d1-rest-api-latency/

Would love to see if anyone notices this in their graphs.

Cloudflare Docs

50-500ms Faster D1 REST API Requests

Llambrospetrou 🚀 We released some improvements to the D1 REST API a few days ago and now most...

Chaika•5/30/25, 3:42 PM

Is it still subject to the normal API Rate Limits? (1200/5m)?

CChaika Is it still subject to the normal API Rate Limits? (1200/5m)?

lambrospetrou•5/30/25, 3:56 PM

No changes were done there, yes.

Llambrospetrou No changes were done there, yes.

Chaika•5/30/25, 4:23 PM

aw, that's a pretty big blocker for using the API for Dynamic D1 stuff, hopefully in the future it will be adjusted

CChaika aw, that's a pretty big blocker for using the API for Dynamic D1 stuff, hopefull...

lambrospetrou•5/30/25, 4:25 PM

Yeah there is a bit more work to do there, but if you have high traffic going through a worker is still best. REST API has the rate limiting, still needs to do auth, check your plan status, etc, so it will always have some delay even if rate limiting was higher. But yes, rate limiting is a common issue with the REST API. It's a thing folks want to improve across CF overall.

Muhammad nisar 0372•6/1/25, 6:32 AM

Muhammad nisar 0372•6/1/25, 6:33 AM

@lambrospetrou @lambrospetrou

Joe•6/3/25, 10:44 AM

Hello! I'm strugling to create a new D1 database (via wrangler and the web dashboard). I get an error about not being able to create more than 10, despite being a paid user with a limit of 50,000.

Any ideas?