btw is there any progress on this: https://github.com/cloudflare/workers-sdk/issues/5438

GitHub

🚀 Feature Request: Allow turning off foreign key check while mig...

Some table altering tasks in SQLite cannot be achieved without replacing it with a new table (by dropping - recreating the table) (like adding foreign keys, changing primary keys, updating column t...

Tony LeungOP•9/17/25, 9:32 AM

i guess this is not a trivial problem to fix

TTony Leung btw is there any progress on this: https://github.com/cloudflare/workers-sdk/iss...

lambrospetrou•9/17/25, 9:33 AM

Import/export/migrations is a big bucket of things we want to start tackling soon.

Llambrospetrou Import/export/migrations is a big bucket of things we want to start tackling soo...

Larry•9/17/25, 11:44 AM

What I really want is as simple and flexible as disconnect a replica and save the .sqlite file in R2.

LLarry What I really want is as simple and flexible as disconnect a replica and save th...

lambrospetrou•9/17/25, 11:59 AM

Yeah, this flow is among the options we discuss. It's a matter of resourcing

Larry•9/17/25, 12:52 PM

I also want whatever you do to come to DOs also

gruntlord6•9/17/25, 1:43 PM

I just want dynamic bindings, I don't always want the full complexity of a do in every case that I want accessible storage

Ggruntlord6 I just want dynamic bindings, I don't always want the full complexity of a do in...

lambrospetrou•9/17/25, 2:00 PM

Have you checked the https://github.com/cloudflare/actors library? If you need to be able to create as many DBs as you want, then this gets you quite far with little code. You don't need to write a lot of code.

You lose the import/export/wrangler/D1 UI tooling, though.

Llambrospetrou Have you checked the https://github.com/cloudflare/actors library? If you need t...

gruntlord6•9/17/25, 4:43 PM

theres still a lot of edge cases you have with durable objects, the tooling being one of them. I can make tooling per project but D1 has much more along the lines of batteries included tools. Being able to dynamically bind solves a lot more issues

Ggruntlord6 theres still a lot of edge cases you have with durable objects, the tooling bein...

lambrospetrou•9/17/25, 4:50 PM

Yeah the batteries included things are what gradually I would like us (personal opinion) to also make available for DOs, and then the choice is simpler. If D1 got dynamic bindings then it would be 90% identical to DOs, and duplicated effort from all fronts. But, yeah, everything you say is a common internal debate we are having.

YYS•9/18/25, 1:53 PM

I'm using D1 for an app that has 5 tables, 4 of them have a foreign key reference to table1. Now I'd like to delete a few columns in table1, but since D1 does not support ALTER TABLE DROP COLUMN, the only way to accomplish that is to create a new table, copy the data and then replace the original table. However, since the table is referenced by foreign key and D1 does not support PRAGMA foreign_keys=OFF it fails to delete and recreate it. Can you please advise what is the path forward for this scenario?

Ehbraheem•9/18/25, 7:19 PM

Hi @lambrospetrou

Does D1 has SQLite vector extension support

EEhbraheem Hi @lambrospetrou Does D1 has SQLite vector extension support

Hard@Work•9/18/25, 9:42 PM

?pings

SuperHelpflare•9/18/25, 9:42 PM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

HHard@Work ?pings

Ehbraheem•9/18/25, 9:46 PM

I’m asking if D1 supports the SQLite vector type and it’s corresponding HNSW index for vector similarity searches

EEhbraheem I’m asking if D1 supports the SQLite vector type and it’s corresponding HNSW ind...

Chaika•9/18/25, 10:05 PM

yea, and he was saying not to ping people

Chaika•9/18/25, 10:05 PM

there's docs about the supported extensions here: https://developers.cloudflare.com/d1/sql-api/sql-statements/#supported-sqlite-extensions (no vector support)
Cloudflare has a dedicated vector storage db: https://developers.cloudflare.com/vectorize/

CChaika there's docs about the supported extensions here: https://developers.cloudflare....

Ehbraheem•9/18/25, 10:07 PM

Oh I missed that. Thanks for the link.

Vectorize as a funny pricing option for our use case and we are already using direct SQLite embedding with great performance

Need_Not•9/19/25, 9:44 PM

occasionally i'll get the error cause: Error: D1_ERROR: Failed to parse body as JSON, got: error code: 1031cause: Error: D1_ERROR: Failed to parse body as JSON, got: error code: 1031 and i have no idea what causes it. I restart my server an it stops doing it

Need_Not•9/19/25, 9:46 PM

sometimes it's the session table, this case it was the folders table. I don't even know if its' something i'm doing or related to the table.

NNeed_Not occasionally i'll get the error `cause: Error: D1_ERROR: Failed to parse body as...

lambrospetrou•9/19/25, 11:08 PM

Do you get this through the REST API or through the Worker API?
The error Failed to parse body as JSONFailed to parse body as JSON is thrown when the request body is not a valid JSON, before even validating the actual contents.

Need_Not•9/19/25, 11:09 PM

Worker... I'm using drizzle just db = drizzle(env.DB)db = drizzle(env.DB)

Need_Not•9/19/25, 11:09 PM

@lambrospetrou

Need_Not•9/19/25, 11:10 PM

The thing is it's the same code that is running but once it happens it happens. For some context I'm running locally but a lot of the services including D1 are remote. I don't know if hot reloading is playing anything or not.

NNeed_Not The thing is it's the same code that is running but once it happens it happens. ...

lambrospetrou•9/19/25, 11:10 PM

Are you getting the error when running locally, or when the worker is running in production? It's unlikely that the D1 binding has this issue, unless some network problem did not transmit the complete request, but you should be failing anyway in that case.

Llambrospetrou Are you getting the error when running locally, or when the worker is running in...

Need_Not•9/20/25, 1:48 AM

I'm developing right now which is running locally. I have my D1 along with the rest of the stack remote.

Need_Not•9/20/25, 1:49 AM

message.txt2.82KB

Need_Not•9/20/25, 1:50 AM

it's sorta rare an i'm not able to recreate it. Once it happens though it happens everytime until i restart

52Hz•9/21/25, 4:49 PM

My D1 database frequently reports errors during read and write operations. Is there a problem with the database server? The error message is similar to this: Error: Failed query: select "id", "uid". . .Error: Failed query: select "id", "uid". . .

52Hz•9/21/25, 4:50 PM

552Hz My D1 database frequently reports errors during read and write operations. Is th...

lambrospetrou•9/21/25, 10:15 PM

What is the exact error you are getting? That seems to be from SQLite?

52Hz•9/22/25, 1:20 AM

Failed query: ${sql string}Failed query: ${sql string} ; It's all like this, whether it's select, delete or insert.

552Hz `Failed query: ${sql string}` ; It's all like this, whether it's select, delete...

cloudkite•9/22/25, 2:07 AM

Based on that error looks like you are using drizzle? if so drizzle wraps sql execution errors with their own error. So youll need check the error type with instanceof and then do console.error(error.cause) see https://github.com/drizzle-team/drizzle-orm/blob/37d059f95ebe4ca7da6e60415de0164c729a8454/drizzle-orm/src/errors.ts#L13

52Hz•9/22/25, 2:37 AM

Thank you. After making the modifications as you suggested, I found the problem. Error: D1_ERROR: Currently processing a long-running export.Error: D1_ERROR: Currently processing a long-running export.

52Hz•9/22/25, 2:38 AM

This is caused by my D1 backup process. Recently, the data record in this table has reached 10,000 entries, and this problem has begun to occur.

52Hz•9/22/25, 2:40 AM

The currently backed-up data file is 2.61 MB; is there a way to perform the backup without blocking (database operations)?

NNeed_Not Worker... I'm using drizzle just `db = drizzle(env.DB)`

vkalahas•9/22/25, 2:46 AM

just letting you know, drizzle seems to have a lot of problems with d1, if you're using drizzle it really only seems to work decently with postgres based solutions

it would be SO COOL if cloudflare could just buy one of the serverless postgres companies and offer this as part of the cloudflare stack

Vvkalahas just letting you know, drizzle seems to have a lot of problems with d1, if you'r...

Need_Not•9/22/25, 4:36 AM

Interesting. Would be nice IMO to have other options besides sqlite.

552Hz The currently backed-up data file is 2.61 MB; is there a way to perform the back...

lambrospetrou•9/22/25, 7:40 AM

At the moment, imports and exports are blocking the D1 database unfortunately. There isn't a way to opt-out until we refactor that process.

In some occasions, exports seem to be failing for prolonged time. If that's the case for your DB, please DM me and I can restart the DB to stop the export process.

aza547•9/22/25, 10:12 AM

Seeing a very high failure rate on D1 queries currently. Is there an ongoing incident?

aza547•9/22/25, 10:16 AM

Screenshot_2025-09-22-11-15-55-41_40deb401b9ffe8e1df2f1cc5ba480b12.jpg

aza547•9/22/25, 10:16 AM

Sorry for the crap diags, just boarded a flight and on mobile.

aza547•9/22/25, 10:17 AM

All the failures seem to be the same error message.

Aaza547 Click to see attachment

lambrospetrou•9/22/25, 10:28 AM

Can you share your DB ID (DM me)? I see only a handful of DBs mostly seeing an elevated error rate so probably yours is one of them.
BTW, it went down now, so let me know if it's solved on your side too.

Llambrospetrou Can you share your DB ID (DM me)? I see only a handful of DBs mostly seeing an e...

lambrospetrou•9/22/25, 10:56 AM

We actually identified a single server/metal having network issues and moved all the DBs out from it. So, our metrics show that all of these errors disappeared now. Please let me know if not.

aza547•9/22/25, 11:41 AM

Seems better now, will grab the DB ID incase it's still useful, thanks

aza547•9/22/25, 11:41 AM

589bafbd-d600-4e01-8879-7443811d45a1

Aaza547 589bafbd-d600-4e01-8879-7443811d45a1

lambrospetrou•9/22/25, 12:35 PM

Yeah that was it

dandoen•9/23/25, 1:24 PM

@lambrospetrou any rough estimate on when you guys will get to improving the export process & make that non blocking? seems like this is one of the biggest pain point lots of ppl are raising. believe someone mentioned q3/q4.

Ddandoen @lambrospetrou any rough estimate on when you guys will get to improving the exp...

lambrospetrou•9/23/25, 2:01 PM

I didn't mention ETAs so far, intentionally. It is one of the next major things we want to tackle but there are some high priorities items before that. I don't have a specific ETA, unfortunately. Improving reliability is the number one goal both for D1 and DO so it kinda helps the import/export flows as well, so that's to be seen how much impact it will have specifically to those.
I do want to take a look at some point this quarter to see if there are some quick wins though.

khy•9/24/25, 3:07 AM

In the D1 FAQ, under Limits, I see

Each D1 database can store up to 10 GB of data, and you can create up to thousands of separate D1 databases. This allows you to split a single monolithic database into multiple, smaller databases, thereby isolating application data by user, customer, or tenant.

How does that work with worker bindings? Or is there some more dynamic way of addressing a particular tenant's DB?

btw is there any progress on this: https://github.com/cloudflare/workers-sdk/issues/5438

Similar Threads

Similar Threads

Similar Threads