@Isaac McFadyen any idea why none of `npx wrangler d1 migrations --help` / `npx wrangler d1 migratio

@Isaac McFadyen any idea why none of

npx wrangler d1 migrations --help

npx wrangler d1 migrations --help

npx wrangler d1 migrations apply --help

npx wrangler d1 migrations apply --help

lists

persist-to

persist-to

as a valid option?

Bbeelzabub @Isaac McFadyen any idea why none of `npx wrangler d1 migrations --help` / `npx ...

Isaac McFadyen•2/24/25, 8:35 PM

From the source it looks like a valid option so I'm guessing it might have just been forgotten in the

--help

--help

output?

Isaac McFadyen•2/24/25, 8:35 PM

Not quite sure, I haven't used migrations much, sorry.

Skycrafter•2/25/25, 3:13 PM

Hello, I have a website project where I'm trying to use a D1 db. However, I'm getting big latencies, so I was thinking of using the Sessions API. However, I'm afraid of data inconsistency (for reads) from one user to the next. Can help me understand how should a session be initiated on a worker to ensure that all future queries have up-to-date data? Like, should navigating between pages create a new session to have up-to-date info? That feels as bad as using no replication. Any insights on if I missed something? Thanks a lot

James•2/25/25, 3:15 PM

The sessions API doesn’t exist yet - but soon. I’m sure a lot more info will be shared when it’s released and generally available, with best practices, recommendations, etc.

Skycrafter•2/25/25, 3:15 PM

okay thank you

MMax (@rozenmd)It'll be possible to limit replication within an area (like the EU for GDPR)

mohamnag•2/26/25, 6:06 AM

Is this already available? I’m not sure if anyone can use D1 for a serious project in EU until we have this

Mmohamnag Is this already available? I’m not sure if anyone can use D1 for a serious proje...

lambrospetrou•2/26/25, 6:47 AM

Replication is not released yet, and will be optional anyway for some time. You can decide to keep your primary database instance in EEUR or WEUR.

Llambrospetrou Replication is not released yet, and will be optional anyway for some time. You ...

mohamnag•2/26/25, 6:54 AM

is keeping data in EU done using location hint? Because docs say that one is not binding and might even be ignored.

Also is there any way to prevent this replication? Like when does that happen? If for anyone outside of an specific region no DB access happens, does that mean no replication is happening either?

o7•2/26/25, 6:56 AM

EU GDPR jurisdiction support is something I'm also interested in

Mmohamnag is keeping data in EU done using location hint? Because docs say that one is not...

lambrospetrou•2/26/25, 6:59 AM

Also is there any way to prevent this replication? Like when does that happen? If for anyone outside of an specific region no DB access happens, does that mean no replication is happening either?

There is no replication at the moment. Once it's out, we will have some control for jurisdictions once those are added for D1.

You can also check where your database is located after creation to confirm its location.

Llambrospetrou > Also is there any way to prevent this replication? Like when does that happen?...

mohamnag•2/26/25, 8:54 AM

would you mind pointing me where the location of a DB can be seen? not finding anything on dashboard

Mmohamnag would you mind pointing me where the location of a DB can be seen? not finding a...

mohamnag•2/26/25, 8:57 AM

found it using wrangler

Mmohamnag found it using wrangler 😉

lambrospetrou•2/26/25, 10:00 AM

Wrangler can give it to you yes, your query responses also contain that information in the

meta

meta

object, and the dashboard will show it soon as well.

Llambrospetrou Wrangler can give it to you yes, your query responses also contain that informat...

mohamnag•2/26/25, 11:14 AM

Thanks again. For now need to provide the hint and chk location afterwards. Would be nice if in future that hint is more binding too.

Mmohamnag is keeping data in EU done using location hint? Because docs say that one is not...

Hello, I’m Allie!•2/26/25, 2:07 PM

If you are referring to DOs, they do support Jurisdictions, which means it isn’t a hint, but a guarantee that they run in a given region

cosbgn•2/26/25, 3:01 PM

Does D1 provides some proper error codes?
so far I'm doing:

if (e.message.startsWith(`D1_ERROR: UNIQUE constraint failed:`)){
  throw createError({statusCode:400, statusMessage:`Your name needs to be unique`})
}

if (e.message.startsWith(`D1_ERROR: UNIQUE constraint failed:`)){
  throw createError({statusCode:400, statusMessage:`Your name needs to be unique`})
}

but seems super hacky

HHello, I’m Allie!If you are referring to DOs, they do support Jurisdictions, which means it isn’t...

mohamnag•2/26/25, 3:16 PM

what is DO? durable object? we were talking about D1 not sure if there is relation

Roger•2/26/25, 3:21 PM

Hello, is there any plan to create an official driver to manage D1 databases via third-party database managers like DBeaver?

PV76•2/26/25, 3:22 PM

Hi All. I'm working with the D1 Database by using the Prisma, Wrangler in the NextJS App Router Fullstack. I have a problem when I need to get the env to bind it into the Prisma D1 Adapter. Does anyone have experience with that? Could you help me with this? Thanks all

Mmohamnag what is DO? durable object? we were talking about D1 not sure if there is relati...

Hello, I’m Allie!•2/26/25, 4:50 PM

Yes, it is Durable Objects. D1 Databases are Durable Objects with some utils to make it easy to query externally

Hello, I’m Allie!•2/26/25, 4:50 PM

Durable Objects do support Jurisdictions, which force the location. Not sure whether D1 will have the same(don’t think it exists yet)

Caleb•2/26/25, 7:12 PM

Im sure someone has asked this before but I couldn't find anything about it. The D1 free tier says there are 25 billion rows read per month included. Does this only count the rows that the query returns? Or does it count rows that were checked and not returned as well?

CCaleb Im sure someone has asked this before but I couldn't find anything about it. The...

lambrospetrou•2/26/25, 7:14 PM

Or does it count rows that were checked and not returned as well?

All rows read are counted. From indices, non-indices, views, etc.

Caleb•2/26/25, 7:15 PM

CCaleb Im sure someone has asked this before but I couldn't find anything about it. The...

1984 Ford Laser•2/27/25, 4:41 AM

D1 Free tier is 5million row reads per day, not 25bil per month. 25bil is included in the $5 Workers Paid plan

dan—1106•2/27/25, 6:42 PM

I know that during a D1 export the database is unavailable for other requests (https://developers.cloudflare.com/d1/best-practices/import-export-data/#known-limitations).

A couple of questions on this:

What's a reasonable maximum time for an export to take? If a database hits the 10gb limit, how long would exporting it take?
Will this limitation go away when read only replicas become available?

YYS•2/27/25, 9:14 PM

Where can I request to update the error message for D1 response errors?

Ddan—1106 I know that during a D1 export the database is unavailable for other requests (h...

lambrospetrou•2/27/25, 9:19 PM

This really depends on each database. How many millions of rows, how big each row is, etc.
Probably reads could still flow through with the replicas, but the primary will still be blocked. We have some work streams to improve the import/export APIs over the next few months.

Llambrospetrou 1. This really depends on each database. How many millions of rows, how big each...

1984 Ford Laser•2/27/25, 10:53 PM

Replicas that don't exist publicly yet right?

Llambrospetrou 1. This really depends on each database. How many millions of rows, how big each...

dan—1106•2/27/25, 11:00 PM

On 1, makes sense. Can you give any guidance on the possible ranges of times the db might be blocked? Seconds, 10 minutes, 30 minutes?

Ddan—1106 On 1, makes sense. Can you give any guidance on the possible ranges of times the...

dan—1106•2/27/25, 11:02 PM

Is it possible to export a backup from Time Travel? Snapshots must be on disk somewhere?

RRoger Hello, is there any plan to create an official driver to manage D1 databases via...

Roger•2/28/25, 8:04 AM

Hello, I think this message has gone unnoticed among others. Is there any plan to collaborate with an existing database manager to support d1?

RRoger Hello, I think this message has gone unnoticed among others. Is there any plan t...

Silvan•2/28/25, 10:56 AM

pretty sure drizzle studio works?

RRoger Hello, I think this message has gone unnoticed among others. Is there any plan t...

Brayden•2/28/25, 12:26 PM

You can use Outerbase to view your D1 databases

Manuel Ogomigo•2/28/25, 3:16 PM

Hi my d1 all of a sudden went from less than 10m rows read to over 38B in 5 days.
I didn't make any change and still uses the same data, not sure what's causing it.

It keeps on increasing, is there any way I can fix this. Please

MManuel Ogomigo Hi my d1 all of a sudden went from less than 10m rows read to over 38B in 5 days...

Isaac McFadyen•2/28/25, 3:19 PM

Double-check that whatever Worker is querying the D1 DB isn't getting flooded with requests, perhaps?

Isaac McFadyen•2/28/25, 3:19 PM

And/or that you haven't accidentally leaked an access token that someone's using to hit the API

Manuel Ogomigo•2/28/25, 3:25 PM

This is the query that is being shown in the metrics with the higest count, multiples of it. And that query is only found in my cloudflare pages.

is there any way I can check to see where the D1 queries are coming from aside that, or a way to fix it, it's been that query for months with no issues

Manuel Ogomigo•2/28/25, 4:17 PM

I found the query already, using the d1 insights wrangler, thank you!

Xulo•2/28/25, 7:09 PM

Hi, I'm using Cloudflare D1 with Drizzle ORM and want to batch multiple queries in a single transaction. However, I need

newUser.id

newUser.id

and

account.id

account.id

from the first two queries to use in the third one. Since the queries are in an array, I can't assign these values to a constant. Is there a way to achieve this within a single batch, or do I need to split it into two?

Thanks in advance! :)

atmajo•3/1/25, 3:29 AM

Hello, I'm using cloudflare D1 with drizzle orm from 28th February 2025, I am getting an error while applying migration changes to the databse can anyone please help me

$ bun wrangler d1 migrations apply megha-backend

wrangler 3.111.0
--------------------

*** Received structured exception #0xc0000005: access violation; stack: 7ffbf9c52c0f 7ff66a13147a 7ff66a131543 7ff66a0d84ac 7ff66a0d8457 7ff669627a8e 7ff669627d9f 7ff6680a3316 7ff66975200f 7ff6697591b6 7ff669752513 7ff6697591b6 7ff66974feac 7ff668091ee5 7ff66acaeb5f 7ffc142fe8d6 7ffc15bbbf2b
X [ERROR] The Workers runtime failed to start. There is likely additional logging output above.

Matthew•3/1/25, 2:50 PM

I'm seeing lots of D1 errors for brief periods yesterday and today, but there's nothing on the D1 status page. I get

D1 DB storage operation exceeded timeout which caused object to be reset

D1 DB storage operation exceeded timeout which caused object to be reset

and

D1 DB is overloaded. Too many requests queued.

D1 DB is overloaded. Too many requests queued.

Matthew•3/1/25, 2:52 PM

My database is about 30Mb, it gets ~50k write queries per 24 hours and I believe is well indexed

Matthew•3/1/25, 2:52 PM

Is anyone else seeing this?

James•3/1/25, 3:45 PM

Error rates on D1 are higher than most people would like. I've requested the team to document this so people understand how they should use D1 a bit better at https://github.com/cloudflare/cloudflare-docs/issues/18485, but the general wisdom unless you're seeing 100% failures is just that it's expected and you should retry your queries. Not great, I know, but sadly that's all we got for now.

Silvan•3/1/25, 4:29 PM

i have not ran into this but im assuming queries arent retried automatically either right? good to know

James•3/1/25, 4:55 PM

They are not, no, you would need to retry them yourself or implement them via another Cloudflare product that can do retries in failure conditions like Workflows, Queues, etc.

o7•3/2/25, 8:15 AM

does running a batch block the db and prevent other queries from running?

Update: Yes, very much so

1984 Ford Laser•3/2/25, 10:00 AM

Any plans to add sub-query support to generated columns, specifically when doing JSON querying? Being able to match an object from a list of objects and generate a column from that would be cool

@Isaac McFadyen any idea why none of `npx wrangler d1 migrations --help` / `npx wrangler d1 migratio

Similar Threads

Similar Threads

Similar Threads