My database down for 10 hours. https://github.com/cloudflare/workers-sdk/issues/9578 I can not expor

7

782-627•6/14/25, 12:13 AM

CC My database down for 10 hours. https://github.com/cloudflare/workers-sdk/issues/...

L

lambrospetrou•6/14/25, 8:03 AM

I just rebooted your database so the export is killed. The error you are getting means there is a mismatch between the actual data you store and the schema defined in the table. So, the current D1 export logic that creates the SQL statements fails. It's one of the weirdness of the current export implementation and is planned to be reworked.

Llambrospetrou I just rebooted your database so the export is killed. The error you are getting...

L

lambrospetrou•6/14/25, 8:05 AM

Unfortunately, that error is not transient, it's based on the stored data, so if you try to export again, the same thing will most likely happen. I will raise it with the team to see if someone can work on it soon.

Llambrospetrou Unfortunately, that error is not transient, it's based on the stored data, so if...

C

COP•6/14/25, 10:20 AM

Thank you so much! I will not export again until it get fixed.

CC Thank you so much! I will not export again until it get fixed.

G

gruntlord6•6/15/25, 5:13 PM

you could just have the worker export the data manually if they aren't able to get it doing and you need it sooner

G

gruntlord6•6/15/25, 5:13 PM

or copy to another database with the correct schema and export from there

G

gruntlord6•6/15/25, 5:14 PM

personally I would recommend using a second temporary database for the dump anyway since it locks your database while performing it in the current implementation

D

Disciple of Caoximeihao•6/16/25, 8:54 AM

When using wrangler v3, is it possible to declare database d1 in cloudflare workers outside of the .toml file?

D

Disciple of Caoximeihao•6/16/25, 8:55 AM

If it is [vars] I have declared it outside the .toml file using .dev.vars

D

Disciple of Caoximeihao•6/16/25, 8:55 AM

please someone help me

Z

zegevlier•6/16/25, 8:55 AM

Why do you want to do that?

Z

zegevlier•6/16/25, 8:56 AM

I am not sure I know of a way to do that - but knowing why you want it might lead to a workaround

Zzegevlier I am not sure I know of a way to do that - but knowing why you want it might lea...

D

Disciple of Caoximeihao•6/16/25, 8:59 AM

When I develop I will use a different database, when I am in production I want to use a different database, I don't want to use --env develop

Z

zegevlier•6/16/25, 9:04 AM

If you don't pass the

--remote

--remote

flag to wrangler when starting up your development environment, it should be using a local database. Would that work for you? Otherwise, I don't know of any way to do that without using

--env

--env

--env

--env.

Note that you could change your

npm run dev

npm run dev

command to include the

--env

--env

--env

--env flag, so you don't need to type it every time, if that's the issue.

T

Tory•6/16/25, 1:47 PM

Is it possible to restore data for a specific table in a D1 database? It looks like we experienced some data loss during the recent outage for a specific table.

TTory Is it possible to restore data for a specific table in a D1 database? It looks l...

L

lambrospetrou•6/16/25, 3:44 PM

It looks like we experienced some data loss during the recent outage for a specific table.

Can you elaborate on this please? Feel free to DM me with as much details as you can. The recent incident could not lead to data loss for D1 from everything we have seen so far. Only startups were impacted and some writes not going through potentially.

You can restore using the bookmark API but that's for the database as a whole, not individual tables.

G

Gagan Suie•6/16/25, 7:30 PM

did D1 dashboard just remove "Table" tab? and replace it with "Explore Data"?

A

astra•6/16/25, 7:30 PM

yeah the update just went live to me just now aswell.. some of my columns are missing unless i explicitly search for it

G

Gagan Suie•6/16/25, 7:31 PM

freaked me out because i was actively making changes and thought i purged my entire DB accidentally. so i restored and lost some data. T_T

Aastra yeah the update just went live to me just now aswell.. some of my columns are mi...

B

Brayden•6/16/25, 7:51 PM

Can you elaborate a bit on this one? This doesn't sound like expected behavior.

GGagan Suie freaked me out because i was actively making changes and thought i purged my ent...

G

gruntlord6•6/16/25, 9:08 PM

you can also restore back to before you restored it

G

gruntlord6•6/16/25, 9:08 PM

time travel is magical

A

alphem•6/16/25, 11:29 PM

I'm not sure if this is the place to post, but I am not a fan of the front end updates through the dashboard. The fact that I cannot easily see what tables populate the db is very frustrating. Please bring this back. The user interface had a few issues, but this is not better.

GGagan Suie did D1 dashboard just remove "Table" tab? and replace it with "Explore Data"?

G

gruntlord6•6/16/25, 11:41 PM

I don't have a tab for that, I have to go to the other menu

G

gruntlord6•6/16/25, 11:42 PM

not exactly what I meant when I said I preffered the other way, I meant I wanted that to show on the table tab

Aalphem I'm not sure if this is the place to post, but I am not a fan of the front end u...

V

Visal .In•6/17/25, 12:56 AM

What do you mean you can’t see which table is populating the database? Do you see the “Explore Data” button on the right side?

A

alphem•6/17/25, 12:57 AM

I see that well enough. My point is that I can't just see everything from the dashboard now. I have to open a new tab in order to see it.

A

alphem•6/17/25, 12:58 AM

It would be best if "explore data" was just a tab on the dashboard.

Aalphem It would be best if "explore data" was just a tab on the dashboard.

V

Visal .In•6/17/25, 1:04 AM

Got it. Now I understand what you mean. We’ll continue to improve it.

VVisal .In Got it. Now I understand what you mean. We’ll continue to improve it.

A

alphem•6/17/25, 3:18 AM

TY. Don't mean to complain overmuch, you guys have an amazing product here.

�

😈 Donkey 💫•6/17/25, 3:45 AM

the table tab has gone, why?

D

dsds10•6/17/25, 7:10 AM

great job on adding the new tables viewer! that's A LOT better

K

kd•6/17/25, 8:59 PM

Hi! I'm looking for some clarity on D1 cold starts. I have a ~600MB database in D1 right now which will mostly be used as a read-only DB, fronted by a Worker-based react-router website. I have not rolled it out into production yet, but the cold starts of ~5 seconds after every 5-10 minutes of idling makes wonder if I made a right choice for a low-traffic use case. I mean, if there is only a couple visitors an hour, they will all get these huge delays on some of the interactions where I very much preferred a 50ms response that's happening after

Are there any rough numbers of when the D1 goes to sleep and how much traffic should be there to avoid cold starts?

K

kd•6/17/25, 9:02 PM

I am querying D1 from separate react-router's "API" routes, which I believe should be bundled altogether in a single worker. The routes that do not touch D1 have like a 50ms ttfb, while routes that query D1 have this super long cold start

K

kd•6/17/25, 9:03 PM

the worst part is that while I was writing this message (~1-2 minutes), it happened again. The subsequent requests are all 40-50 ms though, so I'd assume it's not the heavy joins or something like this (I almost don't have any heavy sql queries)

Kkd Hi! I'm looking for some clarity on D1 cold starts. I have a ~600MB database in ...

L

lambrospetrou•6/17/25, 10:42 PM

The databases go to sleep after 1-2 minutes of inactivity (due to the underlying Durable Object hibernation/eviction).
So, in your case you will experience booting up the database all the time if you query once every 5-10 minutes.

Now, in theory, unless the underlying machine your database is hosted is bad all the time, your boots should be hot after the first one, and startups should be faster without needing to fetch from cold storage all the time. If you share your database ID/account ID I can double check to see the cold starts you were having.

Kkd I am querying D1 from separate react-router's "API" routes, which I believe sho...

G

gruntlord6•6/18/25, 12:26 AM

if you are using react router anyway you can easily add in durable objects if you want faster performance

G

gruntlord6•6/18/25, 12:27 AM

they made it very trivial with the new vite plugin

G

gruntlord6•6/18/25, 12:28 AM

you could also have your parent route ping the d1 instance when you start serving requests to keep it warm

D

Delchan•6/18/25, 10:07 AM

what

Ggruntlord6 you could also have your parent route ping the d1 instance when you start servin...

K

kd•6/18/25, 6:08 PM

this actually sounds like a quick and easy solution to keep it warm, thanks for the help! \

Kkd this actually sounds like a quick and easy solution to keep it warm, thanks for ...

G

gruntlord6•6/18/25, 7:16 PM

no problem, I use something similar to keep a websocket connection in a header

D

Dev•6/19/25, 5:43 AM

Are d1 procedures available to use? I could only find an article about it from 3 years ago

DDev Are d1 procedures available to use? I could only find an article about it from 3...

L

lambrospetrou•6/19/25, 6:06 AM

Nope. Not on the roadmap for now.

Llambrospetrou Nope. Not on the roadmap for now.

D

Dev•6/19/25, 6:30 AM

so there's no way to use transactions-like in d1?

DDev so there's no way to use transactions-like in d1?

L

lambrospetrou•6/19/25, 6:41 AM

If you mean interleaving JavaScript code and SQL within the same transaction, then not at the moment. You can execute multiple SQL queries in a single transaction using the

batch()

batch()

batch()

batch() function, though, if that fits your use-case.
Otherwise if you need a lot of JS mixed with SQL, using SQLite Durable Objects is more suitable.

K

karenr•6/20/25, 4:17 AM

Hi, when working on openNext. Is there a way to use the --remote flag to fetch the data? If not specifying the flag. Other ways that you have tried and worked?

I have a large dataset in production that I'd like to use in the frontend to display.

F

fare•6/22/25, 6:35 PM

wg d1 list

 ⛅️ wrangler 4.20.5
───────────────────

✘ [ERROR] A request to the Cloudflare API (/accounts/:id/d1/database) failed.

  Authentication error [code: 10000]


Getting User settings...
👋 You are logged in with an OAuth Token, associated with the email .
┌───────────────────────────────────┬──────────────────────────────────┐
│ Account Name                      │ Account ID                       │
├───────────────────────────────────┼──────────────────────────────────┤
│ Account Name                      │ Account ID                       │
└───────────────────────────────────┴──────────────────────────────────┘
🔓 Token Permissions: If scopes are missing, you may need to logout and re-login.
Scope (Access)
- account (read)
- user (read)
- workers (write)
- workers_kv (write)
- workers_routes (write)
- workers_scripts (write)
- workers_tail (read)
- d1 (write)
- pages (write)
- zone (read)
- ssl_certs (write)
- ai (write)
- queues (write)
- pipelines (write)
- secrets_store (write)
- offline_access 
🎢 Membership roles in "EMAIL": Contact account super admin to change your permissions.
- Super Administrator - All Privileges

wg d1 list

 ⛅️ wrangler 4.20.5
───────────────────

✘ [ERROR] A request to the Cloudflare API (/accounts/:id/d1/database) failed.

  Authentication error [code: 10000]


Getting User settings...
👋 You are logged in with an OAuth Token, associated with the email .
┌───────────────────────────────────┬──────────────────────────────────┐
│ Account Name                      │ Account ID                       │
├───────────────────────────────────┼──────────────────────────────────┤
│ Account Name                      │ Account ID                       │
└───────────────────────────────────┴──────────────────────────────────┘
🔓 Token Permissions: If scopes are missing, you may need to logout and re-login.
Scope (Access)
- account (read)
- user (read)
- workers (write)
- workers_kv (write)
- workers_routes (write)
- workers_scripts (write)
- workers_tail (read)
- d1 (write)
- pages (write)
- zone (read)
- ssl_certs (write)
- ai (write)
- queues (write)
- pipelines (write)
- secrets_store (write)
- offline_access 
🎢 Membership roles in "EMAIL": Contact account super admin to change your permissions.
- Super Administrator - All Privileges

wg d1 list

 ⛅️ wrangler 4.20.5
───────────────────

✘ [ERROR] A request to the Cloudflare API (/accounts/:id/d1/database) failed.

  Authentication error [code: 10000]


Getting User settings...
👋 You are logged in with an OAuth Token, associated with the email .
┌───────────────────────────────────┬──────────────────────────────────┐
│ Account Name                      │ Account ID                       │
├───────────────────────────────────┼──────────────────────────────────┤
│ Account Name                      │ Account ID                       │
└───────────────────────────────────┴──────────────────────────────────┘
🔓 Token Permissions: If scopes are missing, you may need to logout and re-login.
Scope (Access)
- account (read)
- user (read)
- workers (write)
- workers_kv (write)
- workers_routes (write)
- workers_scripts (write)
- workers_tail (read)
- d1 (write)
- pages (write)
- zone (read)
- ssl_certs (write)
- ai (write)
- queues (write)
- pipelines (write)
- secrets_store (write)
- offline_access 
🎢 Membership roles in "EMAIL": Contact account super admin to change your permissions.
- Super Administrator - All Privileges

wg d1 list

 ⛅️ wrangler 4.20.5
───────────────────

✘ [ERROR] A request to the Cloudflare API (/accounts/:id/d1/database) failed.

  Authentication error [code: 10000]


Getting User settings...
👋 You are logged in with an OAuth Token, associated with the email .
┌───────────────────────────────────┬──────────────────────────────────┐
│ Account Name                      │ Account ID                       │
├───────────────────────────────────┼──────────────────────────────────┤
│ Account Name                      │ Account ID                       │
└───────────────────────────────────┴──────────────────────────────────┘
🔓 Token Permissions: If scopes are missing, you may need to logout and re-login.
Scope (Access)
- account (read)
- user (read)
- workers (write)
- workers_kv (write)
- workers_routes (write)
- workers_scripts (write)
- workers_tail (read)
- d1 (write)
- pages (write)
- zone (read)
- ssl_certs (write)
- ai (write)
- queues (write)
- pipelines (write)
- secrets_store (write)
- offline_access 
🎢 Membership roles in "EMAIL": Contact account super admin to change your permissions.
- Super Administrator - All Privileges

Whenever i run this command I get this error
this does not happen for any other commands except d1 list

M

Mirith•6/23/25, 6:18 PM

If I'm just saving strings to my D1 database, how much sanitizing do I need to do?

MMirith If I'm just saving strings to my D1 database, how much sanitizing do I need to d...

D

deleted•6/23/25, 6:21 PM

if ur using prepared statements and passing the strings via parametrized bindings, i.e. bind(), then you should be good

My database down for 10 hours. https://github.com/cloudflare/workers-sdk/issues/9578 I can not expor

Similar Threads

Similar Threads

Similar Threads