I've encountered a significant number of "D1_ERROR: internal error" messages today. we haven't updat

I've encountered a significant number of "D1_ERROR: internal error" messages today. we haven't updated our code. Has there been any changes in D1 today?

TTomK I've encountered a significant number of "D1_ERROR: internal error" messages tod...

fry69•10/29/24, 2:08 PM

In doubt check -> status there have been issues a few hours ago with pages, but not D1, so IDK (though it also showed "internal error").

fry69•10/29/24, 2:09 PM

"internal error" can literally mean anything.

fry69•10/29/24, 2:11 PM

Unless we see more reports here or elsewhere, it might also be something with your database/setup which Cloudflare can't handle for some reason.

TomKOP•10/29/24, 2:12 PM

The error message has now changed to "D1_ERROR: D1 storage operation exceeded timeout which caused object to be reset."

Ffry69 Unless we see more reports here or elsewhere, it might also be something with yo...

TomKOP•10/29/24, 2:12 PM

Okay, thank you for your response. I will check further.

nato•10/29/24, 2:35 PM

how can I make 2 different cloudflare workers apps use same D1 db in local dev?

nato•10/29/24, 2:35 PM

I see it uses ./wrangler/state/v3/d1 but since both projects are on seperate folders

nato•10/29/24, 2:36 PM

is there any way to specify path?

nato•10/29/24, 2:37 PM

nvm it was mentioned in docs

npx wrangler dev --persist-to <DIRECTORY>

npx wrangler dev --persist-to <DIRECTORY>

TTomK Okay, thank you for your response. I will check further.

Stan Angeloff•10/29/24, 3:01 PM

I'm another customer that's observing lots of random D1 failures today (and in general a lot more since September, lots of lost connection, internal error, etc.) Just thought I'd chime in so you know you are not alone.

sz19•10/29/24, 4:01 PM

It started at 12PM UTC, I've been receiving these errors since then.
D1 storage operation exceeded timeout which caused object to be reset. / Network connection lost. / internal error

Ssz19 It started at 12PM UTC, I've been receiving these errors since then. D1 storage ...

TomKOP•10/29/24, 4:38 PM

I also encountered the same issue at the same time.

TTomK I also encountered the same issue at the same time.

sz19•10/29/24, 4:49 PM

is your d1 database located somewhere in asia?

Ssz19 is your d1 database located somewhere in asia?

TomKOP•10/29/24, 4:57 PM

yes

TomKOP•10/29/24, 4:59 PM

I'm not sure if this has anything to do with the maintenance program in the Singapore region?

TomKOP•10/29/24, 5:02 PM

TTomK Click to see attachment

fry69•10/29/24, 5:09 PM

That is still in the future if I read this correctly (UTC)

fry69•10/29/24, 5:10 PM

(should start in <1h)

fry69•10/29/24, 5:12 PM

The hiccups could of course be due to preparations for this maintenance or other things.

Ffry69 That is still in the future if I read this correctly (UTC)

TomKOP•10/29/24, 5:14 PM

Yes, it was future time, which is a very far-fetched reason indeed, but other than that I can't associate it with any other reason, since the code wasn't updated.:NotLikeThis:

sz19•10/29/24, 5:38 PM

Update: errors seems to be gone now on mine

sz19•10/29/24, 5:44 PM

There was about a solid 5 mins giving me this error:
Error: D1_ERROR: Internal error while starting up D1 storage caused object to be reset.
, then after that i no longer receive d1 errors. Hopefully it stays like this

rubenf•10/29/24, 8:41 PM

Our D1 database has been unavailable for the last 10mins withL:

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

rubenf•10/29/24, 8:42 PM

even the cloud console can't access it

rubenf•10/29/24, 8:42 PM

Are D1 databases beta/unfit for prod?

Rrubenf Our D1 database has been unavailable for the last 10mins withL: `D1_ERROR: Inter...

fry69•10/29/24, 8:45 PM

Which region/colo?

rubenf•10/29/24, 8:46 PM

@fry69 not sure actually, where do I find that info

rubenf•10/29/24, 8:46 PM

we have the database id

Rrubenf we have the database id

fry69•10/29/24, 8:56 PM

running_in_regionrunning_in_region via

wrangler d1 info <dbname>

wrangler d1 info <dbname>

fry69•10/29/24, 8:57 PM

rubenf•10/29/24, 8:58 PM

  Internal error: failed to get DB size and num_tables [code: 7500]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

  Internal error: failed to get DB size and num_tables [code: 7500]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

rubenf•10/29/24, 8:58 PM

the whole db is completely unavailable