Thanks for getting back to me! Database ID is 31174a64-6897-47f9-8364-644637f90c40. Sentry shows `D

Thanks for getting back to me! Database ID is 31174a64-6897-47f9-8364-644637f90c40. Sentry shows

DB is overloaded

DB is overloaded

DB is overloaded

DB is overloaded errors on 2025-02-28 around 14:26-14:33GMT, and

storage operation exceeded timeout

storage operation exceeded timeout

storage operation exceeded timeout

storage operation exceeded timeout errors around 2025-03-01 14:33 GMT. I don't know exactly which queries were associated with the errors, but the Query Latency metrics show the P95 latency can't have been higher than 8-10ms. My most frequently run queries have a P95 latency of 0-3ms.

く

くもりにくもったクラウドサービスlocaler•3/4/25, 4:26 PM

Is it possible to use sql transactions in D1?

くくもりにくもったクラウドサービスlocaler Is it possible to use sql transactions in D1?

lambrospetrou•3/4/25, 4:30 PM

Not with interleaving JS code if that's what you mean. Each batch query or single query you send to D1 is running within a transaction.

く

くもりにくもったクラウドサービスlocaler•3/4/25, 4:38 PM

Thanks for letting me know.

MMatthew Thanks for getting back to me! Database ID is 31174a64-6897-47f9-8364-644637f90c...

lambrospetrou•3/4/25, 11:33 PM

I only see the

storage operation exceeded timeout

storage operation exceeded timeout

errors at that exact timestamp (2025-03-01 14:33 GMT2025-03-01 14:33 GMT) on your database, nothing else before or after, so it might have been something transient or maybe a query slowdown momentarily if the machine had any issue.
Same for the overload errors. I don't see other errors except that one time.

If your queries are idempotent (e.g. insert if not existsinsert if not exists) or selects, then retrying them is always suggested.

We have some plan to document some of these errors and denote which are retryable, but if you design your queries to be "safe" to retry you can already do it yourself. This will pretty much cover these one-time errors.

Llambrospetrou I only see the `storage operation exceeded timeout` errors at that exact timesta...

MatthewOP•3/5/25, 12:46 PM

Thanks for looking into it! Have to say, there are more transient/one-off errors than I had expected when I based my app on D1, and I wasn't aware I would have to write query-retry code

andifined.dev•3/5/25, 4:40 PM

Maybe asked some time ago. But docs state some kind of dB per user. I‘m wondering how that should be possible with d1? And how to handle dB Migrations?

marko.333•3/5/25, 6:57 PM

Does anyone know if there are plans to add support for embeddings/vectors to D1 (maybe via Vectorize integration)? I would like to merge/rank D1 queries (BM25) with dense embedding ranking? For now are there any good workarounds?
Thx.

andifined.dev•3/5/25, 8:04 PM

Im looking for a example architecture on how the scale out of D1 should work for per user databases

jasonj•3/6/25, 1:20 AM

I hope this message finds you well. I’m reaching out to request your assistance with an issue I’m experiencing with my D1 database.

Currently, I’m unable to access my database with the ID 1bad90ef-990b-4ad1-908b-4bddd1f3ffd9. When I try to view its status through the Cloudflare Dashboard, it remains stuck in a "loading" state indefinitely. This issue is preventing me from managing or using the database effectively, and I’m unsure of the underlying cause.

Could you please help me investigate what might be going wrong? I’d greatly appreciate any insights or guidance you could provide to resolve this.

Thank you in advance for your support! Please let me know if you need any additional details from my side to assist with troubleshooting.

Best regards,

and I want check my timetravel by wrangler d1 time-travel info dbname

it's show me ✘ [ERROR] A request to the Cloudflare API (/accounts/{myid}/d1/database/1bad90ef-990b-4ad1-908b-4bddd1f3ffd9) failed.

internal error; reference = e_PVSMDp_1bdbed40ae1f4484a8b15b649291cf15 [code: 7500]

all other d1 is work well ,just this db is error

Jjasonj I hope this message finds you well. I’m reaching out to request your assistance ...

Walshy•3/6/25, 2:02 AM

what's your account id?
(it's safe to share)

toadfans•3/6/25, 2:12 AM

Same error: D1_ERROR: internal error; reference = 3v37q0sukf03r4emb40aq73qD1_ERROR: internal error; reference = 3v37q0sukf03r4emb40aq73q , account_id: 75d8d68ecf8f9e8155f1ccc7dad82e0075d8d68ecf8f9e8155f1ccc7dad82e00

WWalshy what's your account id? (it's safe to share)

jasonj•3/6/25, 2:24 AM

8863216c46bc0b22436dac7ad793a08f

WWalshy what's your account id? (it's safe to share)

jasonj•3/6/25, 4:41 AM

Any progress? Thanks a lot

beelzabub•3/6/25, 4:58 PM

I store base32 and base64 strings within sqlite. It would be nice if D1 supported extension functions to encode blobs as base32/base64 / decode base32/base64 strings (akin to hex/unhex that do the same)

beelzabub•3/6/25, 4:59 PM

It just makes it more convenient when running queries directly to debug stuff vs having to write JS to interpret the DB.

Original message was deleted

Hard@Work•3/6/25, 6:27 PM

Wrong channel? This is for D1, the database

anand248•3/6/25, 9:15 PM

Hey Team, I am based in Sydney Australia, and trying D1 + Cloudflare pages using Drizzle ORM.
I am experiencing, each DB Call takes at least > 230 miliseconds.
I found multiple forum, people discussing D1 queries taking time. (I have created indexes, but that should not be a problem, since my DB is very small , with few test data in KBs).
Is this latency due to D1 not closser to my Pages Worker?

Aanand248 Hey Team, I am based in Sydney Australia, and trying D1 + Cloudflare pages using...

1984 Ford Laser•3/6/25, 9:18 PM

Smart Placement might help, are your requests going to the Sydney colo or elsewhere?

BiffBaffBoff•3/6/25, 9:40 PM

Hi, if you have multiple workers needing to talk to the same d1 instance when doing local development? How do you achieve that?

/root
  /app1
     wrangler.jsonc -> "d1_databases": [{ "binding": "DB", "database_name": "a-shared-name", "database_id": "1234..." }]
  /app2
     wrangler.jsonc -> "d1_databases": [{ "binding": "DB", "database_name": "a-shared-name", "database_id": "1234..." }]

/root
  /app1
     wrangler.jsonc -> "d1_databases": [{ "binding": "DB", "database_name": "a-shared-name", "database_id": "1234..." }]
  /app2
     wrangler.jsonc -> "d1_databases": [{ "binding": "DB", "database_name": "a-shared-name", "database_id": "1234..." }]

If I run both workers, they each create a

.wrangler

.wrangler

directory with each state independant from each other. Thanks

James•3/6/25, 10:27 PM

'persist' option on wrangler when you run it, pick one dir for both

11984 Ford Laser Smart Placement *might* help, are your requests going to the Sydney colo or else...

anand248•3/7/25, 5:53 AM

how to figure out, where request goes when we query D1 database?

1984 Ford Laser•3/7/25, 5:59 AM

In the response from the Worker, look at the cf: colocf: colo header

anand248•3/7/25, 6:06 AM

Thanks, I get-

cf-placement: local-SYD
cf-ray: 91c7d72ecb3a572d-SYD

cf-placement: local-SYD
cf-ray: 91c7d72ecb3a572d-SYD

Isn;t it about the location of pages or worker? I am curious about my D1 DB location where read happens, I guess for each query to take >240s, it seem it is network latency.

LLazyGeniusMan hello, I have monorepo setup with this structure ``` ├── apps/ │ ├── foo-worke...

Silvan•3/7/25, 11:08 AM

if you scroll up 5 messages theres your answer x)

BBiffBaffBoff Hi, if you have multiple workers needing to talk to the same d1 instance when do...

! Nakoshi 恨•3/7/25, 2:10 PM

Hello

Aanand248 Thanks, I get- ``` cf-placement: local-SYD cf-ray: 91c7d72ecb3a572d-SYD ``` Isn...

lambrospetrou•3/7/25, 6:51 PM

Every D1 response now has a meta.served_by_regionmeta.served_by_region information. That's the location (region) of your database instance that processed the query.
To get the location of your worker, as others mentioned above you can use Cloudflare headers of the request telling you the colocolo: https://developers.cloudflare.com/workers/runtime-apis/request/#incomingrequestcfproperties
Or fetch the URL https://cloudflare.com/cdn-cgi/trace from within your worker and check the

colo=

colo=

line.

Iiandees Is it possible to build a Sqlite database separately, publish it into D1, and us...

lambrospetrou•3/7/25, 6:53 PM

What does "build an SQLite database separately" mean? You mean uploading an existing SQLite database file?
If yes, you can use the import API: https://developers.cloudflare.com/d1/best-practices/import-export-data/
If not, I don't understand the question, so please elaborate.

Llambrospetrou Every D1 response now has a `meta.served_by_region` information. That's the loca...

anand248•3/7/25, 10:04 PM

I mange to find DB location from command wrangler d1 info <db_name>wrangler d1 info <db_name> , which tells me my db is in Wesern north america, while the only time i ussed it ws from AU. Now I am moving my DB Back to AU by creating new db/exporting data to it.

anand248•3/7/25, 10:11 PM

command wrangler d1 export --remote <db_name> --output=x_backup.sqlwrangler d1 export --remote <db_name> --output=x_backup.sql does not create DDL & DML in correct order. (Table being referred get created later.).

Iiandees is the database size limit something that can be increased? a couple of the data...

Tait•3/8/25, 12:39 AM

Pretty sure the answer to this is no. Cloudflare announced some D1 changes last April. Maybe they'll have more updates around the same time this year.

JOEY•3/8/25, 10:22 AM

▲ [WARNING] No migrations folder found. Set migrations_dirmigrations_dir in your wrangler.json file to choose a different path.

i;m getting this error why?

PS : Solved it, was a stupid fix

JOEY•3/8/25, 10:22 AM

i already set up the path

く

くもりにくもったクラウドサービスlocaler•3/9/25, 8:25 AM

Is it possible to do something like enum type with d1?

James•3/9/25, 3:17 PM

sqlite doesn't support enums directly, but you could use a CHECKCHECK constraint on your column to accomplish a similar result.

disaster.js•3/9/25, 4:17 PM

Make a not null foreign key constraint to an enumerated table

TTait Pretty sure the answer to this is no. Cloudflare announced some D1 changes last...

ajgeiss0702•3/9/25, 6:56 PM

yeah they bank a bunch of updates for developer week each year

ajgeiss0702•3/9/25, 7:01 PM

im personally hoping for some replica news, but we'll see

Aajgeiss0702 im personally hoping for some replica news, but we'll see

Tait•3/9/25, 11:32 PM

Hoping for larger max size of databases or some easy way in workers to dynamically access many databases I shard accounts to...

Disciple of Caoximeihao•3/10/25, 6:33 AM

hiep@MBP-Hiep payalert-backend-v2 % wrangler d1 execute pay-alert --local --file=./database.sql

✘ [ERROR] Could not read file: ./database.sql

Cannot create a string longer than 0x1fffffe8 characters

HELP: database sql file 2GB

dimsid•3/10/25, 9:12 AM

Hello! I am using a D1 database and have golang script for upserting some rows in D1.

The cloudflare-go sdk that i am using is v0.89.0.

Everything worked good until last Monday that i started getting this error:

failed to upsert customers to D1 {"error": "error from makeRequest: received internal server error response (HTTP 500), please try again later"}

Any known issue or api change?
Wasn't able to find a relevant changelog

Ddimsid Hello! I am using a D1 database and have golang script for upserting some rows i...

lambrospetrou•3/10/25, 10:23 AM

If you query your database directly or through the dashboard UI console does it work? That error message is not a D1 error so not sure which layers fails for you there.

Llambrospetrou If you query your database directly or through the dashboard UI console does it ...

dimsid•3/10/25, 10:37 AM

yes quering the d1 directly from the Ui console works.

I have noticed some other api compatibility issues that i have fixed.

My code was originally like this:

res, err := c.api.QueryD1Database(c.ctx, cloudflare.AccountIdentifier(c.cfg.Cloudflare.AccountID), cloudflare.QueryD1DatabaseParams{
DatabaseID: c.cfg.Cloudflare.DBID,
SQL: sqlQuery.String(),
// error was originally here
})

The first error that i started getting was this:

Invalid property: params => Expected array, received null (7400)"}

When i changed the code to include a string array with params i started getting:

failed to upsert customers to D1 {"error": "error from makeRequest: received internal server error response (HTTP 500), please try again later"}

This started happening one week ago.

Ddimsid yes quering the d1 directly from the Ui console works. I have noticed some oth...

lambrospetrou•3/10/25, 10:50 AM

We recently added some validation on that endpoint. The Invalid property: params => Expected array, received null (7400)Invalid property: params => Expected array, received null (7400) seems to be coming from that validation. The paramsparams is an optional list argument that should only be provided if you have bind parameters in the SQL query.

I will see if we can make the params === nullparams === null be treated the same is not provided at all, since

null

null

is not a valid value per se for that list argument.

When i changed the code to include a string array with params i started getting:

Not sure what you mean here. Did you provide an empty slice?

Thanks for getting back to me! Database ID is 31174a64-6897-47f9-8364-644637f90c40. Sentry shows `D

Similar Threads

Similar Threads

Similar Threads