I'm definitely not measuring TTFB inside the worker, but the numbers I got were so similar I (incorr

M

monOP•5/9/25, 8:05 AM

Also, sorry if "never responded to by a cloudflare employee" came across as an attack - was meant to mean that there wasn't an existing explanation I could fall back on.

Mmon I'm definitely not measuring TTFB inside the worker, but the numbers I got were ...

L

lambrospetrou•5/9/25, 8:13 AM

I can definitely argue that any latency comparison between REST API and Worker Binding is 99% of the time not the same root cause. If you have concrete numbers from your Worker's end to end latency, feel free to post later and I can take a look.
Just mentioning it even if you already know, but each D1 query includes the time it took for the SQL itself to be executed (usually at the single digit millisecond level or less), and then you can measure the end-to-end D1 latency within your worker. Example of measuring that in https://github.com/lambrospetrou/d1-starter-sessions-api/blob/6bbd1e5ee971240bb05b669488818f5976d7f81d/src/index.ts#L87

GitHub

d1-starter-sessions-api/src/index.ts at 6bbd1e5ee971240bb05b6694888...

Starter repository using Cloudflare Workers with D1 database and the new Sessions API for read replication. - lambrospetrou/d1-starter-sessions-api

M

monOP•5/9/25, 8:15 AM

Sure - I'll come back on Monday with some numbers from that.

Original message was deleted

L

lambrospetrou•5/9/25, 3:28 PM

That error doesn't refer to your traffic being too much. Usually it's due to either a query generating too many changes and then failing to persist, or the underlying machine has network issues and could not persist your changes (even if small).
Are you seeing this consistently over different times, or did you see it now a few times?
BTW, without a database ID we can't really help much in terms of investigation.

Original message was deleted

L

lambrospetrou•5/9/25, 3:36 PM

I literally only see a single error for your database, and the location of your database had some sporadic network issue spikes throughout the day, so it seems like you were just unlucky.

VVlad Lykhonis That wasn’t a question. I can create 50k D1s too and extend limit. Question was ...

G

gruntlord6•5/9/25, 4:49 PM

when they eventually making dynamic bindings its a great way to handle this scenario without the complexity of durable objects. Sharding is the way IMO since each db is a single thread anyway

G

gruntlord6•5/9/25, 4:52 PM

I haven't used this but if it comes up for me and they still don't have the dynamic bindings officially this would be worth investigating: https://discord.com/channels/595317990191398933/992060581832032316/1357236057569099849

Ggruntlord6 I haven't used this but if it comes up for me and they still don't have the dyna...

V

Vlad Lykhonis•5/9/25, 9:23 PM

I am using workers for platforms, so allocating new D1 and binding it to a my clients scripts should be no problem. I was curious if there is some more general approach for sharding, but indeed seems more situational aka application specifics

G

gruntlord6•5/9/25, 9:24 PM

yea its always going to come down to what data is suitable to be sharded. You can approach it all kinds of ways. Does each client get a db? each organization? each member of the org? etc

G

gruntlord6•5/9/25, 9:25 PM

in theory you could have a central db that just maps data from other dbs, that would probably work for most data sets but be more complicated to manage

Ggruntlord6 in theory you could have a central db that just maps data from other dbs, that w...

L

lambrospetrou•5/10/25, 8:21 AM

Many folks do this, but I recommend against it. If you put a single database (or even Durable Object) in the hot path of every request you lost all the benefits of sharding across multiple of them. If that one DB/DO is down, then you halt.
It's totally OK to have one control plane database for things like managing your resources during creation/deletion/listing, but for the hot path and data plane operations of your application you should not depend on that single DB/DO.
I wrote about this pattern here: https://developers.cloudflare.com/reference-architecture/diagrams/storage/durable-object-control-data-plane-pattern/

Cloudflare Docs

Control and data plane architectural pattern for Durable Objects

Durable Objects are built on-top of Cloudflare Workers spanning several locations across our global infrastructure network.
Each Durable Object instance has its own durable storage persisted across requests, in-memory state, single-threaded execution, and can be placed in a specific region.

W

will smith•5/11/25, 2:42 PM

is it me or is database editing in the UI broken?
It's straight up editing the wrong row. Video attached
https://dash.cloudflare.com/a3f6e70849e6eb5ca1ebaf6083bc84ba/workers/d1/databases/79a7d7de-4213-4a3a-b53c-e9ac3c1eda91/tables/Page?page=1&perPage=10

Wwill smith is it me or is database editing in the UI broken? It's straight up editing the w...

B

Brayden•5/11/25, 3:43 PM

If you go back to the D1 resource list page and click the “…” menu, then “Explore data”, try using this new experience & let me know if it works.

BBrayden If you go back to the D1 resource list page and click the “…” menu, then “Explor...

W

will smith•5/11/25, 4:05 PM

yep this one's working thanks

BBrayden If you go back to the D1 resource list page and click the “…” menu, then “Explor...

G

gruntlord6•5/11/25, 10:46 PM

that looks a lot nicer, any chance it will have sortable columns like the other version does?

Ggruntlord6 that looks a lot nicer, any chance it will have sortable columns like the other ...

B

Brayden•5/11/25, 11:54 PM

This week, stay tuned

Llambrospetrou I can definitely argue that any latency comparison between REST API and Worker B...

M

monOP•5/12/25, 1:43 AM

Here's some typical numbers for small and large returns, where I take a

performance.now()

performance.now()

before and after the call to

bind(...).all()

bind(...).all()

bind(...).all()

bind(...).all() to identify the total time.

row fetch took 206 ms
result serialises to 19906 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 0.4254
  },
  "duration": 0.4254,
  "changes": 0,
  "last_row_id": 705,
  "changed_db": false,
  "size_after": 10797056,
  "rows_read": 2,
  "rows_written": 0
}

row fetch took 3748 ms
result serialises to 5100116 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 2.4634
  },
  "duration": 2.4634,
  "changes": 0,
  "last_row_id": 840,
  "changed_db": false,
  "size_after": 13021184,
  "rows_read": 100,
  "rows_written": 0
}

row fetch took 206 ms
result serialises to 19906 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 0.4254
  },
  "duration": 0.4254,
  "changes": 0,
  "last_row_id": 705,
  "changed_db": false,
  "size_after": 10797056,
  "rows_read": 2,
  "rows_written": 0
}

row fetch took 3748 ms
result serialises to 5100116 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 2.4634
  },
  "duration": 2.4634,
  "changes": 0,
  "last_row_id": 840,
  "changed_db": false,
  "size_after": 13021184,
  "rows_read": 100,
  "rows_written": 0
}

row fetch took 206 ms
result serialises to 19906 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 0.4254
  },
  "duration": 0.4254,
  "changes": 0,
  "last_row_id": 705,
  "changed_db": false,
  "size_after": 10797056,
  "rows_read": 2,
  "rows_written": 0
}

row fetch took 3748 ms
result serialises to 5100116 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 2.4634
  },
  "duration": 2.4634,
  "changes": 0,
  "last_row_id": 840,
  "changed_db": false,
  "size_after": 13021184,
  "rows_read": 100,
  "rows_written": 0
}

row fetch took 206 ms
result serialises to 19906 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 0.4254
  },
  "duration": 0.4254,
  "changes": 0,
  "last_row_id": 705,
  "changed_db": false,
  "size_after": 10797056,
  "rows_read": 2,
  "rows_written": 0
}

row fetch took 3748 ms
result serialises to 5100116 bytes of JSON
result meta {
  "served_by": "v3-prod",
  "served_by_region": "APAC",
  "served_by_primary": true,
  "timings": {
    "sql_duration_ms": 2.4634
  },
  "duration": 2.4634,
  "changes": 0,
  "last_row_id": 840,
  "changed_db": false,
  "size_after": 13021184,
  "rows_read": 100,
  "rows_written": 0
}

Mmon Here's some typical numbers for small and large returns, where I take a `perform...

L

lambrospetrou•5/12/25, 6:33 AM

Your worker doing this is in APAC too? Judging from the fast response my guess would be that even if it is, probably far away from the DB still.

Llambrospetrou Your worker doing this is in APAC too? Judging from the fast response my guess w...

M

monOP•5/12/25, 6:36 AM

I'm in OC so I assume the worker will be too - similar timings for deployed worker vs

wrangler dev --remote

wrangler dev --remote

M

monOP•5/12/25, 6:36 AM

No smart placement

Mmon I'm in OC so I assume the worker will be too - similar timings for deployed work...

L

lambrospetrou•5/12/25, 6:38 AM

OK OC to APAC is super varied unfortunately. Without digging into it, my guess is that the 5MB response size hits the limitation we know about the JSRPC protocol (not D1 specific), and gets worse when over OC->APAC. I will raise it again with the team since it's been in discussion for some time.

M

monOP•5/12/25, 6:39 AM

Fantastic, thanks for getting to the bottom of it! In the meantime I'll probably try and migrate this code to Durable Objects to avoid the cross-region shenanigans - I've been told we tried and failed before, but with SQLite in DO now I think it'll be smooth sailing.

M

monOP•5/12/25, 6:43 AM

Well, not perfectly smooth sailing because

[WARNING] SQLite in Durable Objects is only supported in local mode.

[WARNING] SQLite in Durable Objects is only supported in local mode.

[WARNING] SQLite in Durable Objects is only supported in local mode.

[WARNING] SQLite in Durable Objects is only supported in local mode., but I can probably work around that for the time being

Mmon Fantastic, thanks for getting to the bottom of it! In the meantime I'll probably...

L

lambrospetrou•5/12/25, 6:45 AM

BTW, the limit I mentioned applies to DOs as well, but at least there your code is near the database so you can do your main logic there to reduce the 5MB result further down before returning it out of the DO.

M

monOP•5/12/25, 6:46 AM

Yep, and that's exactly what my plan is - the rows are all read, lightly processed and saved to R2. By moving this work into the DO, we entirely eliminate the RPC overhead.

M

monOP•5/12/25, 6:47 AM

Plus it's information about a user session, so I get to simplify all the queries and just have one DO per session instead of filtering the rows.

M

monOP•5/12/25, 6:47 AM

Honestly it really is the perfect usecase for DOs and I'm sad it didn't work out the first time

B

ByteBeast•5/12/25, 11:10 AM

I have one table in which I have auth column when i query it into worker and fetch value in that column it gets converted in to **. what is this and how can I get actual value?

Y

yinxingmaiming6409•5/13/25, 8:55 AM

I want to experience RealtimeKit. Can someone review it for me?

Yyinxingmaiming6409 I want to experience RealtimeKit. Can someone review it for me?

1

1984 Ford Laser•5/13/25, 11:43 AM

You need to be posting in #realtime

K

kchro3•5/13/25, 4:29 PM

Hey, I started seeing a bunch of

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost

D1_ERROR: Network connection lost (even after adding retries) where every write would fail.

the trace looked like this:

" at D1DatabaseSessionAlwaysPrimary._sendOrThrow (cloudflare-internal:d1-api:125:19) at async D1DatabaseSessionAlwaysPrimary.batch (cloudflare-internal:d1-api:80:23) at async Object.queue (index.js:6144:5)",

" at D1DatabaseSessionAlwaysPrimary._sendOrThrow (cloudflare-internal:d1-api:125:19) at async D1DatabaseSessionAlwaysPrimary.batch (cloudflare-internal:d1-api:80:23) at async Object.queue (index.js:6144:5)",

" at D1DatabaseSessionAlwaysPrimary._sendOrThrow (cloudflare-internal:d1-api:125:19) at async D1DatabaseSessionAlwaysPrimary.batch (cloudflare-internal:d1-api:80:23) at async Object.queue (index.js:6144:5)",

" at D1DatabaseSessionAlwaysPrimary._sendOrThrow (cloudflare-internal:d1-api:125:19) at async D1DatabaseSessionAlwaysPrimary.batch (cloudflare-internal:d1-api:80:23) at async Object.queue (index.js:6144:5)",

i was trying to use batch on a list of insert statements like this:

await env.D1.batch(
  batch.map((item) => stmt.bind(...))
);

await env.D1.batch(
  batch.map((item) => stmt.bind(...))
);

await env.D1.batch(
  batch.map((item) => stmt.bind(...))
);

await env.D1.batch(
  batch.map((item) => stmt.bind(...))
);

is there a soft limit on how large a batch can be? i was able to resolve it by breaking up the batches into smaller batches of 25, but it wasn't causing problems before and the full batch size is <100

T

Tuna•5/13/25, 6:59 PM

Hi,

I have workers, durableObject lets say one durableObject is for keep track of uploads from client to server (i have my own API for multipart upload), the second is for access to R2 and also used as life cycle, alarm is set for TTL and after that its deleting the file/s from R2.

Im wondering what will be best practice, i want the durableObject to sync R1, like when user upload files, it will keep track in durable object but also sync the global database R1 which will be per user, and i will need one database for all users.
i also have an api gateway worker with itty router to handle rest API.

should i update the D1 from the router handler / workers ? should i clean the R2 from the alarm?
or should i use queues?
if i use queues for async operations, they need to be bounded to the same worker or i can set the main worker to be producer and create a second worker to be the consumer ?

P

parisholley•5/13/25, 7:22 PM

anyone seeing a higher than usual amount of D1 errors (timeout, connection lost, etc)

K

kchro3•5/14/25, 1:02 AM

yes, i saw a huge spike of errors in the last week without changing the code at all

Pparisholley anyone seeing a higher than usual amount of D1 errors (timeout, connection lost,...

G

gruntlord6•5/14/25, 5:03 AM

yea had an automated job fail because it could not create a table this morning due to D1 timing out

P

parisholley•5/14/25, 2:17 PM

do reads effectively "lock" the d1 database? eg: if i'm doing an expensive read-only query that takes 1-2s, does this prevent other clients from doing reads?

D

Dean•5/15/25, 12:25 AM

i thought reads were multi-threaded but writes are single threaded

D

Dean•5/15/25, 12:26 AM

is dynamic bindings for D1 coming eventually? I've been working around it for a while but need to start to re-think it long term if it's never going to arrive

DDean is dynamic bindings for D1 coming eventually? I've been working around it for a ...

H

Hard@Work•5/15/25, 12:45 AM

SQLite DOs are kind of dynamic bindings? They have most of the features, minus read replicas, but with scripting next to the DB

HHard@Work SQLite DOs are kind of dynamic bindings? They have most of the features, minus r...

D

Dean•5/15/25, 12:50 AM

i get DO's exist, but i built the platform around D1 with dynamic bindings coming eventually (which is fine). I'm hesitant to change everything from D1 -> DO and then D1 ends up with dynamic binding support and I've wasted my time. Eventually i'd like these databases replicated so I'm sort of in limbo.

D

Deda•5/15/25, 1:05 AM

is it possible to connect to the d1 trought the node.js app locally, or its only available for the workers?

C

Chaika•5/15/25, 1:23 AM

?d1-remote-connections

S

SuperHelpflare•5/15/25, 1:23 AM

Accessing D1 from outside workers:

D1 is based on SQLite, which does not natively support remote connections and isn't MySQL/PostgreSQL wire compatible, nor does D1 itself offer that functionality. As such, your options are:

1 -> The Cloudflare API Query Endpoint (https://developers.cloudflare.com/api/operations/cloudflare-d1-query-database), with the upside of needing less setup, all requests have to go back to Cloudflare's core, so request latency is far from optimal from some locations. You would also be subject to the API Rate limit of 1200 requests per 5 minutes.

2 -> Create a worker to proxy requests to your D1 Database. Either tightly bound to your application/schema or loose and just accepting any query. This would allow your worker to execute potentially closer to your D1 Database and avoid the api rate limit.

Ffrankichiro Hello! What is the correct API request to get the same info as `wrangler d1 info...

C

Chaika•5/15/25, 8:39 PM

Wrangler is using GraphQL
https://github.com/cloudflare/workers-sdk/blob/02d40ed3bbfc9cb4c2f95fb921efd7ec56f141a6/packages/wrangler/src/d1/info.ts#L57

GitHub

workers-sdk/packages/wrangler/src/d1/info.ts at 02d40ed3bbfc9cb4c2f...

Home to Wrangler, the CLI for Cloudflare Workers® - cloudflare/workers-sdk

C

Chaika•5/15/25, 8:39 PM

can see the exact query there. Wrangler's all open source

A

aza547•5/16/25, 11:36 AM

I'm seeing spikes of D1 failures periodically when querying my database recently. It doesn't feel like the normal level of background failures you might just retry to avoid. The errors all seem to be one of:

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset

D1_ERROR: Network connection lost.

D1_ERROR: Network connection lost.

D1_ERROR: Network connection lost.

D1_ERROR: Network connection lost.

```
D1_ERROR: internal error; reference = 3n7qu7dkdd0atgp7vioes6a5
```
D1_ERROR: internal error; reference = 3n7qu7dkdd0atgp7vioes6a5
```
D1_ERROR: internal error; reference = 3n7qu7dkdd0atgp7vioes6a5
```
D1_ERROR: internal error; reference = 3n7qu7dkdd0atgp7vioes6a5
Is anyone able to advise on this? My database ID is
```
589bafbd-d600-4e01-8879-7443811d45a1
```
589bafbd-d600-4e01-8879-7443811d45a1
```
589bafbd-d600-4e01-8879-7443811d45a1
```
589bafbd-d600-4e01-8879-7443811d45a1
if that's of any use.

I'm definitely not measuring TTFB inside the worker, but the numbers I got were so similar I (incorr

Similar Threads

Similar Threads

Similar Threads