@Dean @sz19 @Shannor can you share database IDs of the dbs where you're experiencing the issues?

DDaniFoldi @Dean @sz19 @Shannor can you share database IDs of the dbs where you're experien...

D

Dean•11/29/24, 2:47 PM

2206f7ed-1476-40a0-9758-f1bc3d47e5ad for the last 12 hours it’s been okay, but it comes and goes. I have a cf worker that connects to it every hour to do auditing and it fails

D

D Trombett•11/29/24, 3:10 PM

Hi, sometimes I'm getting a

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset.

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset.

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset.

D1_ERROR: D1 DB storage operation exceeded timeout which caused object to be reset.. This happens rarely, but has been happening for weeks and when it happens no request is able to query the database. It seems like it randomly freezes for 30s and then returns that error
Database ID:

8a298455-ac11-4e0c-b160-4db807cf3572

8a298455-ac11-4e0c-b160-4db807cf3572

8a298455-ac11-4e0c-b160-4db807cf3572

8a298455-ac11-4e0c-b160-4db807cf3572

DD Trombett Hi, sometimes I'm getting a `D1_ERROR: D1 DB storage operation exceeded timeout ...

I

Isaac McFadyen•11/29/24, 3:11 PM

Can you give the database ID please (it's not a secret/can't be used except for on your own account so you can share it here)?

D

D Trombett•11/29/24, 3:12 PM

sure

I

Isaac McFadyen•11/29/24, 3:12 PM

Thanks.

Original message was deleted

I

Isaac McFadyen•11/29/24, 3:13 PM

Not sure there's an immediate fix but we're surfacing these errors to the team so hopefully there's some communication at some point.

D

D Trombett•11/29/24, 3:14 PM

Don't worry, I'm using D1 just for a small hobby project so it's nothing critical

S

Shannor•11/29/24, 3:38 PM

Hey @DaniFoldi and @Isaac McFadyen the Database ID is 7356accc-d066-45c4-a577-9b9009c822eb. We use the DB pretty often at my company so it's definitely a weird error though sporadic. We're not able to reproduce it on purpse and it also seems like we get the error but the DB action still happens.

J

James•11/29/24, 3:47 PM

These kind of sporadic errors are unfortunately par for the course with D1. Here's some stats from an active DB for example: https://canary.discord.com/channels/595317990191398933/992060581832032316/1300948096964100097
The best you can do is retry queries until they work, sadly, but I wish I had better news for you.

SShannor Hey @DaniFoldi and @Isaac McFadyen the Database ID is 7356accc-d066-45c4-a577-...

I

Isaac McFadyen•11/29/24, 3:49 PM

it also seems like we get the error but the DB action still happens

This part seems incredibly concerning...?

I

Isaac McFadyen•11/29/24, 3:50 PM

So to confirm, you're making a query and it's succeeding in doing whatever the query is supposed to, but you're still getting an error?

JJames These kind of sporadic errors are unfortunately par for the course with D1. Here...

J

James•11/29/24, 4:29 PM

From the D1 team: "[the user should] retry their query and unless there is an underlying issue with the database, it should eventually work". That's the best we've got for now, sorry folks.

K

Kotkoroid•11/29/24, 6:41 PM

Hey, does D1 engine has public sources?

KKotkoroid Hey, does D1 engine has public sources?

C

Chaika•11/29/24, 6:46 PM

public sources? like source code, or what?

K

Kotkoroid•11/29/24, 6:46 PM

Yes, is D1 open source?

KKotkoroid Yes, is D1 open source?

C

Chaika•11/29/24, 6:47 PM

It's just SQlite with a few patches: https://github.com/cloudflare/workerd/tree/main/patches/sqlite

GitHub

workerd/patches/sqlite at main · cloudflare/workerd

The JavaScript / Wasm runtime that powers Cloudflare Workers - cloudflare/workerd

K

Kotkoroid•11/29/24, 6:48 PM

Thanks

JJames From the D1 team: "[the user should] retry their query and unless there is an un...

D

Dean•11/30/24, 12:50 AM

this seems kind of wild to me, right? hey the product doesn't work sometimes, just hope it comes back or that customers aren't interrupted while it waits X amount of secs to timeout.

DDean this seems kind of wild to me, right? hey the product doesn't work sometimes, ju...

J

James•11/30/24, 12:55 AM

I wholeheartedly agree, and am raising issues around D1 stability and error rates pretty regularly. I opened https://github.com/cloudflare/cloudflare-docs/issues/18485 today in hopes that there's some public guidance of the kinds of architecture people are expected to build into their apps to have a stable experience with D1.

L

lucasp•11/30/24, 4:22 PM

Hello, I'm using Prisma with Hono and Workers. I've noticed that when I use Prisma, it takes more time to execute queries compared to using db.prepare. Is that normal? or whay i could being doing wrong

Llucasp Hello, I'm using Prisma with Hono and Workers. I've noticed that when I use Pris...

J

James•11/30/24, 4:35 PM

With the exact same query? Using any ORM is almost always going to create slightly more unoptimised queries because they're designed for flexibility and general use-cases vs doing very specific queries yourself.

JJames With the exact same query? Using any ORM is almost always going to create slight...

L

lucasp•11/30/24, 4:38 PM

yes i did this query

 const [total_records, users] = await Promise.all([
    prisma.user.count({
      where: whereClause
    }),
    prisma.user.findMany({
      take: limit || undefined,
      skip: page && limit ? (page - 1) * limit : undefined,
      where: whereClause,
      orderBy: sort ? getOrderBy(sort) : undefined,
      select: {
        id: true,
        first_name: true,
        last_name: true,
        role: {
          select: { name: true }
        },
        email: true,
        transportist: { select: { phone: true, status: true } },
        cargo_giver: { select: { phone: true, status: true } },
        created_at: true
      }
    })
  ])

 const [total_records, users] = await Promise.all([
    prisma.user.count({
      where: whereClause
    }),
    prisma.user.findMany({
      take: limit || undefined,
      skip: page && limit ? (page - 1) * limit : undefined,
      where: whereClause,
      orderBy: sort ? getOrderBy(sort) : undefined,
      select: {
        id: true,
        first_name: true,
        last_name: true,
        role: {
          select: { name: true }
        },
        email: true,
        transportist: { select: { phone: true, status: true } },
        cargo_giver: { select: { phone: true, status: true } },
        created_at: true
      }
    })
  ])

 const [total_records, users] = await Promise.all([
    prisma.user.count({
      where: whereClause
    }),
    prisma.user.findMany({
      take: limit || undefined,
      skip: page && limit ? (page - 1) * limit : undefined,
      where: whereClause,
      orderBy: sort ? getOrderBy(sort) : undefined,
      select: {
        id: true,
        first_name: true,
        last_name: true,
        role: {
          select: { name: true }
        },
        email: true,
        transportist: { select: { phone: true, status: true } },
        cargo_giver: { select: { phone: true, status: true } },
        created_at: true
      }
    })
  ])

 const [total_records, users] = await Promise.all([
    prisma.user.count({
      where: whereClause
    }),
    prisma.user.findMany({
      take: limit || undefined,
      skip: page && limit ? (page - 1) * limit : undefined,
      where: whereClause,
      orderBy: sort ? getOrderBy(sort) : undefined,
      select: {
        id: true,
        first_name: true,
        last_name: true,
        role: {
          select: { name: true }
        },
        email: true,
        transportist: { select: { phone: true, status: true } },
        cargo_giver: { select: { phone: true, status: true } },
        created_at: true
      }
    })
  ])

with prism findmany and selects it takes me 5 seconds and I changed it to using $queryRaw and it takes me 2 seconds which seems like quite a difference to me

Llucasp yes i did this query ```js const [total_records, users] = await Promise.all([ ...

J

James•11/30/24, 5:51 PM

You gotta check the raw query output to verify that. Probably not. Also orms spend time converting raw data to js objects.

F

Frederik•11/30/24, 8:53 PM

Hi folks, is there an example somewhere on how to use transactions with D1? (rolling back a sequence of inserts/updates if one failed)

E

esselungo•12/1/24, 2:22 AM

d1 really bills by rows written and not operations? is there no plan covering a bit more ops? i’m thinking of moving out of d1 completely for an outside db

Eesselungo d1 really bills by rows written and not operations? is there no plan covering a ...

I

Isaac McFadyen•12/1/24, 4:02 AM

What is an "operation" in this context?

I

Isaac McFadyen•12/1/24, 4:02 AM

And yes, D1 bills for rows read/written.

Original message was deleted

F

Frederik•12/1/24, 9:48 AM

Sorry I was not specific enough with what i meant with "sequence": with being able to use the result of a query/insert/update for the query in the sequence. This is not really possible with batch AFAIK

Original message was deleted

F

Frederik•12/1/24, 10:44 AM

thanks, i will try work my way around

M

Mas Inis•12/2/24, 2:22 AM

is D1 support branching (like neon, supabase, turso)?

MMas Inis is D1 support branching (like neon, supabase, turso)?

I

Isaac McFadyen•12/2/24, 2:45 AM

No. D1 has Time Travel (aka PITR, point-in-time recovery) but no branching.

IIsaac McFadyen No. D1 has Time Travel (aka PITR, point-in-time recovery) but no branching.

M

Mas Inis•12/2/24, 6:14 AM

Thanks!

IIsaac McFadyen No. D1 has Time Travel (aka PITR, point-in-time recovery) but no branching.

M

Max (@rozenmd)•12/2/24, 1:33 PM

(yet)

MMax (@rozenmd)(yet)

L

Larry•12/2/24, 1:49 PM

Is this on the roadmap or do you just like to tease us?

LLarry Is this on the roadmap or do you just like to tease us?

M

Max (@rozenmd)•12/2/24, 1:52 PM

regardless, it becomes a lot easier to create branch/preview DBs once you have infrastructure in place to rapidly spin up replicas of D1 DBs

D

dmaretskyi•12/2/24, 4:46 PM

Hello, I'm seeing high latency on a D1 database (around 1 sec RTT per write) on my workers project. The service is a simple CRUD api hooked up to D1 with Prisma. The database is located in WNAM while I'm calling the worker from Europe.

Is there anything I can do to mitigate the latency on writes? I could shard the data so that it's located closer to the user. D1 docs say that it's design to scale accross multiple smaller per-user databases? How is that achieved in practice? In my worker's TOML config I need to define each DB binding manually.

Ddmaretskyi Hello, I'm seeing high latency on a D1 database (around 1 sec RTT per write) on ...

J

James•12/3/24, 12:46 AM

i had the same concern, i ended up doing sql in the DO instead of D1 to generate and migrate new dbs on the fly per user.

MMax (@rozenmd)(yet)

I

Isaac McFadyen•12/3/24, 12:52 AM

Replicas first :lul:

Ddmaretskyi Hello, I'm seeing high latency on a D1 database (around 1 sec RTT per write) on ...

1

1984 Ford Laser•12/3/24, 1:16 AM

Durable Objects would be a far better suit here. More work to set up and get going from an architectural perspective, but far more malleable overall

M

Mitya•12/3/24, 12:35 PM

Hi. Today I got this, while developing locally with Wrangler's

--remote

--remote

set to true. Should I be concerned about this happening in production, or is it just a dev env issue?

M

Mitya•12/3/24, 12:35 PM

(Restarting the server got rid of the error - only seen this once.)

MMitya Hi. Today I got this, while developing locally with Wrangler's `--remote` set to...

M

Max (@rozenmd)•12/3/24, 12:51 PM

It's a deploy-time issue (running wrangler dev --remote deploys to edge-preview) - retrying fixes it

We're in the process of refactoring the D1 API, which should reduce how often these errors show up

T

Tom•12/4/24, 12:55 PM

Hey, given that D1 is "SQLite based", and SQLite allows only one writer (AFAIK?, except when using WAL mode?) is D1 bound by this limitation aswell?

T

Tom•12/4/24, 12:57 PM

My company intends to use D1 in a system where has write-heavy burst loads (these are regional, and not "big" at all given cloudflare's scale though)

TTom Hey, given that D1 is "SQLite based", and SQLite allows only one writer (AFAIK?,...

L

lambrospetrou•12/4/24, 1:11 PM

Even with WAL mode SQLite only allows one writer at a time. WAL mode allows multiple readers regardless of the writer: https://www.sqlite.org/wal.html
D1 is using SQLite Durable Objects, so only 1 query is executed at a specific point in time, but depending on your queries you can get hundreds/maybe low-thousands per second if they are small enough.

My company intends to use D1 in a system where has write-heavy burst loads

Without some numbers, and ideally benchmarking your exact use-case and the queries you will run yourself, nobody can confirm if this use-case is suitable for D1. What kind of bursts, how long do they last, how often, what is peak write qps, what are your queries...

Also location where you will be calling this might matter. A D1 database is in a single location (for now), so if you will be sending queries from all over the world, usual network latencies/delays apply).

T

Tom•12/4/24, 1:14 PM

Sorry for vague question, the burst would last ~10 minutes, they'd be long time apart (so no chance of colliding), queries would be simple multiple INSERT INTO (we intend to use D1 for our cart only, while having a whole other database that contains all data that's cached), 1sec for peak write qps

T

Tom•12/4/24, 1:23 PM

Write QPS might peak at like 700, and this peak might be for like 1 minute in this whole duration, then eases off slowly for the next ten minutes (I'm sure this qps is no problem for D1), our D1 location that we'll choose (western europe), and 99.9% of users are in this location aswell

Llambrospetrou Even with WAL mode SQLite only allows one writer at a time. WAL mode allows mult...

T

Tom•12/4/24, 1:39 PM

(A bit of more context behind this question: previously we used MariaDB (for just normal data and cart data), and our database performance was absolute horrendous.. eventually we found out that query cache was enabled, which is a killer in write-heavy loads. However, now we're completely rebuilding our front-end and figured we can just split out the cart into a separate database so our writes won't disturb our normal reads.)

D1 is using SQLite Durable Objects, so only 1 query is executed at a specific point in time, but depending on your queries you can get hundreds/maybe low-thousands per second if they are small enough.

D1 is using SQLite Durable Objects, so only 1 query is executed at a specific point in time, but depending on your queries you can get hundreds/maybe low-thousands per second if they are small enough.

D1 is using SQLite Durable Objects, so only 1 query is executed at a specific point in time, but depending on your queries you can get hundreds/maybe low-thousands per second if they are small enough.

D1 is using SQLite Durable Objects, so only 1 query is executed at a specific point in time, but depending on your queries you can get hundreds/maybe low-thousands per second if they are small enough.

Alright, that's great to hear, I'm 100% we'll manage with such capacity. The queries shouldn't be overly complex, we'll probably find a lot of places where we can use BEGIN CONCURRENT too.

@Dean @sz19 @Shannor can you share database IDs of the dbs where you're experiencing the issues?

Similar Threads

Similar Threads

Similar Threads