Seeing D1 DB is overloaded errors a lot more since 12 PM GMT

jims0209OP•1/23/25, 5:24 PM

DB ids:

f8d9ec32-6d52-4224-9316-fc50bd556811
15a6fbf7-6c42-4621-8795-b68f352ab0e4

f8d9ec32-6d52-4224-9316-fc50bd556811
15a6fbf7-6c42-4621-8795-b68f352ab0e4

jims0209OP•1/23/25, 5:30 PM

The CF worker that's using it is only getting 16 req / s max, wouldn't have expected any issues from this kind of load? (worker ID

f1464da9-c78b-42c2-b197-fc60492ca704

f1464da9-c78b-42c2-b197-fc60492ca704

)

Jjims0209 Seeing D1 DB is overloaded errors a lot more since 12 PM GMT

Max (@rozenmd)•1/23/25, 5:48 PM

We started rolling out a feature around 1600 UTC, the team is investigating if it's related

Max (@rozenmd)•1/23/25, 5:49 PM

16 RPS should be more than fine, but depends on how complex the query is

jims0209OP•1/23/25, 6:24 PM

Yeah the performance is pretty bad now. Even the CF D1 dashboard is slow to load

jims0209OP•1/23/25, 6:24 PM

The red bar of death is growing

jims0209OP•1/23/25, 8:57 PM

Looks like stuff is back to normal now for service on my end... thanks for resolving whatever that was fairly quickly

jims0209OP•1/23/25, 8:57 PM

Wall times have come back down to normal right before 20:00 UTC

Max (@rozenmd)•1/24/25, 9:58 AM

Added a bit more data and sorting to D1 insights

kamama•1/24/25, 10:04 AM

will paid plan faster than free plan?
i mean worker -> D1, not the query itself

Kkamama will paid plan faster than free plan? i mean worker -> D1, not the query itself

1984 Ford Laser•1/24/25, 11:11 AM

Nah

11984 Ford Laser Nah

kamama•1/24/25, 11:19 AM

then its really slow haha, turso better

Kkamama then its really slow haha, turso better

Max (@rozenmd)•1/24/25, 11:20 AM

what numbers are you seeing?

Kkamama 1 query take 224ms (foods_aus raw) and another one take 1.1s (nutrients_aus raw)...

kamama•1/24/25, 11:22 AM

@Max (@rozenmd)

Kkamama @Max (@rozenmd)

Max (@rozenmd)•1/24/25, 11:22 AM

what numbers are you seeing since 2025-01-07?

kamama•1/24/25, 11:24 AM

now around 500ms - 1000ms

Max (@rozenmd)•1/24/25, 11:24 AM

We got a fair bit faster since

kamama•1/24/25, 11:24 AM

from worker1 -> worker2 -> DB

kamama•1/24/25, 11:25 AM

let me deploy the performance check right

Kkamama from worker1 -> worker2 -> DB

Max (@rozenmd)•1/24/25, 11:25 AM

what do you see in the colo field at https://cloudflare.com/cdn-cgi/trace ?
and whats the output of wrangler d1 info dbnamewrangler d1 info dbname ?

kamama•1/24/25, 11:26 AM

HKG

kamama•1/24/25, 11:26 AM

running_in_region │ WNAM

Max (@rozenmd)•1/24/25, 11:27 AM

That's why:

kamama•1/24/25, 11:28 AM

i did try apac before

kamama•1/24/25, 11:28 AM

similar

戴

戴きますReina•1/24/25, 12:24 PM

anyone have project with hono with d1 prisma? how get the url for the db1 database? for prisma migrate

戴戴きますReina anyone have project with hono with d1 prisma? how get the url for the db1 databa...

Max (@rozenmd)•1/24/25, 12:27 PM

this might help
https://www.prisma.io/docs/orm/overview/databases/cloudflare-d1#migration-workflows

MMax (@rozenmd)this might help https://www.prisma.io/docs/orm/overview/databases/cloudflare-d1#...

戴

戴きますReina•1/24/25, 12:38 PM

that the problem, it doesnt, no matter how i tried to get the url for d1 we cant get it, need via wrangler

戴

戴きますReina•1/24/25, 12:38 PM

how to migrate from 001 migrations --> 002 migrations if a table already exist, this error confusing via wrangler. all example is writter from empty table not an existed one

Max (@rozenmd)•1/24/25, 12:41 PM

your migrations shouldn't be trying to create a table that already exists, but you can update your SQL to

CREATE TABLE IF NOT EXISTS

CREATE TABLE IF NOT EXISTS

to avoid the error. it sounds like there's something wrong with your setup if you already have tables and are trying to run migrations to create them, though.

Isaac McFadyen•1/24/25, 12:42 PM

^ migrations are not meant to be indempotent, instead there's usually a table created within the DB that stores the migration name/ID and whether it's already been applied

Isaac McFadyen•1/24/25, 12:42 PM

That way you don't re-run the same migration twice.

戴

戴きますReina•1/24/25, 12:44 PM

the only thing i can think rn is via db file

Original message was deleted

Isaac McFadyen•1/24/25, 12:44 PM

It looks like you're trying to create a unique/primary/foriegn key that already exists?

Isaac McFadyen•1/24/25, 12:44 PM

What's your SQL statement?

IIsaac McFadyen What's your SQL statement?

戴

戴きますReina•1/24/25, 12:46 PM

sql statement is generated via prisma cli

戴戴きますReina anyone have project with hono with d1 prisma? how get the url for the db1 databa...

戴

戴きますReina•1/24/25, 12:46 PM

like this

戴戴きますReina sql statement is generated via prisma cli

Isaac McFadyen•1/24/25, 12:46 PM

Does the Prisma CLI connect to your D1 DB to verify that the table doesn't already exist? It shouldn't be giving you SQL to create the table if the table already exists.

IIsaac McFadyen Does the Prisma CLI connect to your D1 DB to verify that the table doesn't alrea...

戴

戴きますReina•1/24/25, 12:48 PM

we using prisma migrate diff like in the docs,
https://www.prisma.io/docs/orm/overview/databases/cloudflare-d1

Cloudflare D1 | Prisma Documentation

Guide to Cloudflare D1

IIsaac McFadyen Does the Prisma CLI connect to your D1 DB to verify that the table doesn't alrea...

戴

戴きますReina•1/24/25, 12:48 PM

yup its should not generate create table, even we change manual still not work

戴戴きますReina yup its should not generate create table, even we change manual still not work

Isaac McFadyen•1/24/25, 12:52 PM

It's very hard to troubleshoot unless you give the (manually changed) statement. The error you shared indicates that it's trying to do something it shouldn't be.

IIsaac McFadyen It's very hard to troubleshoot unless you give the (manually changed) statement....

戴

戴きますReina•1/24/25, 12:52 PM

for now i think i am gonna restart all the d1 since its still the beginning huhu

IIsaac McFadyen It's very hard to troubleshoot unless you give the (manually changed) statement....

戴

戴きますReina•1/24/25, 12:54 PM

for example 002 migrations already make table "CREATE TABLE "Single" but if we change manual (cause cli not working) is like this "CREATE TABLE IF NOT EXIST "Single""

戴戴きますReina for example 002 migrations already make table "CREATE TABLE "Single" but if we c...

Isaac McFadyen•1/24/25, 12:55 PM

Is there any other statement in there that might be trying to create a key (that's what the error is)? Maybe a CREATE INDEXCREATE INDEX or similar?

IIsaac McFadyen Is there any other statement in there that might be trying to create a key (that...

戴

戴きますReina•1/24/25, 1:02 PM

nothing

Isaac McFadyen•1/24/25, 1:03 PM

An error is still returned if the table cannot be created because of an existing index, even if the "IF NOT EXISTS" clause is specified.

戴戴きますReina we using prisma migrate diff like in the docs, https://www.prisma.io/docs/orm/ov...

戴

戴きますReina•1/24/25, 1:03 PM

i got lock in here, if you read this if we use --from-schema-datamodel --from-url we cant since binding is via wrangler not url like postgress, we also cant use

Isaac McFadyen•1/24/25, 1:03 PM

Ah, actually, looks to be a SQLite thing.

Isaac McFadyen•1/24/25, 1:03 PM

TLDR if there's an index in the table you can't even use CREATE IF NOT EXISTS

IIsaac McFadyen TLDR if there's an index in the table you can't even use CREATE IF NOT EXISTS

戴

戴きますReina•1/24/25, 1:03 PM

wait let me check

Seeing D1 DB is overloaded errors a lot more since 12 PM GMT

Similar Threads

Similar Threads

Similar Threads