no - the bookmarks time travel uses are like pointers rather than actual copies of the DB, makes it

no - the bookmarks time travel uses are like pointers rather than actual copies of the DB, makes it hard to do stuff like that

i initially wanted to build a Time Machine style UI for it, but it wouldn't work

Nnejc any insights into what could be going on?

Max (@rozenmd)OP•11/19/24, 8:06 PM

that's a pretty bad error on our part, if i had to guess it's hitting an error and rolling back, does it work if you call the /query API with the sql text directly?

nejc•11/19/24, 8:30 PM

@Max (@rozenmd) problem is that this DB is giving error all the time

nejc•11/19/24, 8:31 PM

no matter what I do, and wait for how long

Dean•11/20/24, 8:47 AM

same here

Dean•11/20/24, 8:47 AM

Error: D1_ERROR: Invalid primary location hint provided

oscar•11/20/24, 8:49 AM

same here, all services using D1 are down

Dean•11/20/24, 8:50 AM

rip d1

oscar•11/20/24, 8:57 AM

back up it seems

Dean•11/20/24, 8:58 AM

yep, getting results from my dbs now

miljussss•11/20/24, 9:03 AM

same here, got good a few minutes ago

DaniFoldi•11/20/24, 9:08 AM

Looks like it’s resolved now, but I’ll see if we can get a retro statuspage for this

Vikash•11/20/24, 9:17 AM

Is Cloudflare team playing with our production databases in the backend

D1_ERROR: Invalid primary location hint provided:

D1_ERROR: Invalid primary location hint provided:

Dean•11/20/24, 9:17 AM

see above

Vikash•11/20/24, 9:18 AM

I think the D1 was out of beta few months back, still these issues regularly.

Max (@rozenmd)OP•11/20/24, 9:20 AM

There was a bad release at 08:42 UTC, we have since rolled it back.

DaniFoldi•11/20/24, 11:01 AM

https://discord.com/channels/595317990191398933/895794943182909470/1308747807355703319

SteffTek•11/21/24, 5:17 AM

I've noticed that my d1 has become really slow.

A simple query where i loaded client information took only 20ms, where now it takes almost 300! i didn't change anything. we have multiple tenants, and this can be seen on the dev env and the prod env

Edit: All DBs are hosted in WEUR, where all our tenants are. smart placement is enabled for worker

Abdul•11/21/24, 6:14 AM

My startup recently got funded, and since i am cloudflare boy, i am already using majority of its services now i was thinking wether i should also use D1 as my main Database or not?

-> why i was thinking of D1?
= Since i am going to use workers for API and smart placement is also available, so using D1 would bring my api and Database closer making the query load faster.

-> Does D1 has limitations for startups?
-> has anyone faced problems with it and decided to change their DB

My use case ( not exact, just a example )
-> User will have multiple relationships in the table
-> Analytics

Thats it. please guide me if you can from your experience.
Thank you

SSteffTek I've noticed that my d1 has become really slow. A simple query where i loaded c...

Max (@rozenmd)OP•11/21/24, 7:15 AM

what's your database id, any chance the table just has more data without an index on the queried key?

MMax (@rozenmd)what's your database id, any chance the table just has more data without an inde...

SteffTek•11/21/24, 8:13 AM

we have a database for each tenant, in my test database we only have 4* entries in the table of concern. id is: 7b0f67f7-6768-44a8-a855-08e758a65989

SSteffTek I've noticed that my d1 has become really slow. A simple query where i loaded c...

Max (@rozenmd)OP•11/21/24, 11:18 AM

when you say it takes almost 300, do you mean as measured from the Worker? I don't see evidence of that kind of performance regression in that DB

SSteffTek we have a database for each tenant, in my test database we only have 4* entries ...

Max (@rozenmd)OP•11/21/24, 11:22 AM

also, how much traffic is this DB doing? smart placement relies on steady traffic to place your Worker optimally

MMax (@rozenmd)when you say it takes almost 300, do you mean as measured from the Worker? I don...

SteffTek•11/21/24, 11:47 AM

yep, i measuered the time within the worker. it always was around 20ms before.

should i disable smart placement? database is in WEUR anyway and all our traffic (should) come from germany

SteffTek•11/21/24, 11:50 AM

dashboard doesnt show any smart placement traffic, only default placement, so maybe not enough traffic

SSteffTek dashboard doesnt show any smart placement traffic, only default placement, so ma...

Max (@rozenmd)OP•11/21/24, 11:55 AM

smart placement uses 1% of your traffic to compare timings (so 99 get smart placed, 1 is left default placement as a baseline), it sounds like it needs a bit more traffic yeah

SteffTek•11/21/24, 11:56 AM

im just wondering because even our tenant has this problem where traffic should exist, more than our dev deployment ever had even while testing

SteffTek•11/21/24, 11:57 AM

funny thing to say: "yeah you just need to use the app more so it becomes faster" lol

MMax (@rozenmd)smart placement uses 1% of your traffic to compare timings (so 99 get smart plac...

lambrospetrou•11/21/24, 12:26 PM

Can you check your placement status for your worker? https://developers.cloudflare.com/workers/configuration/smart-placement/#placement-status

I think you also need to do multiple roundtrips from your worker to the database, otherwise it cannot get much faster anyway if it's a single request.

nejc•11/21/24, 12:27 PM

@Max (@rozenmd) will smart placement slow down (as it's doing more requests) workers that don't have a lot of traffic?

Nnejc @Max (@rozenmd) will smart placement slow down (as it's doing more requests) wor...

Max (@rozenmd)OP•11/21/24, 12:29 PM

you may have misunderstood what I wrote, smart placement doesn't do more requests, it requires more requests for better data

Nnejc @Max (@rozenmd) will smart placement slow down (as it's doing more requests) wor...

lambrospetrou•11/21/24, 12:30 PM

It's not doing more requests. It just uses 1 out of a 100 of your requests with smart placement disabled, so that it can compare that with your other 99 requests that are smart placed to figure out if it's worth it doing the smart placement or if it should "smart place your worker" elsewhere.

But always check the placement status to see if you are actually smart placed.

Llambrospetrou Can you check your placement status for your worker? https://developers.cloudfla...

SteffTek•11/21/24, 12:31 PM

will do, wait a moment

SteffTek•11/21/24, 12:34 PM

INSUFFICIENT_INVOCATIONS - so yeah... how many are needed? :D

nejc•11/21/24, 3:27 PM

@Max (@rozenmd) @lambrospetrou got it. Thank you

AAbdul My startup recently got funded, and since i am cloudflare boy, i am already usin...

James•11/21/24, 4:28 PM

I personally wouldn't use D1 as a primary due to the nature of D1 being so far from potential workers depending on your user base, the latency isn't good. During my own testing the extra 100-500ms latency per worker request due to multiple round trips to D1 wasn't worth it.

It forced me to use the DO SQL engine instead and refactor my app to per-user DBs which I feel is a more scalable design.

JJames I personally wouldn't use D1 as a primary due to the nature of D1 being so far f...

elpupper•11/21/24, 5:37 PM

how/why are you doing multiple round trips to D1?

MMax (@rozenmd)Is this a free account, or do you pay for Workers btw?

deternal•11/21/24, 6:13 PM

We use workers paid account, we have about 15 D1 databases and each one is less than 5 gb, so I doubt it crossed the 250 gb account wide threshold. The "Exceeded maximum DB size" errors show up for some time and then resolve on it's own, which is what it makes harder to understand if the db size actually breached 10gb or not, the UI's d1 db size is what we are use to decide to change the db, but these errors show up even when the db size is less than 2gb in the UI. Any tips would be gratly appreciated.

Eelpupper how/why are you doing multiple round trips to D1?

James•11/21/24, 6:22 PM

web app makes all kinds of D1 requests on a worker request, get session, get user, update user etc. Each SQL stmt is a round trip.

JJames web app makes all kinds of D1 requests on a worker request, get session, get use...

elpupper•11/21/24, 6:56 PM

100 ms seams reasonable. but 500 doesnt. You should consider not splitting up your statements and write real SQL language. I'm not making fun of you FYI a lot of people including me have a issue of splitting up queries when realistically it can be one query.

Eelpupper 100 ms seams reasonable. but 500 doesnt. You should consider not splitting up yo...

James•11/21/24, 7:05 PM

Already use straight SQL, there's no getting around some big requests with lots of disparate SQL for different purposes on a modern app. The downfall of D1 is that it's not colocated with the web server like many other services. Whats close for one user is far for another. Personally a db request should have sub 10ms latency from the web worker for simple queries. Closer to 1-5ms even or less.

elpupper•11/21/24, 7:06 PM

completely agree. The latency is a network latency tho thats the issue

elpupper•11/21/24, 7:06 PM

I had the same argument last time about it in this chat

MMax (@rozenmd)no - the bookmarks time travel uses are like pointers rather than actual copies ...