I think we're in agreement. If it's exceptional then exceptional stuff happen from time to time. I'l

I think we're in agreement. If it's exceptional then exceptional stuff happen from time to time. I'll see what CF respond and in what timeline. We're likely to share our experience more broadly with other companies to learn from it as I would have liked hearing about those stories when making our infra choices.

JJames agreeing w @rubenf , there's a world of difference between guaranteed SLAs and c...

Chaika•10/29/24, 10:06 PM

fwiw no one has said anything's lost/unrecoverable, still waiting on escalation response, I'd expect the same though

Rrubenf I think we're in agreement. If it's exceptional then exceptional stuff happen fr...

James•10/29/24, 10:07 PM

Agreed, this is exactly what I'd recommend. I would fully anticipate your DB to be restored, but sharing your experience to help others is a great idea. :MeowHeartCloudflare:

1984 Ford Laser•10/29/24, 10:08 PM

@rubenf are you able to share here what the eventual issue/resolution is? Def curious to see where it goes

1984 Ford Laser•10/29/24, 10:09 PM

Apologies if I came across as attacking or anything, not my intention :thisisfine:

Rrubenf I think we're in agreement. If it's exceptional then exceptional stuff happen fr...

James•10/29/24, 10:22 PM

For reference on usage, here's ~9 months worth of errors of internal, upstream errors for a project using D1: https://i.james.pub/file/2024/10/eafd02a4-02c7-45ba-8cf4-bfe39abbe7d7.png

James•10/29/24, 10:23 PM

1k in the last 7 days https://i.james.pub/file/2024/10/b14ed4b7-a681-457b-92ff-56459d894871.png

rubenfOP•10/29/24, 10:23 PM

James•10/29/24, 10:26 PM

We're seeing a couple more people reporting similar problems for what it's worth:
https://community.cloudflare.com/t/d1-error-internal-error-while-starting-up-d1-storage-caused-object-to-be-reset/730624?u=cherryjimbo
https://community.cloudflare.com/t/d1-database-error/730656?u=cherryjimbo

We're going to escalate this with higher priority and hopefully get some eyeballs on it ASAP.

Chaika•10/29/24, 10:52 PM

https://www.cloudflarestatus.com/incidents/h5n23gyb4my2

Increase in D1 Errors

naourass•10/30/24, 12:19 AM

Hi there, I'm in a scenario where I update/add data periodically to a local d1 db and need to sync that data progressively with the remote one. Is there some way to connect to the remote db from a node script so I can run the diffing logic (primarily based on last_updatedlast_updated fields) and push the updates from the local db to the remote one, or is wrangler d1 executewrangler d1 execute the only way currently to run queries on a remote d1 db? Thanks in advance.

Original message was deleted

KaiM•10/30/24, 12:44 AM

Just following up here. With Smart Placement enabled the Worker was running in Brisbane - still very much the opposite side of the world to the D1 database. Any ideas?

Nnaourass Hi there, I'm in a scenario where I update/add data periodically to a local d1 d...

Isaac McFadyen•10/30/24, 12:45 AM

You can use the Cloudflare API, one sec.

Isaac McFadyen•10/30/24, 12:45 AM

https://developers.cloudflare.com/api/operations/cloudflare-d1-query-database

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

sz19•10/30/24, 12:51 AM

The d1 errors are back again in my end

TomK•10/30/24, 3:06 AM

On my end, there have been no recurrences of the D1 errors in the last hour.

TomK•10/30/24, 3:13 AM

Does anyone know how to find the location selected when a D1 database was created? I've looked in both the dash and the wrangler command, but I can't find any relevant information.

TTomK Does anyone know how to find the location selected when a D1 database was create...

Isaac McFadyen•10/30/24, 3:17 AM

Try

wrangler d1 info <dbname>

wrangler d1 info <dbname>

IIsaac McFadyen Try `wrangler d1 info <dbname>` 😄

TomK•10/30/24, 3:39 AM

There is no location information in the info command.

TomK•10/30/24, 3:40 AM

TomK•10/30/24, 3:40 AM

wrangler 3.83.0

Isaac McFadyen•10/30/24, 3:40 AM

If you do

wrangler d1 list

wrangler d1 list

do you see

production

production

as the version?

Isaac McFadyen•10/30/24, 3:41 AM

There should be a

running_in_region

running_in_region

field right between the size and read query count... strange that you don't see it

FFlikTeoh https://discord.com/channels/595317990191398933/799437470004412476/1298726326265...

Chaika•10/30/24, 3:55 AM

anything more interesting output if you try info with the --json flag after the name?

FFlikTeoh Nope. I had other db that wasn't using location hint though. Those shows its cur...

Chaika•10/30/24, 3:58 AM

What do you mean "Current regions"? D1 only runs in a single region/location, if you don't specify a location hint it just does it off the requestor's location, and it'll stay there forever

FFlikTeoh Yeah. What I mean is that, other db that was created without location hints, sho...

Chaika•10/30/24, 4:01 AM

hmm I can't reproduce that. If you have a second, try making another with the same location hint? Just trying to understand scope, I'd guess it's a weird one-off issue
The --json option is just returning what the database get endpoint responds with + graphql, so it missing is api being confused/not a specific wrangler thing

TTomK Click to see attachment

Chaika•10/30/24, 4:04 AM

what's the date of creation on that db?

Chaika•10/30/24, 4:05 AM

oop sorry I meant tomk, yea I saw yours, maybe just an issue for dbs created in a specific period

FFlikTeoh Should I create a new profile db? This one also takes 1.5s to 4s on initial conn...

Chaika•10/30/24, 4:07 AM

how much of that is query time?

FFlikTeoh Under 100ms. It's just the connection time is long for every initial request (wh...

Chaika•10/30/24, 4:09 AM

there's going to be some cold start time but shouldn't be that much

Chaika•10/30/24, 4:09 AM

where are you getting the response times from? The D1 Console wouldn't be a good indictator of response time for example, all requests still have to go you -> core -> d1 instance afaik

FFlikTeoh Yeah it was in the 1.5s to 2s range last week. Yesterday it was at 4.4s. Which w...

Chaika•10/30/24, 4:12 AM

it wouldn't go to sleep if it was constantly being accessed, if you're getting 800ms on some subsequent requests that's still pretty high though

FFlikTeoh This was from insights: ``` { "query": "SELECT * FROM profiles WHERE user_id...

Chaika•10/30/24, 4:13 AM

hmm that one's 0.3ms on avg

Chaika•10/30/24, 4:13 AM

800ms is really high if you have smart placement on, possible that it being borked is connected to the api not showing the location though

FFlikTeoh I can't remember the exact location hint I gave when I created that db. But I th...

Chaika•10/30/24, 4:14 AM

with smart placement on, what was the cf-placement response header?

Chaika•10/30/24, 4:20 AM

Smart Placement is currently ignored when making RPC calls. If Smart Placement is enabled for Worker A, and Worker B declares a Service Binding to it, when Worker B calls Worker A via RPC, Worker A will run locally, on the same machine.

Chaika•10/30/24, 4:20 AM

even if it did work if the underlying d1-calling worker was called via rpc the header wouldn't be passed up anyway

I think we're in agreement. If it's exceptional then exceptional stuff happen from time to time. I'l

Similar Threads

Similar Threads

Similar Threads