Cloudflare Developers•15mo ago

Can we work with geospatial data on it? I’m using Django so should I use SQLite locally?

Ccybersentry Can we work with geospatial data on it? I’m using Django so should I use SQLite ...

1984 Ford Laser•10/29/24, 12:49 PM

Can it be formatted as JSON or text? Then yes

cybersentryOP•10/29/24, 12:52 PM

I mean can’t anything be formatted as that? Just because it can doesn’t mean it should

Ccybersentry I mean can’t anything be formatted as that? Just because it can doesn’t mean it ...

1984 Ford Laser•10/29/24, 12:57 PM

We cant help you if we don't know what the data is. 'geospatial data' is so vague and broad, in theory basically any meaningful database solution could be used. A series of TXT documents formatted correctly could be used in theory

Original message was deleted

KaiM•10/29/24, 1:10 PM

I was under the impression that D1 had global replication. Does that exist at all?

KaiM•10/29/24, 1:17 PM

Oof, that sucks. At that point I’d rather just position my Worker in the same datacenter as the database and have the latency on the HTTP side. I gotta say, a database that is unable to be globally distributed but that’s designed for a compute platform that is global by default seems like a strange product offering.

KaiM•10/29/24, 1:18 PM

Doesn’t it try and find a middle ground? Because I’m still getting 500+ms latency on D1 queries with smart placement enabled.

KaiM•10/29/24, 1:21 PM

Yeah I saw those. Most of my endpoints do a few queries, most with at least one batch. As expected the first is consistently the slowest, but I still got higher latency than I would expect for subsequent ones. I’ll profile it all again tomorrow.

TomK•10/29/24, 2:05 PM

I've encountered a significant number of "D1_ERROR: internal error" messages today. we haven't updated our code. Has there been any changes in D1 today?

TTomK I've encountered a significant number of "D1_ERROR: internal error" messages tod...

fry69•10/29/24, 2:08 PM

In doubt check -> status there have been issues a few hours ago with pages, but not D1, so IDK (though it also showed "internal error").

fry69•10/29/24, 2:09 PM

"internal error" can literally mean anything.

fry69•10/29/24, 2:11 PM

Unless we see more reports here or elsewhere, it might also be something with your database/setup which Cloudflare can't handle for some reason.

TomK•10/29/24, 2:12 PM

The error message has now changed to "D1_ERROR: D1 storage operation exceeded timeout which caused object to be reset."

Ffry69 Unless we see more reports here or elsewhere, it might also be something with yo...

TomK•10/29/24, 2:12 PM

Okay, thank you for your response. I will check further.

nato•10/29/24, 2:35 PM

how can I make 2 different cloudflare workers apps use same D1 db in local dev?

nato•10/29/24, 2:35 PM

I see it uses ./wrangler/state/v3/d1 but since both projects are on seperate folders

nato•10/29/24, 2:36 PM

is there any way to specify path?

nato•10/29/24, 2:37 PM

nvm it was mentioned in docs

npx wrangler dev --persist-to <DIRECTORY>

npx wrangler dev --persist-to <DIRECTORY>

TTomK Okay, thank you for your response. I will check further.

Stan Angeloff•10/29/24, 3:01 PM

I'm another customer that's observing lots of random D1 failures today (and in general a lot more since September, lots of lost connection, internal error, etc.) Just thought I'd chime in so you know you are not alone.

sz19•10/29/24, 4:01 PM

It started at 12PM UTC, I've been receiving these errors since then.
D1 storage operation exceeded timeout which caused object to be reset. / Network connection lost. / internal error

Ssz19 It started at 12PM UTC, I've been receiving these errors since then. D1 storage ...

TomK•10/29/24, 4:38 PM

I also encountered the same issue at the same time.

TTomK I also encountered the same issue at the same time.

sz19•10/29/24, 4:49 PM

is your d1 database located somewhere in asia?

Ssz19 is your d1 database located somewhere in asia?

TomK•10/29/24, 4:57 PM

yes

TomK•10/29/24, 4:59 PM

I'm not sure if this has anything to do with the maintenance program in the Singapore region?

TomK•10/29/24, 5:02 PM

TTomK Click to see attachment

fry69•10/29/24, 5:09 PM

That is still in the future if I read this correctly (UTC)

fry69•10/29/24, 5:10 PM

(should start in <1h)

fry69•10/29/24, 5:12 PM

The hiccups could of course be due to preparations for this maintenance or other things.

Ffry69 That is still in the future if I read this correctly (UTC)

TomK•10/29/24, 5:14 PM

Yes, it was future time, which is a very far-fetched reason indeed, but other than that I can't associate it with any other reason, since the code wasn't updated.:NotLikeThis:

sz19•10/29/24, 5:38 PM

Update: errors seems to be gone now on mine

sz19•10/29/24, 5:44 PM

There was about a solid 5 mins giving me this error:
Error: D1_ERROR: Internal error while starting up D1 storage caused object to be reset.
, then after that i no longer receive d1 errors. Hopefully it stays like this

rubenf•10/29/24, 8:41 PM

Our D1 database has been unavailable for the last 10mins withL:

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.

rubenf•10/29/24, 8:42 PM

even the cloud console can't access it

rubenf•10/29/24, 8:42 PM

Are D1 databases beta/unfit for prod?

Rrubenf Our D1 database has been unavailable for the last 10mins withL: `D1_ERROR: Inter...

fry69•10/29/24, 8:45 PM

Which region/colo?

rubenf•10/29/24, 8:46 PM

@fry69 not sure actually, where do I find that info

rubenf•10/29/24, 8:46 PM

we have the database id

Rrubenf we have the database id

fry69•10/29/24, 8:56 PM

running_in_regionrunning_in_region via wrangler d1 info <dbname>wrangler d1 info <dbname>

fry69•10/29/24, 8:57 PM

rubenf•10/29/24, 8:58 PM

  Internal error: failed to get DB size and num_tables [code: 7500]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

  Internal error: failed to get DB size and num_tables [code: 7500]
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

rubenf•10/29/24, 8:58 PM

the whole db is completely unavailable

1984 Ford Laser•10/29/24, 8:59 PM

syntax error?

Rrubenf ``` Internal error: failed to get DB size and num_tables [code: 7500] If ...

fry69•10/29/24, 8:59 PM

Worked for me in region EEUREEUR (creating a new D1 db and showing the info)

rubenf•10/29/24, 8:59 PM

that's using the CLI

rubenf•10/29/24, 8:59 PM

We have numerous D1 database, this one is failing, not the others