Cloudflare Developers•3y ago

i meant unit testing sorry

Öömer i meant unit testing sorry

Matt Silverlock•5/18/23, 2:20 PM

@mrbbot might have a good example when they're around

Murder Chicken•5/18/23, 7:56 PM

With Wrangler v3 and the deprecation of --local--local and --persist--persist, how can we request Pages use a local copy of the DB in the .wrangler directory?

Murder Chicken•5/18/23, 8:46 PM

Yup. I've gotten to the point where I'm here: https://github.com/cloudflare/workers-sdk/issues/3244

GitHub

🐛 BUG: local dev persistence location changed - upgraded projects s...

Which Cloudflare product(s) does this pertain to? Wrangler What version of Wrangler are you using? 3.0.0 What operating system are you using? Mac Describe the Bug If you upgrade to wrangler v3, the...

Murder Chicken•5/18/23, 8:47 PM

Moved the sqlite DB to the new storage directory with UUID. Now I'm just getting

D1_ERROR

D1_ERROR

message when trying to do any kind of prepareprepare statement.

Murder Chicken•5/18/23, 8:48 PM

The sqlite DB files?

Murder Chicken•5/18/23, 8:49 PM

Ahhh. What I was trying to figure out is how to get Pages to initiate a local DB file.

Murder Chicken•5/18/23, 8:50 PM

Is there a way to have local Pages dev utilize the actual remote binding and DB?

Murder Chicken•5/18/23, 8:50 PM

In the mean time...

Original message was deleted

Murder Chicken•5/18/23, 8:50 PM

Yup. It created the directory but not the sqlite file, which was odd.

Murder Chicken•5/18/23, 8:51 PM

It also created the v3 dir but not the UUID subfolder. Which makes sense because I'm not sure where that would be specified locally in config.

Mozzy•5/19/23, 11:32 AM

Is D1 having an especially hard time currently?

MMozzy Is D1 having an especially hard time currently?

Matt Silverlock•5/19/23, 12:17 PM

There's nothing service wide. Can you expand on what you're seeing/the issue you're having?

Mozzy•5/19/23, 12:18 PM

I saw an increase in D1_ERROR 500

Mozzy•5/19/23, 12:22 PM

This is also having a hard time loading

Mozzy•5/19/23, 12:22 PM

668d0e1f-b01a-4048-8796-fdf4530fb192668d0e1f-b01a-4048-8796-fdf4530fb192

Mozzy•5/19/23, 12:23 PM

General issues POSTing to the DB

{
  "message": "D1_ERROR",
  "cause": "Error: Error 9000: something went wrong"
}

{
  "message": "D1_ERROR",
  "cause": "Error: Error 9000: something went wrong"
}

Matt Silverlock•5/19/23, 1:02 PM

Big new updates to D1 incoming: https://blog.cloudflare.com/d1-turning-it-up-to-11/

The Cloudflare Blog

D1: We turned it up to 11

We've been heads down iterating on D1, and we've just shipped a major new version that's substantially faster, more reliable, and introduces Time Travel: the ability to restore a D1 database to any point in time.

Mozzy•5/19/23, 1:03 PM

Jason Hostetter•5/19/23, 1:33 PM

when we enable global read replication, you won’t have to pay extra for it, nor will replication multiply your storage consumption.

when we enable global read replication, you won’t have to pay extra for it, nor will replication multiply your storage consumption.

Jason Hostetter•5/19/23, 1:34 PM

very excited, amazing work

MMatt Silverlock Big new updates to D1 incoming: https://blog.cloudflare.com/d1-turning-it-up-to-...

João Castro•5/19/23, 1:38 PM

this is reeeeally cool

Mozzy•5/19/23, 1:43 PM

What would be the ideal way to migrate an existing DB to the Beta/experimental version?

MMozzy What would be the ideal way to migrate an existing DB to the Beta/experimental v...

Matt Silverlock•5/19/23, 1:45 PM

Backup + download locally (https://developers.cloudflare.com/d1/learning/backups/#downloading-a-backup-locally) -> convert to text format (https://developers.cloudflare.com/d1/learning/importing-data/#converting-sqlite-database-files) -> import (https://developers.cloudflare.com/d1/learning/importing-data/#import-an-existing-database).

Mozzy•5/19/23, 1:47 PM

Is this not correct?
data.sqlite3 is the file received from downloading the backup (but renamed)

MMozzy Is this not correct? data.sqlite3 is the file received from downloading the back...

Matt Silverlock•5/19/23, 1:48 PM

Don't open the shell. Just invoke it directly.

Original message was deleted

Matt Silverlock•5/19/23, 1:49 PM

https://github.com/cloudflare/cloudflare-docs/pull/9005

MMatt Silverlock Don't open the shell. Just invoke it directly.

Mozzy•5/19/23, 1:51 PM

Ahh, thanks

Matt Silverlock•5/19/23, 1:54 PM

https://twitter.com/KentonVarda/status/1659551757796515846?s=20 for those that want to understand a bit more about how our new storage backend works under the hood

Kenton Varda (@KentonVarda)

So I've spent the last ~three months writing a new distributed storage engine based on SQLite and it has been FUN!

https://t.co/NVorwS46x8

Twitter

•

5/19/23, 1:29 PM

Atinux•5/19/23, 2:01 PM

Congrats on the updates on D1, the https://nuxt-todos-edge.pages.dev/ is much faster now

Before / After the upgrade to experimental backend

Atinux•5/19/23, 2:03 PM

Note that before I could not choose the primary location (I suspected the US), now it's in Western Europe

Mozzy•5/19/23, 2:13 PM

Is it unrealistic to hope that this will complete? db.sql is about 30,000 lines

MMatt Silverlock https://twitter.com/KentonVarda/status/1659551757796515846?s=20 for those that w...

arbfay•5/19/23, 2:21 PM

Makes me think of this older blog post (written before any D1): https://ma.rkusa.st/store-sqlite-in-cloudflare-durable-objects
DO are the way to go!

Advany•5/19/23, 2:23 PM

The new D1 seems really cool!

I have list of jsons (one per host). I need to get it before each worker is run.

The average json is 260 bytes (up to 1 mb).

Currently using redis/upstash for fast global replication and reads.

Looking at the latency of d1. Seems like its only 20ms orso.

Would it make sense to move it? My total database is only 100mb orso.

Unsmart•5/19/23, 2:24 PM

When its GA sure it could

MMozzy Is it unrealistic to hope that this will complete? db.sql is about 30,000 lines

Mozzy•5/19/23, 2:42 PM

Any way to know if it's actually working or has quietly failed and is refusing to give up?

Ssourabh.sashank Hey @mozzy did you solved this ?

Mozzy•5/19/23, 2:44 PM

Yes: d1-database

Ssourabh.sashank Didn't got that actually can you please explain ?

Mozzy•5/19/23, 2:47 PM

Open cmd inside the folder that has sqlite3.exe -> run sqlite3 file.sqlite3 .dump > db.sqlsqlite3 file.sqlite3 .dump > db.sql

MyZeD•5/19/23, 3:06 PM

i like progress in d1.
would be cool if where's a compress and uncompress-function.

MMozzy Is it unrealistic to hope that this will complete? db.sql is about 30,000 lines

Mozzy•5/19/23, 3:07 PM

@elithrar Is it expected to take more than an hour to process ~31K INSERT INTO statements from the .sql file?
Unsure if it'll ever complete

i meant unit testing sorry

Similar Threads

Similar Threads

Similar Threads