It doesn't, I tried, it's not an available option for `wrangler pages dev`

Jjimmydirt It doesn't, I tried, it's not an available option for `wrangler pages dev`

H

pages dev

pages dev

pages dev

pages dev doesn't support remote anything atm

J

jimmydirtOP•9/17/23, 6:02 PM

I am using Svelte, this page (https://developers.cloudflare.com/d1/examples/d1-and-sveltekit/) very much makes it sound like you put in your DB name to hit the "live" one (step 4). This page (https://developers.cloudflare.com/d1/learning/local-development/#develop-locally-with-pages) is more clear about the local only part, but it doesn't really describe how to migrate from a remote db. Just trying to understand what the workflow is for developing locally against an up-to-date shared db (e.g. schema changes), just keep creating migrations?

Jjimmydirt I am using Svelte, this page (https://developers.cloudflare.com/d1/examples/d1-a...

H

Hello, I’m Allie!•9/17/23, 6:04 PM

If nothing else, I would store a DB schema local, plus maybe a script to generate seed data for it.

H

Hello, I’m Allie!•9/17/23, 6:05 PM

For a read-only DB, it should be fine to read from production, but otherwise, it probably wouldn’t be a good idea

J

jimmydirtOP•9/17/23, 6:16 PM

Yeah for sure, in my experience though there would be e.g. Prod, QA, and Dev databases, devs would normally be connected to Dev, which gets migrated from Prod at certain times. They could then see the same data. This is mentioned as a use case for "wrangler dev --persist-to=/path/to/file", which I guess works but I'm just unfamiliar with the concept of devs working against their own local databases (outside of one-off needs), it seems like a lot of extra work and room for error. Is this common, is this a design decision of D1, or just a

--remote

--remote

functionality that hasn't been added yet?

Jjimmydirt Yeah for sure, in my experience though there would be e.g. Prod, QA, and Dev dat...

H

Hello, I’m Allie!•9/17/23, 6:25 PM

I haven't seen anything about adding it, but that doesn't mean it won't happen. For non-Prod databases, if you deploy your project, you can set it to use a QA/Dev DB instead. And, I would assume that testing a project locally would be at least a little bit faster if the DB was running locally, rather than having to hit the cloud every single time.

J

jimmydirtOP•9/17/23, 7:00 PM

Yeah, and I can understand the value of having that option, but there's also a lot of value in being able to connect to remote databases (from your dev environment). I feel like there's something I'm missing, because that would seem to me a basic and necessary feature (in line with the concept of the DB as a single source of truth), and some of the docs do make it sound like it's prevented by design. Anyway, thank you, and I will work around it.

CCole Xemi I'm trying to disable foreign keys but the disabling is not working: ``` PRAGMA...

M

Matt Silverlock•9/17/23, 11:11 PM

You can’t disable them - you can

PRAGMA defer_foreign_keys = on

PRAGMA defer_foreign_keys = on

to disable temporarily, but you must ensure FK constraints are met. Draft docs: https://silverlock-d1-foreign-keys.cloudflare-docs-7ou.pages.dev/d1/learning/foreign-keys/

Foreign keys · Cloudflare D1 docs

D1 supports defining and enforcing foreign key constraints across tables in a database.

M

Matt Silverlock•9/17/23, 11:11 PM

(Just saw your last message; was out earlier)

I

itstmillertime•9/18/23, 5:07 AM

What's the max db size the team sees D1 achieving when it is out of Alpha?

RRunar This is probably the most frequently asked question here, but sadly a question w...

I

itstmillertime•9/18/23, 6:40 AM

Thank you for your input. 0.5TB is plenty for most apps. What concerns me is other serverless sqlite database providers seem to have a limit at 24gb, and then bump you to the "enterprise" tier

M

Max (@rozenmd)•9/18/23, 7:28 AM

you cannot scale Facebook on D1

If you manage to reach facebook-level success on almost any vendor, that vendor tends to work with you to find a way to scale

Original message was deleted

H

Hello, I’m Allie!•9/18/23, 7:55 AM

A single unified query maybe? If the images are small enough, it might be handy to be able to retrieve everything in one go.

D

dave•9/18/23, 3:02 PM

I'm getting this error when I attempt to run things on a remote database:

  A prepared SQL statement must contain only one statement. [code: 7500]

  A prepared SQL statement must contain only one statement. [code: 7500]

  A prepared SQL statement must contain only one statement. [code: 7500]

  A prepared SQL statement must contain only one statement. [code: 7500]

D

dave•9/18/23, 3:02 PM

but it works locally

D

dave•9/18/23, 3:02 PM

with

--local

--local

MMatt Silverlock Are you using the new backend? Executed as-is for me. ```sh ~/repos/d1 (main) ✔ ...

D

dave•9/18/23, 3:06 PM

How can I check if I'm using the new backend?

┌───────────────────┬──────────────────────────────────────┐
│                   │ removed-removed-removed-removed-     │
├───────────────────┼──────────────────────────────────────┤
│ name              │ removed-worker-d1                    │
├───────────────────┼──────────────────────────────────────┤
│ created_at        │ 2023-09-09T03:49:34.773Z             │
├───────────────────┼──────────────────────────────────────┤
│ version           │ beta                                 │
├───────────────────┼──────────────────────────────────────┤
│ num_tables        │ 6                                    │
├───────────────────┼──────────────────────────────────────┤
│ running_in_region │ ENAM                                 │
├───────────────────┼──────────────────────────────────────┤
│ database_size     │ 2.59 MB                              │
├───────────────────┼──────────────────────────────────────┤
│ read_queries_24h  │ 533                                  │
├───────────────────┼──────────────────────────────────────┤
│ write_queries_24h │ 755                                  │
└───────────────────┴──────────────────────────────────────┘

┌───────────────────┬──────────────────────────────────────┐
│                   │ removed-removed-removed-removed-     │
├───────────────────┼──────────────────────────────────────┤
│ name              │ removed-worker-d1                    │
├───────────────────┼──────────────────────────────────────┤
│ created_at        │ 2023-09-09T03:49:34.773Z             │
├───────────────────┼──────────────────────────────────────┤
│ version           │ beta                                 │
├───────────────────┼──────────────────────────────────────┤
│ num_tables        │ 6                                    │
├───────────────────┼──────────────────────────────────────┤
│ running_in_region │ ENAM                                 │
├───────────────────┼──────────────────────────────────────┤
│ database_size     │ 2.59 MB                              │
├───────────────────┼──────────────────────────────────────┤
│ read_queries_24h  │ 533                                  │
├───────────────────┼──────────────────────────────────────┤
│ write_queries_24h │ 755                                  │
└───────────────────┴──────────────────────────────────────┘

┌───────────────────┬──────────────────────────────────────┐
│                   │ removed-removed-removed-removed-     │
├───────────────────┼──────────────────────────────────────┤
│ name              │ removed-worker-d1                    │
├───────────────────┼──────────────────────────────────────┤
│ created_at        │ 2023-09-09T03:49:34.773Z             │
├───────────────────┼──────────────────────────────────────┤
│ version           │ beta                                 │
├───────────────────┼──────────────────────────────────────┤
│ num_tables        │ 6                                    │
├───────────────────┼──────────────────────────────────────┤
│ running_in_region │ ENAM                                 │
├───────────────────┼──────────────────────────────────────┤
│ database_size     │ 2.59 MB                              │
├───────────────────┼──────────────────────────────────────┤
│ read_queries_24h  │ 533                                  │
├───────────────────┼──────────────────────────────────────┤
│ write_queries_24h │ 755                                  │
└───────────────────┴──────────────────────────────────────┘

┌───────────────────┬──────────────────────────────────────┐
│                   │ removed-removed-removed-removed-     │
├───────────────────┼──────────────────────────────────────┤
│ name              │ removed-worker-d1                    │
├───────────────────┼──────────────────────────────────────┤
│ created_at        │ 2023-09-09T03:49:34.773Z             │
├───────────────────┼──────────────────────────────────────┤
│ version           │ beta                                 │
├───────────────────┼──────────────────────────────────────┤
│ num_tables        │ 6                                    │
├───────────────────┼──────────────────────────────────────┤
│ running_in_region │ ENAM                                 │
├───────────────────┼──────────────────────────────────────┤
│ database_size     │ 2.59 MB                              │
├───────────────────┼──────────────────────────────────────┤
│ read_queries_24h  │ 533                                  │
├───────────────────┼──────────────────────────────────────┤
│ write_queries_24h │ 755                                  │
└───────────────────┴──────────────────────────────────────┘

Ooxygencraft I'm trying to setup the schema on my D1 database but when I run the wrangler com...

D

dave•9/18/23, 3:06 PM

Did you find a solution for this?

Ddave How can I check if I'm using the new backend? ``` ┌───────────────────┬────────...

I

Isaac McFadyen•9/18/23, 3:23 PM

You are. New is beta and old is alpha.

Ooxygencraft I'm trying to setup the schema on my D1 database but when I run the wrangler com...

D

dave•9/18/23, 3:31 PM

I found this as a solution:

--batch-size 1

--batch-size 1

--batch-size 1

--batch-size 1

Ddave How can I check if I'm using the new backend? ``` ┌───────────────────┬────────...

M

Matt Silverlock•9/18/23, 3:56 PM

https://developers.cloudflare.com/d1/changelog/#new-default-storage-subsystem

Changelog · Cloudflare D1 docs

D1 now returns a count of rows_written and rows_read for every query executed, allowing you to assess the cost of query for both pricing and index …

MMatt Silverlock https://developers.cloudflare.com/d1/changelog/#new-default-storage-subsystem

D

dave•9/18/23, 3:57 PM

thanks, turns out my error was with the batch size

D

dave•9/18/23, 3:57 PM

turning it down to 1 fixed the issue

Ddave I'm getting this error when I attempt to run things on a remote database: ``` ...

M

Max (@rozenmd)•9/18/23, 4:47 PM

is this

wrangler d1 execute

wrangler d1 execute

?

MMax (@rozenmd)is this `wrangler d1 execute`?

D

dave•9/18/23, 4:47 PM

yes

D

dave•9/18/23, 5:40 PM

Is using a remote D1 database with

wrangler dev

wrangler dev

no longer possible?

D

dave•9/18/23, 5:40 PM

I have some old code that does.

Ddave Is using a remote D1 database with `wrangler dev` no longer possible?

C

Cyb3r-Jak3•9/18/23, 5:41 PM

I believe the

—remote

—remote

—remote

—remote flag should

D

dave•9/18/23, 5:42 PM

hmmmm maybe I should just migrate

Ddave Is using a remote D1 database with `wrangler dev` no longer possible?

M

Max (@rozenmd)•9/18/23, 5:48 PM

the default was just changed for wrangler v3: https://github.com/cloudflare/workers-sdk/releases/tag/wrangler%403.0.0

M

Max (@rozenmd)•9/18/23, 5:48 PM

wrangler dev now runs fully-locally by default, using the open-source Cloudflare Workers runtime workerd.

To restore the previous behaviour of running on a remote machine with access to production data, use the new --remote flag.

The --local and --experimental-local flags have been deprecated, as this behaviour is now the default, and will be removed in the next major version.