--persist-to is only a folder, so for example by using --persist-to=/temp the actual db file will be

--persist-to is only a folder, so for example by using --persist-to=/temp the actual db file will be stored in /temp/v3/d1/x.sqlite

also you won't find the file right away, the db has to be accessed first for the file to be created

vassbenceOP•6/20/23, 8:33 PM

take a look at wrangler d1 migrationswrangler d1 migrations, you can use a migration to seed the database or if you want a more programatic approach scroll up a bit, we had a discussion about possibilites just a few hours ago

Vvassbence take a look at `wrangler d1 migrations`, you can use a migration to seed the dat...

amorfati•6/20/23, 8:35 PM

ok will try scrolling up. My attempt was to make seeding a worker endpoint that I call by hitting the endpoint but will see if I find a better approach

Vvassbence --persist-to is only a folder, so for example by using --persist-to=/temp the ac...

amorfati•6/20/23, 8:37 PM

ah gotcha. The wording in the doc made me think I can specify filename --persist-to=/path/to/file--persist-to=/path/to/file

Aamorfati ok will try scrolling up. My attempt was to make seeding a worker endpoint that ...

Matt Silverlock•6/20/23, 9:10 PM

https://developers.cloudflare.com/d1/learning/local-development/#test-programmatically (specifically that section)

Matt Silverlock•6/20/23, 9:11 PM

If you set preview_database_idpreview_database_id (per https://developers.cloudflare.com/d1/platform/migrations/#wrangler-customizations) and use wrangler d1 migrations apply <db-name> --localwrangler d1 migrations apply <db-name> --local -> you can apply migrations locally to seed the DB. As above, you can also do that programatically via your test harness

Migrations · Cloudflare D1 docs

Database migrations are a way of versioning your database. Each migration is stored as an .sql file in your migrations folder. The migrations folder …

MMatt Silverlock If you set `preview_database_id` (per https://developers.cloudflare.com/d1/platf...

amorfati•6/20/23, 9:15 PM

I don't see the db client to interact with sqlite being used in the section or any sql queries to seed being done. I assume this section expects me to run migrations through cli first, but what if I want to seed programmatically

Aamorfati I don't see the db client to interact with sqlite being used in the section or a...

amorfati•6/20/23, 9:16 PM

is it possible to tell wrangler to use a specific name.sqlitename.sqlite file?

amorfati•6/20/23, 9:16 PM

Thank you for the help by the way

Original message was deleted

amorfati•6/20/23, 9:23 PM

that can run a ts file and pass it the context with the database client? I will try that

amorfati•6/20/23, 9:23 PM

looks promising

amorfati•6/20/23, 9:35 PM

ok fair. That should work too

Aamorfati I don't see the db client to interact with sqlite being used in the section or a...

Matt Silverlock•6/20/23, 9:45 PM

You can invoke wrangler d1 migrationswrangler d1 migrations inside your tests: the example shows that.

Aamorfati I don't see the db client to interact with sqlite being used in the section or a...

Matt Silverlock•6/20/23, 9:46 PM

You can also read our discussion earlier: d1-database

MMatt Silverlock You can also read our discussion earlier: https://discord.com/channels/595317990...

amorfati•6/20/23, 10:32 PM

sweet, thank you

amorfati•6/20/23, 10:33 PM

when I created a new local db just now, it said binding is dbdb. Is there a way to change that by just changing bindingbinding in wrangler config?

Dahoom•6/20/23, 10:57 PM

use the --local option

Dahoom•6/20/23, 10:58 PM

so something like wrangler d1 execute --local --comand="SELECT NOTHING"wrangler d1 execute --local --comand="SELECT NOTHING"

DDahoom so something like ``wrangler d1 execute --local --comand="SELECT NOTHING"``

Dahoom•6/20/23, 10:58 PM

Dahoom•6/20/23, 11:04 PM

you can use wrangler

Dahoom•6/20/23, 11:04 PM

i tested it and it works in my pages directory

Dahoom•6/20/23, 11:05 PM

even when running wrangler pages dev it will read the wrangler.toml file and load the DB inside it

Dahoom•6/20/23, 11:13 PM

goodluck

amorfati•6/21/23, 1:53 AM

Error: statement too longError: statement too long

what is the statement size limit?

Aamorfati `Error: statement too long` what is the statement size limit?

Matt Silverlock•6/21/23, 1:54 AM

https://developers.cloudflare.com/d1/platform/limits/

Limits · Cloudflare D1 docs

Many of these limits will increase during D1’s public alpha. Join the #d1-open-alpha channel in the Cloudflare Developer Discord to keep up to date …

Aamorfati `Error: statement too long` what is the statement size limit?

amorfati•6/21/23, 1:54 AM

from docs "100,000 bytes (100KB)" is that accounted for experimental backend?

Aamorfati from docs "100,000 bytes (100KB)" is that accounted for experimental backend?

Matt Silverlock•6/21/23, 1:54 AM

That is the experimental backend, yes.

Pprogramjm Are there any examples of using D1 in an Astro project?

itsmatteomanf•6/21/23, 7:36 AM

I’m using it, what do you want to know?

XxPhi any ETA on when d1 will be in beta or production ready? just say 10y if it's fee...

itsmatteomanf•6/21/23, 7:37 AM

It’s pretty good already and it’s very stable, I’m sure the plan would be beta this year, but I have no specific knowledge. We need to wait for Matt.

betim•6/21/23, 9:49 AM

any way to create a DB with the regular backend alongside another with the experimental backend, locally? some of our queries don't work with the experimental backend (after importing data from our existing DBs that use the regular backend) and wanted to debug locally..

betim•6/21/23, 9:50 AM

this is using wrangler 3.1.0

Original message was deleted

betim•6/21/23, 9:57 AM

I was afraid that'd be the answer.. any guidance on figuring out why the experimental backend doesn't like our queries? any high level differences in SQLite support between regular and experimental backend that I should be aware of?

Original message was deleted

Max (@rozenmd)•6/21/23, 10:00 AM

causecause should not be deprecated, it's still there

Max (@rozenmd)•6/21/23, 10:01 AM

Original message was deleted

betim•6/21/23, 10:01 AM

yup, got that Error: too many terms in compound SELECTError: too many terms in compound SELECT (coming from a select {condition} union all select {another condition} select {condition} union all select {another condition} ).. I suppose I'm wondering what SQLite differences would account for this seeing that the query works in the regular backend but errors out in the experimental?

Bbetim yup, got that `Error: too many terms in compound SELECT` (coming from a `select ...

Max (@rozenmd)•6/21/23, 10:03 AM

The experimental backend doesn't run in a WASM container, so there are stricter security limits in place https://developers.cloudflare.com/d1/platform/limits/

MMax (@rozenmd)The experimental backend doesn't run in a WASM container, so there are stricter ...

betim•6/21/23, 10:04 AM

yup, all good on this front.. everything is within the limits on the query and data side

betim•6/21/23, 10:05 AM

is there a version difference in the underlying sqlite runtime between regular and experimental backend? wondering if the query parsing/execution happens differently in the (I'm suspecting) newer version of sqlite that the experimental backend uses..

kian•6/21/23, 10:07 AM

The experimental backend has SQLITE_LIMIT_COMPOUND_SELECTSQLITE_LIMIT_COMPOUND_SELECT set to 33

betim•6/21/23, 10:08 AM

does the backend support modifying that at either creation-time or runtime?

Max (@rozenmd)•6/21/23, 10:08 AM

that'll be why

betim•6/21/23, 10:08 AM

I think our query needs 5

Max (@rozenmd)•6/21/23, 10:09 AM

We can set it in workerd: https://github.com/cloudflare/workerd/blob/cfe19fdd962c2898dcb4a4bd0c4e1b2a60949f74/src/workerd/util/sqlite.c%2B%2B#L645, I think a github issue in workerd would help

MMax (@rozenmd)We can set it in workerd: https://github.com/cloudflare/workerd/blob/cfe19fdd962...

betim•6/21/23, 10:11 AM

k, thanks all.. this prevents us from moving to the experimental backend, which we've been really looking forward to for perf. will log a ticket to make this adjustable

Bbetim k, thanks all.. this prevents us from moving to the experimental backend, which ...

Matt Silverlock•6/21/23, 10:13 AM

Not adjustable: we’re likely to just increase it. A minimal sample query that fails now, but would work at (e.g.) 5 would be great.

--persist-to is only a folder, so for example by using --persist-to=/temp the actual db file will be

Similar Threads

Similar Threads

Similar Threads