https://github.com/cloudflare/workerd/pull/796#event-9597303949 -> this will go out in the next week

https://github.com/cloudflare/workerd/pull/796#event-9597303949 -> this will go out in the next week or two. We'll update the changelog + limits docs once it does.

GitHub

sql: increase SQLITE_LIMIT_COMPOUND_SELECT to 5 by elithrar · Pull ...

Fixes #795
This PR increases the SQLITE_MAX_COMPOUND_SELECT limit (https://www.sqlite.org/limits.html#max_compound_select) from the dark arts recommended 3 to a slightly more permissive 5 based on ...

MMatt Silverlock https://github.com/cloudflare/workerd/pull/796#event-9597303949 -> this will go ...

betim•6/21/23, 7:49 PM

great! will keep an eye out for it. thanks for the quick turnaround!

MMatt Silverlock https://github.com/cloudflare/workerd/pull/796#event-9597303949 -> this will go ...

Dahoom•6/21/23, 7:50 PM

While we wait for time travel could we please get a wrangler option or something to just download the db as an sqlite file?

DDahoom While we wait for time travel could we please get a wrangler option or something...

Matt SilverlockOP•6/21/23, 8:01 PM

That's not how D1 works: it's not a "single file on disk". Time Travel will land very shortly, but we don't expect to support "export a blob" for a while.

Dahoom•6/21/23, 8:04 PM

apologies for my ignorance, good luck with the implementation

vassbence•6/21/23, 8:07 PM

wait then what does

db.dump()

db.dump()

do if not dumping the db content into an sqlite file?

Vvassbence wait then what does `db.dump()` do if not dumping the db content into an sqlite ...

Matt SilverlockOP•6/21/23, 10:41 PM

That’s not available on the experimental backend, which will be the default in the near future.

Matt SilverlockOP•6/21/23, 10:43 PM

The “original” alpha was, as alphas tend to be, a prototype: SQLite in Wasm. A lot has changed since then - some of that I wrote about in our recent blog: d1-database

Original message was deleted

Matt SilverlockOP•6/21/23, 11:00 PM

Prod is

workerd@a2fbc3dfe25

workerd@a2fbc3dfe25

which maps to https://github.com/cloudflare/workerd/commits/main?before=a2fbc3dfe254ce6e94ceb183f7b1d6476b6c2b29+35&branch=main&qualified_name=refs%2Fheads%2Fmain ->

"ALTER TABLE alterme RENAME COLUMN metadata TO somethingelse"

"ALTER TABLE alterme RENAME COLUMN metadata TO somethingelse"

passes.

TL;DR: Yes.

Original message was deleted

Matt SilverlockOP•6/21/23, 11:05 PM

Let me look into that. We may have a bug. @geelen

Original message was deleted

Matt SilverlockOP•6/21/23, 11:13 PM

There’s likely an edge case with how our storage layer & authorizer interact with temp tables during a

DROP COLUMN

DROP COLUMN

op.

amorfati•6/22/23, 5:37 PM

how do I go about having my D1 id in

wrangler.toml

wrangler.toml

? The repo is public so I do I make the id public or is it supposed to stay secret? I assume the latter so currently I'm manually adding it to

wrangler.toml

wrangler.toml

every time before I deploy

amorfati•6/22/23, 5:40 PM

ah got it. Awesome, good to know

amorfati•6/22/23, 5:41 PM

Thank you!

Walshy•6/22/23, 5:43 PM

Everything in wrangler.toml is safe to have public

itsmatteomanf•6/23/23, 9:58 AM

Is there a way to get all table names from D1 via a statement in the JS API?

itsmatteomanf•6/23/23, 9:59 AM

I know of

/tables

/tables

in the console, but does that work in the JS API?

Original message was deleted

itsmatteomanf•6/23/23, 10:10 AM

SELECT * FROM sqlite_master WHERE type = 'table' AND name NOT LIKE 'd1_%' AND name != '_cf_KV'

SELECT * FROM sqlite_master WHERE type = 'table' AND name NOT LIKE 'd1_%' AND name != '_cf_KV'

itsmatteomanf•6/23/23, 10:10 AM

That

_cf_KV

_cf_KV

table isn't really usable, it doesn't let you see it

itsmatteomanf•6/23/23, 10:13 AM

That one is shown even when doing

/tables

/tables

, though

Max (@rozenmd)•6/23/23, 10:44 AM

/tables

/tables

literally just runs that query against the execute endpoint

Max (@rozenmd)•6/23/23, 10:44 AM

i should probably add the filters

Max (@rozenmd)•6/23/23, 10:44 AM

SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name;

SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name;

is what it runs

Iitsmatteomanf Is there a way to get all table names from D1 via a statement in the JS API?

Matt SilverlockOP•6/23/23, 11:11 AM

SELECT PRAGMA table_list, PRAGMA table_info(table_name)

SELECT PRAGMA table_list, PRAGMA table_info(table_name)

Matt SilverlockOP•6/23/23, 11:12 AM

Also

index_list(table), index_info(index)

index_list(table), index_info(index)

itsmatteomanf•6/23/23, 11:27 AM

Gotcha, thanks @rozenmd and @elithrar

Murder Chicken•6/23/23, 12:00 PM

With regard to

batch

batch

operations, is the Maximum SQL statement length of 100,000 (100kb) applied to the entire

batch

batch

or is that applied to the individual statements within the

batch

batch

MMurder Chicken With regard to `batch` operations, is the Maximum SQL statement length of 100,00...

Matt SilverlockOP•6/23/23, 12:26 PM

Per statement within a batch.

Matt SilverlockOP•6/23/23, 12:27 PM

DB.batch(statements)DB.batch(statements) where statements.lengthstatements.length is 400 = 400 statements.

Murder Chicken•6/23/23, 12:38 PM

Wonderful. Thank you for clarifying!

Murder Chicken•6/23/23, 3:01 PM

Are there any sqlite compatible gui clients (like tableplus) that can connect to production D1 databases?

NNimish Question: Will D1 be suitable for write heavy workload? (think - web analytics, ...

Hello, I’m Allie!•6/23/23, 3:27 PM

Maybe? But for those kinds of Workloads, I would probably recommend #analytics-engine-beta, which is purposefully built for stuff like Analytics

Bblank Datagrip works to read data using https://github.com/isaac-mcfadyen/d1-jdbc-driv...

Murder Chicken•6/23/23, 3:34 PM

Interesting. Thanks!

NNimish Question: Will D1 be suitable for write heavy workload? (think - web analytics, ...

Max (@rozenmd)•6/23/23, 3:43 PM

How many writes per second are we talking?

NNimish Question: Will D1 be suitable for write heavy workload? (think - web analytics, ...

Matt SilverlockOP•6/23/23, 4:29 PM

I second @HardAtWork - Analytics Engine is really good at these web analytics/clickevent use-cases. You can query directly out of it via GraphQL or SQL. We have folks writing thousands of events per sec.

Unsmart•6/23/23, 4:45 PM

Yeah that is per request not something shared between multiple requests

NNimish Cool! While taking a look at the Limits I found this: "...there is also a limit ...

Matt SilverlockOP•6/23/23, 4:50 PM

This means:

One client request to a Worker -> you can call writeDataPointwriteDataPoint up to 25 times (each write can include multiple metrics!) -> but you can have hundreds of thousands of client requests

SSparrow Hey everyone! I have a question regarding database creation in runtime. Is it po...

Matt SilverlockOP•6/23/23, 11:38 PM

d1-database

olup•6/24/23, 5:35 AM

I got a weird bug - when adding d1 bindings to my wrangler.tml, I am loosing my es6 default exports (like the email function) cloudflare just doesn't see them anymore
I can even have an empty export default, cf won't see the worker as doing nothing (which it does if I remove d1 bindings)
Anyone with a clue what's ahappening ? How can I get wrangler to output my bundled js so that I can check what's going on ?

MetalGear•6/24/23, 7:44 AM

So i noticed that d1 limits are that we can have max 10 databases per account. And I know thats going to change when d1 is released but my question is would it be smart to dedicate a d1 database for each saas tenant? Its not curcial or a requirment that tenants are on seperate databases.

Oolup I got a weird bug - when adding d1 bindings to my wrangler.tml, I am loosing my ...

itsmatteomanf•6/24/23, 12:06 PM

Can you share the source code of the Worker? To export the output bundle you can do wrangler deploy --dry-run --outdir ./distwrangler deploy --dry-run --outdir ./dist

https://github.com/cloudflare/workerd/pull/796#event-9597303949 -> this will go out in the next week

Similar Threads