Cloudflare Developers•2y ago

can you try run that query in the console tab?

MMatt Silverlock Are the row counts the same?

Denni•5/31/24, 12:52 PM

They are not

MMax (@rozenmd)can you try run that query in the console tab?

Denni•5/31/24, 12:53 PM

I'm sorry, the console tab? My browser console?

DDenni I'm sorry, the console tab? My browser console?

Matt Silverlock•5/31/24, 12:53 PM

In the D1 dashboard [from your screenshot]

Matt Silverlock•5/31/24, 12:53 PM

DDenni I'm sorry, the console tab? My browser console?

Max (@rozenmd)OP•5/31/24, 12:53 PM

Denni•5/31/24, 12:54 PM

Denni•5/31/24, 12:54 PM

This is the wrong count again

Denni•5/31/24, 12:55 PM

OH I think I get it, I'm querying using WHERE pack_id=... and the new results are numbers(?) so they are not included

Denni•5/31/24, 12:55 PM

If I remove the WHERE the counts do match

Denni•5/31/24, 12:55 PM

But cloudflare shows both data types as the sme even though they are different somehow

Max (@rozenmd)OP•5/31/24, 12:57 PM

ah that's the trouble with sqlite, even if you specify types, you can insert anything you want

MMax (@rozenmd)ah that's the trouble with sqlite, even if you specify types, you can insert any...

Denni•5/31/24, 1:01 PM

But now I'm hella confused why it is returning the rows where pack_id is a string with pack_id=371151432834875400pack_id=371151432834875400 but not where pack_id is a number with the same where clause

Denni•5/31/24, 1:01 PM

:denkpoes_animated:

Denni•5/31/24, 1:01 PM

I'm guessing because the number is larger than max_safe_int?

Denni•5/31/24, 1:05 PM

It's actually that value

Original message was deleted

Denni•5/31/24, 1:17 PM

Also no, you're actually right

Denni•5/31/24, 1:17 PM

In the export it's 371151432834875396371151432834875396

Denni•5/31/24, 1:22 PM

So it should be all resolved now, thanks for the help all

SSuman!Is anybody aware of this issue? Trying to use d1-dialect causes my tests to fai...

Suman!•5/31/24, 2:09 PM

Folks , any idea here? Appreciate any help here.

Max (@rozenmd)OP•5/31/24, 3:00 PM

Say you need to delete a few rows of data from a D1 DB - do you use the dashboard UI, dashboard console (SQL), wrangler (SQL) or something else?

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

...•5/31/24, 3:04 PM

wrangler typing a query

SSuman!Folks , any idea here? Appreciate any help here.

Max (@rozenmd)OP•5/31/24, 3:17 PM

Original message was deleted

Max (@rozenmd)OP•5/31/24, 3:19 PM

working on that - we just shipped a query param to let you skip pages (and go back to where you were after modifying data)

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

Chaika•5/31/24, 3:28 PM

dash console

Original message was deleted

Max (@rozenmd)OP•5/31/24, 3:43 PM

surprisingly, i'm not seeing it incur any writes when dropping a table, only reads

Max (@rozenmd)OP•5/31/24, 3:43 PM

not sure if thats a bug

Original message was deleted

Max (@rozenmd)OP•5/31/24, 3:51 PM

but you'd still have to write a value

Max (@rozenmd)OP•5/31/24, 3:51 PM

may as well UPDATE lol

Original message was deleted

roftt•5/31/24, 4:41 PM

"In the future, Time Travel will allow you to fork (clone) an existing database into a new database, or overwrite an existing database." https://developers.cloudflare.com/d1/reference/time-travel

But what will the pricing look like for such an operation, and what are the limits, if any?

jepp•6/1/24, 8:17 AM

Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API reporting back 34 rows inserted (and billed)

Jjepp Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API r...

Max (@rozenmd)OP•6/1/24, 12:27 PM

how many indexes do you have?

maj•6/2/24, 5:06 AM

Today I figured out that I had tens of millions of "rows read" per day - using a table of only 30k records. Turns out most of them were due to using "json_each()" on a JSON array. Would those "virtual rows" count against that quota, too? I'm a bit surprised, as I'm still on the free plan, with a limit of 5M rows read per day. Yet I haven't been billed anything yet.

Ashley•6/2/24, 8:10 AM

Just wanted to give a shoutout to this request: https://github.com/cloudflare/workers-sdk/issues/3581, I think at the moment the dance with different wrangler.toml files is okay but it's certainly not optimal and being able to either specify database_id or the environment would be a really nice QoL change to make CI/CD easier

GitHub

Issues · cloudflare/workers-sdk

Home to Wrangler, the CLI for Cloudflare Workers® - Issues · cloudflare/workers-sdk

Ashley•6/2/24, 8:48 AM

Another little thing I noticed: if you create an API Token using the Edit Cloudflare WorkersEdit Cloudflare Workers template, it doesn't include D1. This caught me out a little bit running D1 commands in CI, as it does include KV and R2, so seems a little inconsistent it doesn't include D1, but perhaps there is a reason for that

Tempo•6/2/24, 7:37 PM

Hi, I know branching is in the work but is there an other way now to have a new preview database for each preview branch ?

Mmaj Today I figured out that I had tens of millions of "rows read" per day - using a...

Matt Silverlock•6/2/24, 9:37 PM

Yes, since those virtual tables reside in memory and require read operations.

If you are on the free plan, you can’t be billed anything. If you are on the $5 paid plan, you will only be billed once you exceed 25 billion reads per month.

jepcd•6/3/24, 5:22 AM

I seem to be running into some limits with a large query

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

is this something that can be increased somehow?

Jjepcd I seem to be running into some limits with a large query ``` [cause]: Error: p...

kian•6/3/24, 7:55 AM

I’d recommend opening an issue on https://github.com/cloudflare/workerd/issues/new/choose with some real-world queries that run into the limit. I believe it can be raised in SQLite, but results in a slower parser so it would need good justification.

dreamingearthman•6/3/24, 3:09 PM

For those who want a fully managed D1 database with a well-built table editor & console, check out https://dzero.dev. You can sign up for early access and I'll approve it

Dzero

Dzero - The fastest globally distributed SQLite database

Dzero is a fully managed serverless SQLite database for production scale. Instantly distribute your database on EDGE nodes around the world at no extract cost. Query your database from any environment or framework. Easily manage your database with the table editor.

SupItsTom•6/3/24, 6:33 PM

when does d1 alpha actually stop processing new queries?
on the d1 dashboard it says august 1st but on alpha-migration it says july 1st

Gerbuuun•6/3/24, 6:33 PM

Does PRAGMA defer_foreign_keys=ONPRAGMA defer_foreign_keys=ON not disable on updateon update and on deleteon delete actions? Kinda weird when SQLite often requires recreating tables (and thus triggering those actions)

Original message was deleted

Max (@rozenmd)OP•6/4/24, 8:20 AM

sqlite still stores the "type", even if you choose to ignore it

Max (@rozenmd)OP•6/4/24, 8:20 AM

we could probably add this

Original message was deleted

Max (@rozenmd)OP•6/4/24, 8:22 AM

in the meanwhile you could query select * from pragma_table_info('TABLE_NAME_HERE');select * from pragma_table_info('TABLE_NAME_HERE');

Original message was deleted

Max (@rozenmd)OP•6/4/24, 9:31 AM

I mean, we'd be running the additional SQL on our side if we added it

GGerbuuun Does `PRAGMA defer_foreign_keys=ON` not disable `on update` and `on delete` acti...

Gerbuuun•6/4/24, 11:54 AM

Do you guys recommend not using the on deleteon delete and on updateon update features because of this? Or should I dump my current db, create a new one, and upload the data?

Gyurmatag•6/4/24, 1:31 PM

Hi guys! Is it possible to make a copy of an existing D1 database from the Cloudflare dashboard or with just one command?

MMax (@rozenmd)I mean, we'd be running the additional SQL on our side if we added it

Isaac McFadyen•6/4/24, 1:34 PM

Possibly an optional thing then?

Isaac McFadyen•6/4/24, 1:35 PM

This would also improve d1-jdbc-driver's introspection because currently (or well, in the v2 PR) I run pragma_table_info and then cache the results to avoid querying that again, but if a table changes it's tricky to know when to invalidate.

can you try run that query in the console tab?

Similar Threads

Similar Threads

Similar Threads