It's also coincidentally the latest result from when I dumped the db yesterday and recreated it (the

It's also coincidentally the latest result from when I dumped the db yesterday and recreated it (the pack_id column was an INTEGER before, but it's usually above the max_safe_int)

DDenni It's also coincidentally the latest result from when I dumped the db yesterday a...

Max (@rozenmd)•5/31/24, 12:40 PM

are they definitely querying the same database id?

DDenni Hey all! I'm having some trouble with my D1 database. It looks like it's using a...

Matt Silverlock•5/31/24, 12:47 PM

wrangler

wrangler

and/or D1 don't cache results (at all). As Max said: can you confirm it's the same database ID here? Your screenshot shows it starting with 50a19e5e50a19e5e - is that the same DB you're looking at in the dash?

MMax (@rozenmd)are they definitely querying the same database id?

DenniOP•5/31/24, 12:48 PM

They're both using the same wrangler.toml I'd think

DDenni They're both using the same wrangler.toml I'd think

Matt Silverlock•5/31/24, 12:48 PM

Share it with us (redact anything - but IDs are safe to share) to be sure.

DenniOP•5/31/24, 12:49 PM

[[d1_databases]]
binding = "USAGE_DB"
database_name = "sticker-usage"
database_id = "50a19e5e-a287-41ea-b908-b27ed1cb4787"

[[d1_databases]]
binding = "USAGE_DB"
database_name = "sticker-usage"
database_id = "50a19e5e-a287-41ea-b908-b27ed1cb4787"

DenniOP•5/31/24, 12:49 PM

DenniOP•5/31/24, 12:49 PM

Both the same

DenniOP•5/31/24, 12:49 PM

The wrangler.toml is in the same directory as where I'm running the wrangler commands from

Matt Silverlock•5/31/24, 12:51 PM

There's no caching (concretely, absolutely, in no way is there result caching) , so I'm curious as to why this is showing different data.

Matt Silverlock•5/31/24, 12:51 PM

Are the row counts the same?

DenniOP•5/31/24, 12:51 PM

Yeah so am I, anything I can try here to make sure the right things are being queried? Some verbose output of the queries

Max (@rozenmd)•5/31/24, 12:52 PM

can you try run that query in the console tab?

MMatt Silverlock Are the row counts the same?

DenniOP•5/31/24, 12:52 PM

They are not

MMax (@rozenmd)can you try run that query in the console tab?

DenniOP•5/31/24, 12:53 PM

I'm sorry, the console tab? My browser console?

DDenni I'm sorry, the console tab? My browser console?

Matt Silverlock•5/31/24, 12:53 PM

In the D1 dashboard [from your screenshot]

Matt Silverlock•5/31/24, 12:53 PM

DDenni I'm sorry, the console tab? My browser console?

Max (@rozenmd)•5/31/24, 12:53 PM

DenniOP•5/31/24, 12:54 PM

DenniOP•5/31/24, 12:54 PM

This is the wrong count again

DenniOP•5/31/24, 12:55 PM

OH I think I get it, I'm querying using WHERE pack_id=... and the new results are numbers(?) so they are not included

DenniOP•5/31/24, 12:55 PM

If I remove the WHERE the counts do match

DenniOP•5/31/24, 12:55 PM

But cloudflare shows both data types as the sme even though they are different somehow

Max (@rozenmd)•5/31/24, 12:57 PM

ah that's the trouble with sqlite, even if you specify types, you can insert anything you want

MMax (@rozenmd)ah that's the trouble with sqlite, even if you specify types, you can insert any...

DenniOP•5/31/24, 1:01 PM

But now I'm hella confused why it is returning the rows where pack_id is a string with pack_id=371151432834875400pack_id=371151432834875400 but not where pack_id is a number with the same where clause

DenniOP•5/31/24, 1:01 PM

:denkpoes_animated:

DenniOP•5/31/24, 1:01 PM

I'm guessing because the number is larger than max_safe_int?

DenniOP•5/31/24, 1:05 PM

It's actually that value

Original message was deleted

DenniOP•5/31/24, 1:17 PM

Also no, you're actually right

DenniOP•5/31/24, 1:17 PM

In the export it's 371151432834875396371151432834875396

DenniOP•5/31/24, 1:22 PM

So it should be all resolved now, thanks for the help all

SSuman!Is anybody aware of this issue? Trying to use d1-dialect causes my tests to fai...

Suman!•5/31/24, 2:09 PM

Folks , any idea here? Appreciate any help here.

Max (@rozenmd)•5/31/24, 3:00 PM

Say you need to delete a few rows of data from a D1 DB - do you use the dashboard UI, dashboard console (SQL), wrangler (SQL) or something else?

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

...•5/31/24, 3:04 PM

wrangler typing a query

SSuman!Folks , any idea here? Appreciate any help here.

Max (@rozenmd)•5/31/24, 3:17 PM

Original message was deleted

Max (@rozenmd)•5/31/24, 3:19 PM

working on that - we just shipped a query param to let you skip pages (and go back to where you were after modifying data)

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

Chaika•5/31/24, 3:28 PM

dash console

Original message was deleted

Max (@rozenmd)•5/31/24, 3:43 PM

surprisingly, i'm not seeing it incur any writes when dropping a table, only reads

Max (@rozenmd)•5/31/24, 3:43 PM

not sure if thats a bug

Original message was deleted

Max (@rozenmd)•5/31/24, 3:51 PM

but you'd still have to write a value

Max (@rozenmd)•5/31/24, 3:51 PM

may as well UPDATE lol

Original message was deleted

roftt•5/31/24, 4:41 PM

"In the future, Time Travel will allow you to fork (clone) an existing database into a new database, or overwrite an existing database." https://developers.cloudflare.com/d1/reference/time-travel

But what will the pricing look like for such an operation, and what are the limits, if any?

jepp•6/1/24, 8:17 AM

Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API reporting back 34 rows inserted (and billed)

Jjepp Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API r...

Max (@rozenmd)•6/1/24, 12:27 PM

how many indexes do you have?

maj•6/2/24, 5:06 AM

Today I figured out that I had tens of millions of "rows read" per day - using a table of only 30k records. Turns out most of them were due to using "json_each()" on a JSON array. Would those "virtual rows" count against that quota, too? I'm a bit surprised, as I'm still on the free plan, with a limit of 5M rows read per day. Yet I haven't been billed anything yet.

Ashley•6/2/24, 8:10 AM

Just wanted to give a shoutout to this request: https://github.com/cloudflare/workers-sdk/issues/3581, I think at the moment the dance with different wrangler.toml files is okay but it's certainly not optimal and being able to either specify database_id or the environment would be a really nice QoL change to make CI/CD easier

GitHub

Issues · cloudflare/workers-sdk

Home to Wrangler, the CLI for Cloudflare Workers® - Issues · cloudflare/workers-sdk

Ashley•6/2/24, 8:48 AM

Another little thing I noticed: if you create an API Token using the Edit Cloudflare WorkersEdit Cloudflare Workers template, it doesn't include D1. This caught me out a little bit running D1 commands in CI, as it does include KV and R2, so seems a little inconsistent it doesn't include D1, but perhaps there is a reason for that

Tempo•6/2/24, 7:37 PM

Hi, I know branching is in the work but is there an other way now to have a new preview database for each preview branch ?

Mmaj Today I figured out that I had tens of millions of "rows read" per day - using a...

Matt Silverlock•6/2/24, 9:37 PM

Yes, since those virtual tables reside in memory and require read operations.

If you are on the free plan, you can’t be billed anything. If you are on the $5 paid plan, you will only be billed once you exceed 25 billion reads per month.

jepcd•6/3/24, 5:22 AM

I seem to be running into some limits with a large query

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

is this something that can be increased somehow?

Jjepcd I seem to be running into some limits with a large query ``` [cause]: Error: p...

kian•6/3/24, 7:55 AM

I’d recommend opening an issue on https://github.com/cloudflare/workerd/issues/new/choose with some real-world queries that run into the limit. I believe it can be raised in SQLite, but results in a slower parser so it would need good justification.

It's also coincidentally the latest result from when I dumped the db yesterday and recreated it (the

Similar Threads