Cloudflare Developers•2y ago

They're both using the same wrangler.toml I'd think

DDenni They're both using the same wrangler.toml I'd think

Matt Silverlock•5/31/24, 12:48 PM

Share it with us (redact anything - but IDs are safe to share) to be sure.

DenniOP•5/31/24, 12:49 PM

[[d1_databases]]
binding = "USAGE_DB"
database_name = "sticker-usage"
database_id = "50a19e5e-a287-41ea-b908-b27ed1cb4787"

[[d1_databases]]
binding = "USAGE_DB"
database_name = "sticker-usage"
database_id = "50a19e5e-a287-41ea-b908-b27ed1cb4787"

DenniOP•5/31/24, 12:49 PM

DenniOP•5/31/24, 12:49 PM

Both the same

DenniOP•5/31/24, 12:49 PM

The wrangler.toml is in the same directory as where I'm running the wrangler commands from

Matt Silverlock•5/31/24, 12:51 PM

There's no caching (concretely, absolutely, in no way is there result caching) , so I'm curious as to why this is showing different data.

Matt Silverlock•5/31/24, 12:51 PM

Are the row counts the same?

DenniOP•5/31/24, 12:51 PM

Yeah so am I, anything I can try here to make sure the right things are being queried? Some verbose output of the queries

Max (@rozenmd)•5/31/24, 12:52 PM

can you try run that query in the console tab?

MMatt Silverlock Are the row counts the same?

DenniOP•5/31/24, 12:52 PM

They are not

MMax (@rozenmd)can you try run that query in the console tab?

DenniOP•5/31/24, 12:53 PM

I'm sorry, the console tab? My browser console?

DDenni I'm sorry, the console tab? My browser console?

Matt Silverlock•5/31/24, 12:53 PM

In the D1 dashboard [from your screenshot]

Matt Silverlock•5/31/24, 12:53 PM

DDenni I'm sorry, the console tab? My browser console?

Max (@rozenmd)•5/31/24, 12:53 PM

DenniOP•5/31/24, 12:54 PM

DenniOP•5/31/24, 12:54 PM

This is the wrong count again

DenniOP•5/31/24, 12:55 PM

OH I think I get it, I'm querying using WHERE pack_id=... and the new results are numbers(?) so they are not included

DenniOP•5/31/24, 12:55 PM

If I remove the WHERE the counts do match

DenniOP•5/31/24, 12:55 PM

But cloudflare shows both data types as the sme even though they are different somehow

Max (@rozenmd)•5/31/24, 12:57 PM

ah that's the trouble with sqlite, even if you specify types, you can insert anything you want

MMax (@rozenmd)ah that's the trouble with sqlite, even if you specify types, you can insert any...

DenniOP•5/31/24, 1:01 PM

But now I'm hella confused why it is returning the rows where pack_id is a string with

pack_id=371151432834875400

pack_id=371151432834875400

but not where pack_id is a number with the same where clause

DenniOP•5/31/24, 1:01 PM

:denkpoes_animated:

DenniOP•5/31/24, 1:01 PM

I'm guessing because the number is larger than max_safe_int?

DenniOP•5/31/24, 1:05 PM

It's actually that value

Original message was deleted

DenniOP•5/31/24, 1:17 PM

Also no, you're actually right

DenniOP•5/31/24, 1:17 PM

In the export it's

371151432834875396

371151432834875396

DenniOP•5/31/24, 1:22 PM

So it should be all resolved now, thanks for the help all

SSuman!Is anybody aware of this issue? Trying to use d1-dialect causes my tests to fai...

Suman!•5/31/24, 2:09 PM

Folks , any idea here? Appreciate any help here.

Max (@rozenmd)•5/31/24, 3:00 PM

Say you need to delete a few rows of data from a D1 DB - do you use the dashboard UI, dashboard console (SQL), wrangler (SQL) or something else?

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

...•5/31/24, 3:04 PM

wrangler typing a query

SSuman!Folks , any idea here? Appreciate any help here.

Max (@rozenmd)•5/31/24, 3:17 PM

Original message was deleted

Max (@rozenmd)•5/31/24, 3:19 PM

working on that - we just shipped a query param to let you skip pages (and go back to where you were after modifying data)

MMax (@rozenmd)Say you need to delete a few rows of data from a D1 DB - do you use the dashboar...

Chaika•5/31/24, 3:28 PM

dash console

Original message was deleted

Max (@rozenmd)•5/31/24, 3:43 PM

surprisingly, i'm not seeing it incur any writes when dropping a table, only reads

Max (@rozenmd)•5/31/24, 3:43 PM

not sure if thats a bug

Original message was deleted

Max (@rozenmd)•5/31/24, 3:51 PM

but you'd still have to write a value

Max (@rozenmd)•5/31/24, 3:51 PM

may as well UPDATE lol

Original message was deleted

roftt•5/31/24, 4:41 PM

"In the future, Time Travel will allow you to fork (clone) an existing database into a new database, or overwrite an existing database." https://developers.cloudflare.com/d1/reference/time-travel

But what will the pricing look like for such an operation, and what are the limits, if any?

jepp•6/1/24, 8:17 AM

Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API reporting back 34 rows inserted (and billed)

Jjepp Hi I am seeing strange behaviour in D1. Inserting two rows of data and the API r...

Max (@rozenmd)•6/1/24, 12:27 PM

how many indexes do you have?

maj•6/2/24, 5:06 AM

Today I figured out that I had tens of millions of "rows read" per day - using a table of only 30k records. Turns out most of them were due to using "json_each()" on a JSON array. Would those "virtual rows" count against that quota, too? I'm a bit surprised, as I'm still on the free plan, with a limit of 5M rows read per day. Yet I haven't been billed anything yet.

Ashley•6/2/24, 8:10 AM

Just wanted to give a shoutout to this request: https://github.com/cloudflare/workers-sdk/issues/3581, I think at the moment the dance with different wrangler.toml files is okay but it's certainly not optimal and being able to either specify database_id or the environment would be a really nice QoL change to make CI/CD easier

GitHub

Issues · cloudflare/workers-sdk

Home to Wrangler, the CLI for Cloudflare Workers® - Issues · cloudflare/workers-sdk

Ashley•6/2/24, 8:48 AM

Another little thing I noticed: if you create an API Token using the

Edit Cloudflare Workers

Edit Cloudflare Workers

template, it doesn't include D1. This caught me out a little bit running D1 commands in CI, as it does include KV and R2, so seems a little inconsistent it doesn't include D1, but perhaps there is a reason for that

Tempo•6/2/24, 7:37 PM

Hi, I know branching is in the work but is there an other way now to have a new preview database for each preview branch ?

Mmaj Today I figured out that I had tens of millions of "rows read" per day - using a...

Matt Silverlock•6/2/24, 9:37 PM

Yes, since those virtual tables reside in memory and require read operations.

If you are on the free plan, you can’t be billed anything. If you are on the $5 paid plan, you will only be billed once you exceed 25 billion reads per month.

jepcd•6/3/24, 5:22 AM

I seem to be running into some limits with a large query

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

  [cause]: Error: parser stack overflow
      at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24)
      at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) {
    [cause]: undefined
  }

is this something that can be increased somehow?

Jjepcd I seem to be running into some limits with a large query ``` [cause]: Error: p...

kian•6/3/24, 7:55 AM

I’d recommend opening an issue on https://github.com/cloudflare/workerd/issues/new/choose with some real-world queries that run into the limit. I believe it can be raised in SQLite, but results in a slower parser so it would need good justification.

dreamingearthman•6/3/24, 3:09 PM

For those who want a fully managed D1 database with a well-built table editor & console, check out https://dzero.dev. You can sign up for early access and I'll approve it

Dzero

Dzero - The fastest globally distributed SQLite database

Dzero is a fully managed serverless SQLite database for production scale. Instantly distribute your database on EDGE nodes around the world at no extract cost. Query your database from any environment or framework. Easily manage your database with the table editor.

SupItsTom•6/3/24, 6:33 PM

when does d1 alpha actually stop processing new queries?
on the d1 dashboard it says august 1st but on alpha-migration it says july 1st

[cause]: Error: parser stack overflow at D1Database._sendOrThrow (cloudflare-internal:d1-api:67:24) at async D1PreparedStatement.raw (cloudflare-internal:d1-api:184:32) { [cause]: undefined }

They're both using the same wrangler.toml I'd think

Similar Threads

Similar Threads

Similar Threads