Hello, I would like to establish a connection between workers and mongodb, is there a tutorial on th

MMatt Silverlock Not at the moment, no: not something we yet expose.

M

Is there any work around to, locally, somehow inspect what the end query result is with the bindings applied? It's super hard to debug queries if they're working directly in the DB but failing when D1 is trying to apply a bind. Any way to replicate what's under the hood in a custom debug function?

M

Murder Chicken•6/9/23, 12:34 PM

I see what's up now that I'm looking at the facade. The statement and bindings are sent to sqlite so there is no local interpolation. Anyway way to log d1 queries at the database level?

M

Max (@rozenmd)•6/9/23, 1:11 PM

Drizzle has a way of letting you see the actual query it runs, I don't think we have that as part of D1 yet

M

Murder Chicken•6/9/23, 1:20 PM

Does Drizzle even work properly with D1? I was seeing posts around people having to jump through hoops to get it to work.

M

Max (@rozenmd)•6/9/23, 1:26 PM

It works, it just has column name collisions when joining tables with the same column names + not using aliases

M

Murder Chicken•6/9/23, 1:27 PM

Ok, thanks @rozenmd , will take a look. Feels like overkill to debug a query with an ORM, haha.

Original message was deleted

M

Murder Chicken•6/9/23, 2:31 PM

Unfortunately, it's not that simple. Dumping the statement and bindings gives you the component pieces but does not allow you to introspect how they're being married together to form a complete query.

In this instance (just solved it), an integer value was being bound to the query as a string. I had to explicitly cast that particular parameter value with

parseInt

parseInt

parseInt

parseInt to get the query to function. Figuring it out through process of elimination is time-consuming and I ended up having to remove bound parameters one by one until I identified which one was causing the issue so that I could trace back why that value was being bound improperly.

Llokiwind Hello, I would like to establish a connection between workers and mongodb, is th...

I

Isaac McFadyen•6/9/23, 3:33 PM

This isn't really #d1-open-alpha specific, so I'd recommend we move to #workers-discussions.

OOr according to the docs it looks like the maximum arguments per SQL function was b...

M

Matt Silverlock•6/9/23, 4:06 PM

Released: all functions now accept up to 32 arguments.

➜  wrangler d1 execute db-enam --command "SELECT json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7)"

🌀 Mapping SQL input into an array of statements
🌀 Parsing 1 statements
🚣 Executed 1 commands in 0.1332309991121292ms
┌──────────────────────────────────────────────────────────────────────────────────────────┐
│ json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7) │
├──────────────────────────────────────────────────────────────────────────────────────────┤
│ {"hello":1,"world":2,"foo":3,"bar":4,"baz":5,"quux":6,"floop":7}                         │
└──────────────────────────────────────────────────────────────────────────────────────────┘

➜  wrangler d1 execute db-enam --command "SELECT json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7)"

🌀 Mapping SQL input into an array of statements
🌀 Parsing 1 statements
🚣 Executed 1 commands in 0.1332309991121292ms
┌──────────────────────────────────────────────────────────────────────────────────────────┐
│ json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7) │
├──────────────────────────────────────────────────────────────────────────────────────────┤
│ {"hello":1,"world":2,"foo":3,"bar":4,"baz":5,"quux":6,"floop":7}                         │
└──────────────────────────────────────────────────────────────────────────────────────────┘

➜  wrangler d1 execute db-enam --command "SELECT json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7)"

🌀 Mapping SQL input into an array of statements
🌀 Parsing 1 statements
🚣 Executed 1 commands in 0.1332309991121292ms
┌──────────────────────────────────────────────────────────────────────────────────────────┐
│ json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7) │
├──────────────────────────────────────────────────────────────────────────────────────────┤
│ {"hello":1,"world":2,"foo":3,"bar":4,"baz":5,"quux":6,"floop":7}                         │
└──────────────────────────────────────────────────────────────────────────────────────────┘

➜  wrangler d1 execute db-enam --command "SELECT json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7)"

🌀 Mapping SQL input into an array of statements
🌀 Parsing 1 statements
🚣 Executed 1 commands in 0.1332309991121292ms
┌──────────────────────────────────────────────────────────────────────────────────────────┐
│ json_object('hello', 1, 'world', 2, 'foo', 3, 'bar', 4, 'baz', 5, 'quux', 6, 'floop', 7) │
├──────────────────────────────────────────────────────────────────────────────────────────┤
│ {"hello":1,"world":2,"foo":3,"bar":4,"baz":5,"quux":6,"floop":7}                         │
└──────────────────────────────────────────────────────────────────────────────────────────┘

Iitsmatteomanf Done, https://github.com/cloudflare/workerd/issues/729

M

Matt Silverlock•6/9/23, 4:14 PM

We just merged this internally. Had to do a bunch of work on our storage layer to make this work correctly. Goal is to get

ALTER TABLE

ALTER TABLE

ALTER TABLE

ALTER TABLE statements released within the week or so.

JJacob Wright I'm getting "not authorized to use function" with timestamp functions (e.g. SELE...

M

Matt Silverlock•6/9/23, 4:16 PM

All of

current_timestamp

current_timestamp

current_timestamp

current_timestamp,

current_time

current_time

current_time

current_time, and

current_date

current_date

current_date

current_date should now work outside of

CREATE TABLE

CREATE TABLE

CREATE TABLE

CREATE TABLE statements now:

➜  wrangler d1 execute db-enam --command "SELECT current_timestamp, current_time, current_date" --json | jq '.[].results'
[
  {
    "current_timestamp": "2023-06-09 16:16:37",
    "current_time": "16:16:37",
    "current_date": "2023-06-09"
  }
]

➜  wrangler d1 execute db-enam --command "SELECT current_timestamp, current_time, current_date" --json | jq '.[].results'
[
  {
    "current_timestamp": "2023-06-09 16:16:37",
    "current_time": "16:16:37",
    "current_date": "2023-06-09"
  }
]

➜  wrangler d1 execute db-enam --command "SELECT current_timestamp, current_time, current_date" --json | jq '.[].results'
[
  {
    "current_timestamp": "2023-06-09 16:16:37",
    "current_time": "16:16:37",
    "current_date": "2023-06-09"
  }
]

➜  wrangler d1 execute db-enam --command "SELECT current_timestamp, current_time, current_date" --json | jq '.[].results'
[
  {
    "current_timestamp": "2023-06-09 16:16:37",
    "current_time": "16:16:37",
    "current_date": "2023-06-09"
  }
]

MMatt Silverlock We just merged this internally. Had to do a bunch of work on our storage layer t...

I

itsmatteomanf•6/9/23, 4:49 PM

Thank you, appreciated

MMatt Silverlock All of `current_timestamp`, `current_time`, and `current_date` should now work o...

I

itsmatteomanf•6/9/23, 4:50 PM

Oh hey, that was a thing I had pinged you about, too ahah

I

itstmillertime•6/9/23, 6:03 PM

How does one run a D1 database migration in CI/CD?
I am running the following:

wrangler d1 migrations apply production

wrangler d1 migrations apply production

wrangler d1 migrations apply production

wrangler d1 migrations apply production

But it wants a keyboard press `` to confirm the migration. Any advice is appreciated!

Iitstmillertime How does one run a D1 database migration in CI/CD? I am running the following: `...

M

Matt Silverlock•6/9/23, 6:17 PM

We need to accept the

-y

-y

-y

-y flag (not supported yet). You should be able to

echo | wrangler d1 migrations apply <db-name>

echo | wrangler d1 migrations apply <db-name>

echo | wrangler d1 migrations apply <db-name>

echo | wrangler d1 migrations apply <db-name> to non-interactively confirm

I

itstmillertime•6/9/23, 6:42 PM

@skye_31 What's the CI environment variable? CI=true?

MMatt Silverlock We need to accept the `-y` flag (not supported yet). You should be able to `echo...

I

itstmillertime•6/9/23, 6:42 PM

Wrapping it in an echo pipe is the secret?

Iitstmillertime @skye_31 What's the CI environment variable? CI=true?

M

Max (@rozenmd)•6/9/23, 6:47 PM

it should support these: https://github.com/watson/ci-info#supported-ci-tools

M

Max (@rozenmd)•6/9/23, 6:48 PM

otherwise hardcoding CI=1 or CI=true works

K

kian•6/9/23, 7:45 PM

It just means you didn't call

all()

all()

all()

all()/

raw()

raw()

raw()

raw()/

first()

first()

first()

first()/etc

K

kian•6/9/23, 7:45 PM

Execute returned results - did you mean to call query?

I

itsmatteomanf•6/9/23, 8:36 PM

Hey @rozenmd, I think it's you that handles UI bugs from the dash, right?
If you have a table with

table

table

table

table as the name of a column, it fails to delete rows from the UI. I presume it isn't adding

'

' or

around column names.

I

itsmatteomanf•6/9/23, 8:37 PM

Not sure why it is specifying columns for row deletions, probably to select data?

M

marc•6/9/23, 11:43 PM

I've been trying out D1 recently paired with a Worker. How often are Reads and Writes updated on CF's dashboard? As it seems to be showing 0 for both even though I'm actively reading and writing from them.

Mmarc I've been trying out D1 recently paired with a Worker. How often are Reads and W...

M

Max (@rozenmd)•6/9/23, 11:56 PM

can be a few minutes - also I should add a tooltip that only experimental backend dbs have metrics

MMax (@rozenmd)can be a few minutes - also I should add a tooltip that only experimental backen...

M

marc•6/10/23, 12:01 AM

That makes sense - thank you ^^

MMatt Silverlock We just merged this internally. Had to do a bunch of work on our storage layer t...

I

itsmatteomanf•6/10/23, 10:12 PM

ALTER TABLE

ALTER TABLE

ALTER TABLE

ALTER TABLE works! party_yay

I

itsmatteomanf•6/10/23, 10:52 PM

But is

DROP COLUMN

DROP COLUMN

DROP COLUMN

DROP COLUMN supported? It's giving me a not authorized...

K

kian•6/10/23, 10:54 PM

Seems like it should be

I

itsmatteomanf•6/10/23, 11:03 PM

I tried both, and they both returned a "not authorized".

ALTER TABLE <table> DROP COLUMN <column>;
ALTER TABLE <table> DROP <column>;

ALTER TABLE <table> DROP COLUMN <column>;
ALTER TABLE <table> DROP <column>;

ALTER TABLE <table> DROP COLUMN <column>;
ALTER TABLE <table> DROP <column>;

ALTER TABLE <table> DROP COLUMN <column>;
ALTER TABLE <table> DROP <column>;

Iitsmatteomanf `ALTER TABLE` works! <a:party_yay:820426146024914955> 🎉

M

Matt Silverlock•6/11/23, 1:18 AM

It hasn’t shipped yet.

Kkian Seems like it should be

M

Matt Silverlock•6/11/23, 1:18 AM

Source != deployed.

MMatt Silverlock It hasn’t shipped yet.

I

itsmatteomanf•6/11/23, 1:39 AM

Ohhh, so some sections of

ALTER TABLE

ALTER TABLE

ALTER TABLE

ALTER TABLE did work already

I assumed it was fully blocked. Will wait

G

Garrett•6/12/23, 3:38 AM

What's the state of D1 these days? Guessing not feature/API stable and unsuitable for production use? Any ETAs on it?

GGarrett What's the state of D1 these days? Guessing not feature/API stable and unsuitabl...

M

Max (@rozenmd)•6/12/23, 8:37 AM

https://blog.cloudflare.com/d1-turning-it-up-to-11/

The Cloudflare Blog

D1: We turned it up to 11

We've been heads down iterating on D1, and we've just shipped a major new version that's substantially faster, more reliable, and introduces Time Travel: the ability to restore a D1 database to any point in time.

M

Mozzy•6/12/23, 2:30 PM

Have gotten 37 "Error: Network connection lost." errors starting today 15:30 CEST
ID:

e68dccd4-7bf7-4860-ba18-17978966ec10

e68dccd4-7bf7-4860-ba18-17978966ec10

e68dccd4-7bf7-4860-ba18-17978966ec10

e68dccd4-7bf7-4860-ba18-17978966ec10

M

Mozzy•6/12/23, 2:31 PM

U

Unsmart•6/12/23, 2:33 PM

Theres an issue with durable objects at the moment:
https://www.cloudflarestatus.com/incidents/z4lmb920dm09

Cloudflare R2 Availability Issues

U

Unsmart•6/12/23, 2:33 PM

(ignore the title only saying R2

)

M

Mozzy•6/12/23, 2:33 PM

Ahh, okay. Thanks

J

John Spurlock•6/12/23, 3:13 PM

looks like the announced graphql datasets for D1 have started to ship! https://twitter.com/johnspurlock/status/1668273301901148164

John Spurlock (@johnspurlock)

Undocumented changes in the @Cloudflare GraphQL Analytics API, Jun 12:

new d1AnalyticsAdaptiveGroups dataset to report on D1 database query times/sizes, available to all plans!

https://t.co/7uzx83Coo6

Twitter

•

6/12/23, 3:05 PM

J

John Spurlock•6/12/23, 3:14 PM

I guess "queries" here mean those all-important billable units, not queries, hopefully?

C

Chaika•6/12/23, 3:15 PM

they're already in the dash as well

C

Chaika•6/12/23, 3:15 PM

pretty sure those are just raw queries and not billable units

J

John Spurlock•6/12/23, 3:15 PM

ah hmm

C

Chaika•6/12/23, 3:16 PM

found this after: https://discord.com/channels/595317990191398933/1022981666744061972/1116806120380575834

C

Chaika•6/12/23, 3:39 PM

Hey,

Are you using the new experimental backend?
Also, D1 works on Durable Objects (which are currently having issues as well), which also means that they only run where Durable Objects are & the D1 Database you created may be far away from your location. Read Replicas and such currently are planned but do not yet exist
From the dash, you can create a D1 Database with a specific locationhint using the new experimental backend. I believe there is still no DO support at all in South America/Africa, so those locations are just always going to get higher latency. Otherwise, specifying a locationhint for your region may help, as well as using the experimental backend.
For more information on the experimental backend: https://blog.cloudflare.com/d1-turning-it-up-to-11/

Hello, I would like to establish a connection between workers and mongodb, is there a tutorial on th

Similar Threads

Similar Threads

Similar Threads