Stuff like <https://www.sqlite.org/loadext.html>? No

K

kianOP•10/22/23, 4:04 AM

It would likely follow the proposal of transactions being JavaScript, in the form of a Worker - d1-database

Kkian Stuff like <https://www.sqlite.org/loadext.html>? No

S

sdan•10/22/23, 4:26 AM

understood -- we're looking to add/adapt a postgres extension for d1 for our enterprise case but seems like gcp cloudsql might be better suited for this

K

kianOP•10/22/23, 4:29 AM

D1's limits and enabled extensions (like FTS5 or mathematical functions) are set at build-time and the same for everyone, so I'd probably agree that it's best to stick with a traditional offering if you want that sort of flexibility or customisation.

Lots of the limits are based on recommendations for untrusted inputs from https://www.sqlite.org/security.html.

K

kianOP•10/22/23, 9:09 AM

[[env.staging.d1_databases]]

[[env.staging.d1_databases]]

[[env.staging.d1_databases]]

[[env.staging.d1_databases]]

K

kianOP•10/22/23, 10:09 AM

toml

Kkian `[[env.staging.d1_databases]]`

J

Jonathan•10/22/23, 3:32 PM

Is this normal to nest D1 under the env? I didn't see this in other projects

JJonathan Is this normal to nest D1 under the env? I didn't see this in other projects

I

Isaac McFadyen•10/22/23, 4:19 PM

That's because nesting it under env allows configuring different D1 databases per environment (where an environment is actually a separate worker suffixed with the environment name)

P

Ponmo•10/23/23, 12:38 AM

Hey is there a way to connect to D1 with Django now?

S

sandtrooper•10/23/23, 2:47 AM

is there a way to make

wrangler d1 migrations apply

wrangler d1 migrations apply

wrangler d1 migrations apply

wrangler d1 migrations apply not request user input ( to write y ). eg,

--yes

--yes

--yes

--yes flag is used on some other wrangler commands to auto accept but does not work for migrations command.

Ssandtrooper is there a way to make `wrangler d1 migrations apply` not request user input ( t...

C

Cyb3r-Jak3•10/23/23, 2:53 AM

It should skip user input if wrangle detects it’s a non-interactive environment or a CI environment. Try setting an environment variable of

CI-1

CI-1

CI-1

CI-1

CCyb3r-Jak3 It should skip user input if wrangle detects it’s a non-interactive environment ...

S

sandtrooper•10/23/23, 2:55 AM

thanks.

CI=1 npx wrangler d1 migrations apply

CI=1 npx wrangler d1 migrations apply

CI=1 npx wrangler d1 migrations apply

CI=1 npx wrangler d1 migrations apply works.

O

Old Man Maker•10/23/23, 4:23 AM

anyone understand this error?

"message": [
        {
          "message": "D1_TYPE_ERROR: Type 'undefined' not supported for value 'undefined'",
          "cause": "Type 'undefined' not supported for value 'undefined'"
        }
      ],

"message": [
        {
          "message": "D1_TYPE_ERROR: Type 'undefined' not supported for value 'undefined'",
          "cause": "Type 'undefined' not supported for value 'undefined'"
        }
      ],

"message": [
        {
          "message": "D1_TYPE_ERROR: Type 'undefined' not supported for value 'undefined'",
          "cause": "Type 'undefined' not supported for value 'undefined'"
        }
      ],

"message": [
        {
          "message": "D1_TYPE_ERROR: Type 'undefined' not supported for value 'undefined'",
          "cause": "Type 'undefined' not supported for value 'undefined'"
        }
      ],

This is on an update - on logging the values being batched into the row, I dont see any values that are undefined.

The area where I am not sure is a field type of Blob, and I am trying to update it with an empty array - i.e.:

\"projectRef\":[],

\"projectRef\":[],

\"projectRef\":[],

\"projectRef\":[],

Does the blob type need to be a string or does it accept a pure array?

O

Old Man Maker•10/23/23, 5:01 AM

Actually, think I answered my own question... not sure what I was thinking

the error message is a challenge though

N

Nikolas•10/23/23, 12:06 PM

Hey, quick question. When I do a simple select in a table with 100 rows using some constraints (let's say some column is > than a number) which satisfy only 5 rows, why does it say

rows_read: 100

rows_read: 100

rows_read: 100

rows_read: 100 (aka I get 100 billed rows)? Is it intended or is it a bug? Thanks

NNikolas Hey, quick question. When I do a simple select in a table with 100 rows using so...

M

Matt Silverlock•10/23/23, 12:09 PM

Your query has to read the whole table to find those rows.

NNikolas Hey, quick question. When I do a simple select in a table with 100 rows using so...

M

Matt Silverlock•10/23/23, 12:09 PM

See https://developers.cloudflare.com/d1/learning/using-indexes/ for how you can optimize.

Use indexes · Cloudflare D1 docs

Indexes enable D1 to improve query performance over the indexed columns for common (popular) queries by reducing the amount of data (number of rows) …

M

Matt Silverlock•10/23/23, 12:10 PM

(Noting that at 25 billion rows read per month included, you can make that query 250 million times. Don’t worry about optimizing small queries too quickly)

N

Nikolas•10/23/23, 12:12 PM

Thanks I'll look into it. This was an example, the table has 15k rows and it reads only 50 each time..

NNikolas Thanks I'll look into it. This was an example, the table has 15k rows and it rea...

M

Matt Silverlock•10/23/23, 12:17 PM

Note that this is the same for any row-based relational database: you have to scan the table to find the rows that match the condition.

F

forslunds•10/23/23, 2:31 PM

Hmm, might save som rows when doing one db per user then

F

forslunds•10/23/23, 2:31 PM

(Millions per user)

K

Kevin•10/23/23, 5:56 PM

How do you add and manage foreign key relationships in d1?

NNikolas Thanks I'll look into it. This was an example, the table has 15k rows and it rea...

M

Michał•10/23/23, 6:49 PM

You can add indices to reduce the number of sequential scans

MMichał You can add indices to reduce the number of sequential scans

N

Nikolas•10/23/23, 7:20 PM

Yes I did that and the reads got way down. Thanks

D

Deleted User 7f983ae1•10/23/23, 7:27 PM

I found out that

auto_increment

auto_increment

auto_increment

auto_increment in D1 doesn't work

DDeleted User 7f983ae1 I found out that `auto_increment` in D1 doesn't work

M

Matt Silverlock•10/23/23, 7:30 PM

auto_increment

auto_increment

auto_increment

auto_increment is not valid and is ignored.

DDeleted User 7f983ae1 I found out that `auto_increment` in D1 doesn't work

M

Matt Silverlock•10/23/23, 7:30 PM

https://www.sqlite.org/autoinc.html

D

Deleted User 7f983ae1•10/23/23, 7:31 PM

is it only mysql support it? ok

K

kianOP•10/23/23, 7:35 PM

No, it's just that

auto_increment

auto_increment

auto_increment

auto_increment is the wrong spelling. It should be

AUTOINCREMENT

AUTOINCREMENT

AUTOINCREMENT

AUTOINCREMENT, and is only valid on a

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY column.

Since

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY

INTEGER PRIMARY KEY will become an alias for the

rowid

rowid

rowid

rowid column by default, it usually isn't needed.

D

Deleted User 7f983ae1•10/23/23, 7:35 PM

D

Deleted User 7f983ae1•10/23/23, 7:36 PM

Really? I always learnt auto_increment when I using MySQL

D

Deleted User 7f983ae1•10/23/23, 7:36 PM

And it work

K

kianOP•10/23/23, 7:36 PM

D1 uses SQLite under the hood, so there will be syntax/grammar differences here and there. Different database engines typically have different extensions to the SQL standard, so what works in one place might not work somewhere else.

D

Deleted User 7f983ae1•10/23/23, 7:36 PM

ok

D

Deleted User 7f983ae1•10/23/23, 7:37 PM

I will check that specifically and fix it

D

Deleted User 7f983ae1•10/23/23, 7:37 PM

thank you

D

Deleted User 7f983ae1•10/23/23, 7:39 PM

(It seem like I have to reset the table to fix it since I set it as pk, so I might just not fix it lol)

KKevin How do you add and manage foreign key relationships in d1?

K

Kevin•10/23/23, 9:03 PM

Anyone have info on this by chance?

KKevin Anyone have info on this by chance?

M

Matt Silverlock•10/23/23, 9:06 PM

https://www.sqlite.org/foreignkeys.html

KKevin Anyone have info on this by chance?

J

joeljuca•10/23/23, 9:14 PM

You might be interested in the docs for the

ALTER TABLE

ALTER TABLE

ALTER TABLE

ALTER TABLE statement in SQLite.

J

joeljuca•10/23/23, 9:15 PM

The TLDR for FKs and/or table constraints in general in SQLite is: they are pretty much set on table creation. IIUC, if you need to seriously change your table constraints, you'll probably need to recreate the table (eg:

CREATE TABLE my_table2

CREATE TABLE my_table2

CREATE TABLE my_table2

CREATE TABLE my_table2, copy all

my_table

my_table

my_table

my_table. data to

my_table2

my_table2

my_table2

my_table2, and then renaming it to

my_table

my_table

my_table

my_table)

K

Kevin•10/23/23, 9:49 PM

Thank you very much!

Z

Zero•10/24/23, 1:22 AM

Are there plans for CDC for D1? stream changes to queues? this will help greatly with integrating systems together

D

Deleted User 7f983ae1•10/24/23, 8:26 AM

Is it possible to read the D1 with software like DataGrip?

D

Deleted User 7f983ae1•10/24/23, 9:39 AM

Or possible workaround if it isn't possible then reading it directly on dashboard which only show 10 row per page

C

Cyb3r-Jak3•10/24/23, 11:49 AM

You can use the REST API to query your database.

Stuff like <https://www.sqlite.org/loadext.html>? No

Similar Threads

Similar Threads

Similar Threads