I am diving in D1 again, previously was using a D1 alpha and now resetting things up with a D1 beta.

C

captainOP•9/25/23, 3:57 PM

(also runing 3.6 , should probably change that)

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

M

Matt Silverlock•9/25/23, 4:06 PM

Can you share what your config is? There's no changes to how

wrangler.toml

wrangler.toml

works. Is this a Workers or a Pages project?

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

M

Matt Silverlock•9/25/23, 4:06 PM

Sharing your Workers code would be great too.

C

captainOP•9/25/23, 4:10 PM

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

C

captainOP•9/25/23, 4:13 PM

and in the TOML file:
d1_databases = [
{ binding = "DBNAME_DB", database_name = "DBNAME_DB", database_id = "74244d9f-afa8-4ca2-ab7f-NEWID" }, #{ binding = "DBNAME_DB", database_name = "DBNAME_DB", database_id = "e6cf047a-8ce0-41a9-a47e-OLDID" },
]

C

captainOP•9/25/23, 4:14 PM

I am placing this just below where I set my kv_namespaces = [] stuff.

C

captainOP•9/25/23, 4:22 PM

the expectation would be it should display some error if getting here, but for some reason its like a black hole

C

captainOP•9/25/23, 4:40 PM

I lowered the position of where d1_databases = is in the toml file (just below my [vars] and now I can see the try getting catched

C

captainOP•9/25/23, 4:40 PM

but when printing out the: "e" it's empty

Ccaptain ``` console.log("we start the new DB"); try { console.log("we start...

M

Matt Silverlock•9/25/23, 4:58 PM

Can you run just a very basic query - start from scratch. Just

await db.exec("PRAGMA table_list")

await db.exec("PRAGMA table_list")

- and nothing else? Your binding appears fine. You aren't returning any results (because it's an INSERT without any RETURNING) - what do you expect to happen? It should just insert without an error.

U

Unsmart•9/25/23, 5:01 PM

Defining you d1_databases array under a

[vars]

[vars]

table will make it where your D1 bindings are not defined unless you changed your format to use a table for

d1_databases

d1_databases

also which is why you started to get an error when you moved it.

These 2 toml files are not equal:

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

[vars]
hello = "world"

d1_databases = [
  { binding = "name", ... }
]

UUnsmart Defining you d1_databases array under a `[vars]` table will make it where your D...

C

captainOP•9/25/23, 5:04 PM

thanks for that, yes I noticed that when review:
"Your worker has access to the following bindings:"
when i was deploying. That said , same results in every scenario.

MMatt Silverlock Can you run just a very basic query - start from scratch. Just `await db.exec("P...

C

captainOP•9/25/23, 5:05 PM

I will try that real quick, I expect to insert the row and then get to the next section of code, however for some reason it just stops and doesn't get past the try catch.

MMatt Silverlock Can you run just a very basic query - start from scratch. Just `await db.exec("P...

C

captainOP•9/25/23, 5:05 PM

i'm avail for vid chat if you want me to walk you through this little bit of code if helps uncover a bug

MMatt Silverlock Can you run just a very basic query - start from scratch. Just `await db.exec("P...

C

captainOP•9/25/23, 5:13 PM

i'm running:

var coolio200 = await env.MYDATABASE_DB.exec("PRAGMA table_list")
console.log("here is coolio100")
console.log("here is coolio200: " + JSON.stringify(coolio200))

var coolio200 = await env.MYDATABASE_DB.exec("PRAGMA table_list")
console.log("here is coolio100")
console.log("here is coolio200: " + JSON.stringify(coolio200))

var coolio200 = await env.MYDATABASE_DB.exec("PRAGMA table_list")
console.log("here is coolio100")
console.log("here is coolio200: " + JSON.stringify(coolio200))

var coolio200 = await env.MYDATABASE_DB.exec("PRAGMA table_list")
console.log("here is coolio100")
console.log("here is coolio200: " + JSON.stringify(coolio200))

and it doesn't print out the console log, it just stops

C

captainOP•9/25/23, 5:14 PM

when I deploy I can see in the log as it deploys:

- KV Namespaces:
....
- D1 Databases:
  - MYDATABASE_DB: mydbinmydashboard (74244d9f-afa8-4ca2-ab7f-XXXXXX)
- Vars:
.....

- KV Namespaces:
....
- D1 Databases:
  - MYDATABASE_DB: mydbinmydashboard (74244d9f-afa8-4ca2-ab7f-XXXXXX)
- Vars:
.....

- KV Namespaces:
....
- D1 Databases:
  - MYDATABASE_DB: mydbinmydashboard (74244d9f-afa8-4ca2-ab7f-XXXXXX)
- Vars:
.....

- KV Namespaces:
....
- D1 Databases:
  - MYDATABASE_DB: mydbinmydashboard (74244d9f-afa8-4ca2-ab7f-XXXXXX)
- Vars:
.....

M

Matt Silverlock•9/25/23, 5:39 PM

https://gist.github.com/elithrar/73e7340046a397ce427d45c037347d1c - this works as-is.

MMatt Silverlock https://gist.github.com/elithrar/73e7340046a397ce427d45c037347d1c - this works a...

C

captainOP•9/25/23, 5:50 PM

do you have example from .js code and not .ts

C

captainOP•9/25/23, 5:50 PM

i notice in other places of documentation it shows a toggle betweent the two

C

captainOP•9/25/23, 5:50 PM

and do u test with .js

MMatt Silverlock https://gist.github.com/elithrar/73e7340046a397ce427d45c037347d1c - this works a...

C

captainOP•9/25/23, 5:52 PM

with my js code the way I am binding things is different for the differnt env scenarios and I think its worth using that as an example as I think its more common

Ccaptain with my js code the way I am binding things is different for the differnt env sc...

M

Matt Silverlock•9/25/23, 5:55 PM

Share your full Worker. Are you sure you're naming the variables correctly? Are you using the same Worker format as I've shown?

Ccaptain with my js code the way I am binding things is different for the differnt env sc...

M

Matt Silverlock•9/25/23, 5:56 PM

export default {
    async fetch(request, env, ctx) {
        let res = await env.MYDATABASE.exec("PRAGMA table_list")
        console.log(res)
        return Response.json({res: res})
    },
};

export default {
    async fetch(request, env, ctx) {
        let res = await env.MYDATABASE.exec("PRAGMA table_list")
        console.log(res)
        return Response.json({res: res})
    },
};

export default {
    async fetch(request, env, ctx) {
        let res = await env.MYDATABASE.exec("PRAGMA table_list")
        console.log(res)
        return Response.json({res: res})
    },
};

export default {
    async fetch(request, env, ctx) {
        let res = await env.MYDATABASE.exec("PRAGMA table_list")
        console.log(res)
        return Response.json({res: res})
    },
};

(TypeScript is transpiled into JavaScript before it is deployed, so there should be no difference)

E

EvanPiro•9/25/23, 8:04 PM

How do I get access to the D1 transactions beta? I have an immediate need for it and users who are willing to deal with turbulence.

EEvanPiro How do I get access to the D1 transactions beta? I have an immediate need for it...

M

Matt Silverlock•9/25/23, 8:06 PM

There is not a transactions beta. What are you trying to do / how do you want to use transactions?

MMatt Silverlock There is not a transactions beta. What are you trying to do / how do you want to...

E

EvanPiro•9/25/23, 8:07 PM

I have a whole bunch of database updates attached to a workers call that need to run atomically.

EEvanPiro I have a whole bunch of database updates attached to a workers call that need to...

M

Matt Silverlock•9/25/23, 8:07 PM

Today the approach for that (if it fits your use-case) is

db.batch

db.batch

(or

UPSERT

UPSERT

/

ON CONFLICT

ON CONFLICT

) - there is not a way to ship a transaction to D1 outside of that.

MMatt Silverlock Today the approach for that (if it fits your use-case) is `db.batch` (or `UPSER...

E

EvanPiro•9/25/23, 8:09 PM

What about D1 procedures? or is this article too outdated?

https://blog.cloudflare.com/whats-new-with-d1/

The Cloudflare Blog

D1: our quest to simplify databases

Get an inside look on the D1 experience today, what the team is currently working on and what’s coming up!

EEvanPiro What about D1 procedures? or is this article too outdated? https://blog.cloudfl...

M

Matt Silverlock•9/25/23, 8:14 PM

Lots of core stuff to build before we get there. We're prioritizing read replication + performance + stability first.

MMatt Silverlock Lots of core stuff to build before we get there. We're prioritizing read replica...

E

EvanPiro•9/25/23, 8:14 PM

Makes sense. I'll look into

db.batch

db.batch

for now.

C

captainOP•9/26/23, 4:14 PM

question regarding setting up a database which creates the best space savings for a field when nothing is set:
a. email TEXT
b. email TEXT DEFAULT ''

C

captainOP•9/26/23, 4:17 PM

so if nothing is set in the email in part a, the field would be filled with "NULL" just wondering if behind the scenes that takes up more space than choice b

D

digeratidave•9/26/23, 4:19 PM

what is the best practice for adding a column to an existing D1? Is the Alter command from wrangler the only method currently supported or are there any other methods such a Console from the Dashboard?

C

captainOP•9/26/23, 4:45 PM

@Matt just wondering if you had any incite on the "under the hood" storage of how D1 saves things, is there more saving a field as "null" or 0 character string?

U

Unsmart•9/26/23, 4:49 PM

I dont think you should be that worried about saving a few bytes an item like that tbh just do whatever you think best for your application that makes it easy for you to manage

UUnsmart I dont think you should be that worried about saving a few bytes an item like th...

C

captainOP•9/26/23, 4:49 PM

the OCD in me does worry...so would be good to know!

K

kian•9/26/23, 4:49 PM

https://www.sqlite.org/fileformat2.html#record_format

Kkian https://www.sqlite.org/fileformat2.html#record_format

C

captainOP•9/26/23, 4:50 PM

are you sure the way Standard SQL lite does thing behind the scenes i the same as how D1 does it? I don't think its always a 1 to 1 situation...only the cloudflare wizards would know what lies beyond the veil

Ccaptain are you sure the way Standard SQL lite does thing behind the scenes i the same a...

M

Max (@rozenmd)•9/26/23, 4:52 PM

it's just sqlite https://github.com/cloudflare/workerd/pull/302/files#diff-3009a3da17d76a94673aa828ce6c364fc24e34d889b4995adfc249a0e2a3c754R66-R69

MMax (@rozenmd)it's just sqlite https://github.com/cloudflare/workerd/pull/302/files#diff-3009a...

C

captainOP•9/26/23, 5:02 PM

so that means...its basically the same size?

C

captainOP•9/26/23, 5:04 PM

https://www.sqlite.org/fileformat2.html#record_format or i mean a someting wit a content length of 0 is Null?

C

captainOP•9/26/23, 5:45 PM

Another question regarding fields, i have a field set to:

time_stamp_updated INTEGER DEFAULT CURRENT_TIMESTAMP,

If I make an entry and don't set this field, it sets it to:

2023-09-26 17:40:44

I was thinking it would set it to to the epoch time similar to Date.now() which would be an integer like: 1695750044698

When going to dashboard and then attempting to update, an update can't occur because the dashboard flags the entry at that time_stamp_updated area.

That said, it still saved "2023-09-26 17:40:44" which is not an integer...how did it do that?

C

captainOP•9/26/23, 5:53 PM

Also noticing workers sets Date.now() to something like 1695750600382 while D1 sets unixepoch('now') to 1695750600

Ccaptain Also noticing workers sets Date.now() to something like 1695750600382 while D1 s...

I

Isaac McFadyen•9/26/23, 5:53 PM

Date.now() is in ms, SQLite is in secs.

C

captainOP•9/26/23, 5:53 PM

wondering if that would make sense if they were more aligned to both either be in ms or secs?

Ccaptain wondering if that would make sense if they were more aligned to both either be i...

I

Isaac McFadyen•9/26/23, 5:53 PM

It might, but that would deviate from SQLite behavior, which I doubt they'd want to do.

I am diving in D1 again, previously was using a D1 alpha and now resetting things up with a D1 beta.

Similar Threads

Similar Threads

Similar Threads