Whats required in wrangler.toml for "wrangler dev" to be able to recognize tables? I run all my comm

SSantosh @Max (@rozenmd) Definitely stuck with local development. Any help? wrangler dev...

M

Max (@rozenmd)•2/15/24, 2:24 PM

I strongly recommend you go through https://developers.cloudflare.com/d1/get-started/ step by step

SSantosh Whats required in wrangler.toml for "wrangler dev" to be able to recognize table...

M

Max (@rozenmd)•2/15/24, 2:25 PM

hard to say without seeing your entire project

MMax (@rozenmd)`WRANGLER_LOG=debug wrangler d1 execute <dbname> --command=<command>`

Ɽ

ⱤØ₥₳₦•2/15/24, 2:25 PM

Thanks sir for this, I'll try this.

I must admit that D1 is incredible because I tried same database (200k rows) both on mysql (with indexes) and D1 (with indexes)

Mysql takes 250-300ms on average while D1 takes 30-50ms for same queries.

I love what you all have built; this magnificent thing is truly amazing!

SSantosh Whats required in wrangler.toml for "wrangler dev" to be able to recognize table...

M

Max (@rozenmd)•2/15/24, 2:32 PM

I would start by console logging

env

env

and

env.DB

env.DB

(or whatever binding you set it to in

wrangler.toml

wrangler.toml

)

if you can see the client API,

console.log(await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all());

console.log(await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all());

to see what tables your Worker can see

if

env

env

or

env.DB

env.DB

are undefined, you haven't configured your wrangler.toml correctly

S

SantoshOP•2/15/24, 2:38 PM

Followed the tutorial verbatim, still doesnt see local customers table: Error: D1_ERROR: SqliteError: no such table: customers. And console.log of the binding (env.DB ) prints

DB ===> D1Database {
  fetcher: Fetcher
}

DB ===> D1Database {
  fetcher: Fetcher
}

All I have changed is the database_id to match mine:

[[d1_databases]]
binding = "DB"
database_name = "prod-d1-tutorial"
database_id = "413dbdd7-5226-4d5c-a57e-0c898aa19002"

[[d1_databases]]
binding = "DB"
database_name = "prod-d1-tutorial"
database_id = "413dbdd7-5226-4d5c-a57e-0c898aa19002"

[[d1_databases]]
binding = "DB"
database_name = "prod-d1-tutorial"
database_id = "413dbdd7-5226-4d5c-a57e-0c898aa19002"

[[d1_databases]]
binding = "DB"
database_name = "prod-d1-tutorial"
database_id = "413dbdd7-5226-4d5c-a57e-0c898aa19002"

SSantosh Followed the tutorial verbatim, still doesnt see local customers table: Error: D...

M

Max (@rozenmd)•2/15/24, 2:47 PM

I just ran

npx wrangler d1 execute prod-d1-tutorial --local --file=./schema.sql

npx wrangler d1 execute prod-d1-tutorial --local --file=./schema.sql

before running

wrangler dev

wrangler dev

, and my console log output is:

{
  success: true,
  meta: {
    served_by: 'miniflare.db',
    duration: 0,
    changes: 0,
    last_row_id: 0,
    changed_db: false,
    size_after: 12288,
    rows_read: 4,
    rows_written: 0
  },
  results: [ { name: 'Customers' }, { name: '_cf_KV' } ]
}

{
  success: true,
  meta: {
    served_by: 'miniflare.db',
    duration: 0,
    changes: 0,
    last_row_id: 0,
    changed_db: false,
    size_after: 12288,
    rows_read: 4,
    rows_written: 0
  },
  results: [ { name: 'Customers' }, { name: '_cf_KV' } ]
}

{
  success: true,
  meta: {
    served_by: 'miniflare.db',
    duration: 0,
    changes: 0,
    last_row_id: 0,
    changed_db: false,
    size_after: 12288,
    rows_read: 4,
    rows_written: 0
  },
  results: [ { name: 'Customers' }, { name: '_cf_KV' } ]
}

{
  success: true,
  meta: {
    served_by: 'miniflare.db',
    duration: 0,
    changes: 0,
    last_row_id: 0,
    changed_db: false,
    size_after: 12288,
    rows_read: 4,
    rows_written: 0
  },
  results: [ { name: 'Customers' }, { name: '_cf_KV' } ]
}

S

SantoshOP•2/15/24, 2:48 PM

Thats whole thing

M

Max (@rozenmd)•2/15/24, 2:48 PM

also, what version of wrangler are you using?

S

SantoshOP•2/15/24, 2:48 PM

When I run from commands line using wrangler d1 execute --local, I can see all of them.

S

SantoshOP•2/15/24, 2:48 PM

wrangler 3.7.0 (update available 3.28.2)

S

SantoshOP•2/15/24, 2:48 PM

its only when I do wrangler dev that it doesnt see the local tables

S

SantoshOP•2/15/24, 2:49 PM

I swear it worked when I did a poc last month

M

Max (@rozenmd)•2/15/24, 2:49 PM

how are you starting wrangler?

S

SantoshOP•2/15/24, 2:49 PM

wrangler dev

S

SantoshOP•2/15/24, 2:49 PM

just from the command line

SSantosh wrangler dev

M

Max (@rozenmd)•2/15/24, 2:50 PM

what does

console.log(await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all());

console.log(await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all());

output, in your Worker?

S

SantoshOP•2/15/24, 2:50 PM

z ===>  Object {
  success: true,
  meta: Object,
  results: Array(0)
}

z ===>  Object {
  success: true,
  meta: Object,
  results: Array(0)
}

z ===>  Object {
  success: true,
  meta: Object,
  results: Array(0)
}

z ===>  Object {
  success: true,
  meta: Object,
  results: Array(0)
}

SSantosh ```z ===> Object { success: true, meta: Object, results: Array(0) }```

M

Max (@rozenmd)•2/15/24, 2:52 PM

how about:

const result = await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all();
console.log(result.meta);

const result = await env.DB.prepare("SELECT name FROM sqlite_schema WHERE type='table' ORDER BY name ;").all();
console.log(result.meta);

S

SantoshOP•2/15/24, 2:53 PM

z ===>  Object {
  duration: 0.28007400035858154,
  last_row_id: 0,
  changes: 0,
  served_by: miniflare.db,
  internal_stats: null
}

z ===>  Object {
  duration: 0.28007400035858154,
  last_row_id: 0,
  changes: 0,
  served_by: miniflare.db,
  internal_stats: null
}

z ===>  Object {
  duration: 0.28007400035858154,
  last_row_id: 0,
  changes: 0,
  served_by: miniflare.db,
  internal_stats: null
}

z ===>  Object {
  duration: 0.28007400035858154,
  last_row_id: 0,
  changes: 0,
  served_by: miniflare.db,
  internal_stats: null
}

M

Max (@rozenmd)•2/15/24, 2:55 PM

oh wtf that wrangler version is cursed

SSantosh ```z ===> Object { duration: 0.28007400035858154, last_row_id: 0, changes...

M

Max (@rozenmd)•2/15/24, 2:55 PM

can you try install wrangler 3.28.2 real quick?

S

SantoshOP•2/15/24, 2:55 PM

I did and that seems to have worked

S

SantoshOP•2/15/24, 2:56 PM

I was trying while you typed..

S

SantoshOP•2/15/24, 2:56 PM

 {
  served_by: 'miniflare.db',
  duration: 0,
  changes: 0,
  last_row_id: 0,
  changed_db: false,
  size_after: 12288,
  rows_read: 4,
  rows_written: 0
}

 {
  served_by: 'miniflare.db',
  duration: 0,
  changes: 0,
  last_row_id: 0,
  changed_db: false,
  size_after: 12288,
  rows_read: 4,
  rows_written: 0
}

 {
  served_by: 'miniflare.db',
  duration: 0,
  changes: 0,
  last_row_id: 0,
  changed_db: false,
  size_after: 12288,
  rows_read: 4,
  rows_written: 0
}

 {
  served_by: 'miniflare.db',
  duration: 0,
  changes: 0,
  last_row_id: 0,
  changed_db: false,
  size_after: 12288,
  rows_read: 4,
  rows_written: 0
}

M

Max (@rozenmd)•2/15/24, 2:56 PM

yeah i just downgraded to 3.7.0 and couldn't see any data

M

Max (@rozenmd)•2/15/24, 2:56 PM

very weird

S

SantoshOP•2/15/24, 2:56 PM

whew - it worked last month - i can bet (on 3.7)

S

SantoshOP•2/15/24, 2:58 PM

@Max (@rozenmd) I have a small team with different email Ids. I grant them access to my site. How does a small team do local development work? How can I provide them all local Dev environment so they can all refer to D1, R2 and other Cloudflare artifacts locally? I meant to say -> see each other changes while they develop on R2, D1 using wrangelr dev --remote

S

SantoshOP•2/15/24, 2:59 PM

Currently, one is not able to see others, as it distinguishes based on Ids (like r2 buckeyt id) and doesn't really allow collab... Am I missing something? Is there a construct to allow a team access to Cloudflare artifacts that I setup? Take D1 as an example, One database would be nice that they can use during dev work

M

Max (@rozenmd)•2/15/24, 3:02 PM

You'd have to invite them all to the same Cloudflare account, then in wrangler.toml you can configure a dev/staging/prod environment that looks at different d1 dbs

M

Max (@rozenmd)•2/15/24, 3:02 PM

https://developers.cloudflare.com/d1/configuration/environments/#environments

S

SantoshOP•2/15/24, 3:02 PM

Invite didnt do the trick. They logged in to mine locally and are still not be able to see the remote buckets/Kv spaces using the Ids I setup on console.

S

SantoshOP•2/15/24, 3:03 PM

Has this team setup been used / tested by anyone?

M

Max (@rozenmd)•2/15/24, 3:05 PM

We're literally using this setup to build D1

S

SantoshOP•2/15/24, 3:05 PM

Ok, I will retry this.

M

Max (@rozenmd)•2/15/24, 3:05 PM

they may need to log out of wrangler and log back in after joining a new account

S

SantoshOP•2/15/24, 3:06 PM

Thanks for the help @Max (@rozenmd) Love cloudflare products, cant wait to see D1 in production. Make it happen fast for us all

PPaulzalele Does D1 support the new SQLite JSONB and extensions yet?

M

Matt Silverlock•2/15/24, 3:35 PM

D1 has supported JSON querying since the beginning: https://developers.cloudflare.com/d1/reference/query-json/

The JSONB format doesn't change the functions available.

Cloudflare Docs

Query JSON · Cloudflare D1 docs

D1 has built-in support for querying and parsing JSON data stored within a database. This enables you to:

J

James•2/15/24, 3:44 PM

You can't use the JSONB data-type, no. You can query JSON using what Matt linked above, though, but not any of the

jsonb_*

jsonb_*

functions, as far as I know.

K

kian•2/15/24, 3:44 PM

D1's SQLite version is 3.44.0, the JSONB format & functions were added in 3.45.0 so they're not available currently.
https://www.sqlite.org/releaselog/3_45_0.html

K

kian•2/15/24, 3:48 PM

What does

wrangler d1 info <dbname>

wrangler d1 info <dbname>

output?

K

kian•2/15/24, 3:51 PM

Do

wrangler d1 insights shopmon

wrangler d1 insights shopmon

wrangler d1 insights shopmon

wrangler d1 insights shopmon

K

kian•2/15/24, 3:51 PM

It will show you your top queries and how long they take to run

Whats required in wrangler.toml for "wrangler dev" to be able to recognize tables? I run all my comm

Similar Threads

Similar Threads

Similar Threads