can this be used independently of running my next app through wrangler? as in it can just let me con

Ssnacks can this be used independently of running my next app through wrangler? as in it...

M

you can have a separate Worker running as an API, and have your Pages app talking to it, as we've done in this demo: https://github.com/cloudflare/d1-northwind

PPhilH Forgive me if this is a stupid error, but does anyone have any idea why on earth...

M

Max (@rozenmd)•4/9/24, 9:47 AM

should be

INSERT INTO ? (slug, type, data, clicks) VALUES (?, "ArtistLanding", ?, 0)

INSERT INTO ? (slug, type, data, clicks) VALUES (?, "ArtistLanding", ?, 0)

INSERT INTO ? (slug, type, data, clicks) VALUES (?, "ArtistLanding", ?, 0)

INSERT INTO ? (slug, type, data, clicks) VALUES (?, "ArtistLanding", ?, 0)

sqlite automatically escapes the input correctly

dit: oops, just noticed the table param too, yeah that won't work

MMax (@rozenmd)you can have a separate Worker running as an API, and have your Pages app talkin...

S

snacksOP•4/9/24, 9:50 AM

thanks I'll have a look into it

Original message was deleted

B

bun•4/9/24, 11:20 AM

You can just use drizzle and log those using their logger

K

Kimitri•4/10/24, 2:45 AM

I'm new on D1 so I have some questions, the only way to use D1 is with workers? I'm ask it because when I tried to create a D1 db, the only way I got was if I create a worker.
I wanna use D1 with my currently api but I guess I don't understand very well what's D1 is exaclty and how it work

Original message was deleted

K

Kimitri•4/10/24, 4:12 AM

So basically if I want to migrate my data base to D1 I should rewrite the entire api endpoints to workers right?

Original message was deleted

K

Kimitri•4/10/24, 4:16 AM

Thank you for clarify how it's work. I'll test it to see the performance differences

S

Super Morris•4/10/24, 8:04 AM

simple question:
d1 processing performance per d1 instance or per cloudflare account?
we thing about horizontally scaling d1 databases vs. vertically scaling

S

Super Morris•4/10/24, 8:07 AM

thanks a lot! any idea about its vertically scaling capacity? on planet scale I can manage the "hardware" but where are the performance limits on a single d1/do?

S

Super Morris•4/10/24, 8:13 AM

or maybe I ask the other way around: we are building an app builder. so far on planetscale we had one (or a few) db for all apps. now as d1 is no longer in beta, we are looking into moving it to d1. and the main question is one db per app or the same like we did on planet scale....

S

Super Morris•4/10/24, 8:17 AM

thanks a lot @Leo !

S

Super Morris•4/10/24, 1:41 PM

worker binding seams to be limited by 1MB metadata (~5000 d1 bindings). when we want to horizontally scale with d1 (1x db = 1x app), we would be limited to ~5000 apps (dbs)... is there an other "dynamic" way to bind/access d1 without losing much performance? (i know about the api beta, however that will not be performant enough for us)

SSuper Morris worker binding seams to be limited by 1MB metadata (~5000 d1 bindings). when we ...

M

Max (@rozenmd)•4/10/24, 1:43 PM

dynamic bindings are coming soon, what api beta?

S

Super Morris•4/10/24, 1:45 PM

@Max (@rozenmd) thanks for the info!
ahh sorry not beta... this api https://developers.cloudflare.com/api/operations/cloudflare-d1-create-database

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

M

Max (@rozenmd)•4/10/24, 1:46 PM

ah yeah. yeah the API was designed more as a configuration/management API, though we've started work to make it more performant

M

Max (@rozenmd)•4/10/24, 1:46 PM

as well as speccing out dynamic bindings so the limit goes away

M

Max (@rozenmd)•4/10/24, 4:03 PM

On the off-chance you're still using an alpha D1 database, we've made a guide to make it easier to move across to the newer, faster (40x more requests per second) D1 DBs:

https://developers.cloudflare.com/d1/platform/alpha-migration

Cloudflare Docs

Alpha database migration guide · Cloudflare D1 docs

D1 alpha databases will stop accepting live SQL queries on July 1, 2024.

T

Titan•4/10/24, 5:00 PM

how do I connect to my d1 db using a desktop db client? I'd like to see the rows in my production db and make edits if required. I see there is a web UI but it has no ability to filter

TTitan how do I connect to my d1 db using a desktop db client? I'd like to see the rows...

J

johtso•4/10/24, 5:14 PM

also interested in knowing if this is possible. I ended up using this, which requires deploying to CF Pages https://github.com/JacobLinCool/d1-manager

T

Titan•4/10/24, 5:19 PM

Thanks, not sure my security team would sign off on a db client being accessible on the web though!

0

0xAndrew•4/10/24, 6:09 PM

I'm unable to get D1 working due to invalid

id

id

in

wrangler.toml

wrangler.toml

.

wrangler.toml

wrangler.toml

name = "something"
main = "src/index.ts"
compatibility_date = "2022-11-07"
node_compat = true

[[ d1_databases ]]
binding = "DB"
database_name = "something"
database_id = "abscsdf23"

name = "something"
main = "src/index.ts"
compatibility_date = "2022-11-07"
node_compat = true

[[ d1_databases ]]
binding = "DB"
database_name = "something"
database_id = "abscsdf23"

name = "something"
main = "src/index.ts"
compatibility_date = "2022-11-07"
node_compat = true

[[ d1_databases ]]
binding = "DB"
database_name = "something"
database_id = "abscsdf23"

name = "something"
main = "src/index.ts"
compatibility_date = "2022-11-07"
node_compat = true

[[ d1_databases ]]
binding = "DB"
database_name = "something"
database_id = "abscsdf23"

But I keep getting an error

notes: [
      {
        text: 'binding __D1_BETA__DB of type d1 must have a valid `id` specified [code: 10021]'
      }
    ],

notes: [
      {
        text: 'binding __D1_BETA__DB of type d1 must have a valid `id` specified [code: 10021]'
      }
    ],

notes: [
      {
        text: 'binding __D1_BETA__DB of type d1 must have a valid `id` specified [code: 10021]'
      }
    ],

notes: [
      {
        text: 'binding __D1_BETA__DB of type d1 must have a valid `id` specified [code: 10021]'
      }
    ],

Anyone know what it should look like? There's guidance in the docs on what the

database_name

database_name

should be but not the

database_id

database_id

. Would be great to update the docs so that there was a better explanation there (https://developers.cloudflare.com/d1/get-started/#4-bind-your-worker-to-your-d1-database)

Cloudflare Docs

Get started · Cloudflare D1 docs

This guide will instruct you through:

00xAndrew I'm unable to get D1 working due to invalid `id` in `wrangler.toml`. `wrangler....

V

Vy•4/10/24, 6:14 PM

database_id

database_id

is auto-generated when you created the database. You can find it on the dash UI too

VVy `database_id` is auto-generated when you created the database. You can find it o...

0

0xAndrew•4/10/24, 6:18 PM

It hasn't been deployed. I've just run

wrangler d1 execute db --local --file=./drizzle/0000_short_lockheed.sql

wrangler d1 execute db --local --file=./drizzle/0000_short_lockheed.sql

wrangler d1 execute db --local --file=./drizzle/0000_short_lockheed.sql

wrangler d1 execute db --local --file=./drizzle/0000_short_lockheed.sql

and then

wrangler dev

wrangler dev

And then i receive this error

00xAndrew It hasn't been deployed. I've just run `wrangler d1 execute db --local --file=...

M

Max (@rozenmd)•4/10/24, 6:45 PM

whats your wrangler version

M

MyZeD•4/10/24, 6:56 PM

I created the table "articles" and everytime i want to insert something, it displays: "no such table: main.price"
WTF?

Sstevefrench is there an easy way to reset (erase everything) a database (all tables) without...

M

MyZeD•4/10/24, 7:02 PM

try https://stackoverflow.com/questions/525512/drop-all-tables-command

Stack Overflow

Drop all tables command

What is the command to drop all tables in SQLite?

Similarly I'd like to drop all indexes.

MMax (@rozenmd)whats your wrangler version

0

0xAndrew•4/10/24, 7:07 PM

2.21.1. Solved by upgrading to latest 3.x.x

MMyZeD I created the table "articles" and everytime i want to insert something, it disp...

M

Max (@rozenmd)•4/10/24, 7:10 PM

does escaping the double quotes help?

MMax (@rozenmd)does escaping the double quotes help?

M

MyZeD•4/10/24, 7:11 PM

No, it's the same

MMyZeD try https://stackoverflow.com/questions/525512/drop-all-tables-command

M

Max (@rozenmd)•4/10/24, 7:12 PM

you'd get billed for writes doing this btw

MMyZeD I created the table "articles" and everytime i want to insert something, it disp...

M

Max (@rozenmd)•4/10/24, 7:14 PM

not sure if it'll help, but sqlite doesn't have varchar nor decimal, its TEXT, and REAL

MMax (@rozenmd)not sure if it'll help, but sqlite doesn't have varchar nor decimal, its TEXT, a...

M

MyZeD•4/10/24, 7:16 PM

Changed all VARCHAR, JSON and DATETIME to TEXT and the DECIMALs to REAL. No change, same: "no such table: main.price"

MMax (@rozenmd)not sure if it'll help, but sqlite doesn't have varchar nor decimal, its TEXT, a...

M

MyZeD•4/10/24, 7:17 PM

Maybe your last developer forget to remove his static test-database

M

Max (@rozenmd)•4/10/24, 7:18 PM

D1 is completely isolated - it's an issue with either the schema, the query, or the API parsing the query

M

Max (@rozenmd)•4/10/24, 7:19 PM

what does your table list look like?

M

MyZeD•4/10/24, 7:21 PM

got it....

MMax (@rozenmd)what does your table list look like?

M

MyZeD•4/10/24, 7:21 PM

was the foreign key: "FOREIGN KEY (price) REFERENCES price (price)" sorry

M

MyZeD•4/10/24, 7:22 PM

I'm sorry for that

M

Max (@rozenmd)•4/10/24, 7:23 PM

all good

U

unk•4/11/24, 5:11 AM

Hi.
Why do I get this error?

Error: D1_ERROR: too many SQL variables at offset 484

Error: D1_ERROR: too many SQL variables at offset 484

Error: D1_ERROR: too many SQL variables at offset 484

Error: D1_ERROR: too many SQL variables at offset 484

I use drizzle.

const data = await db.query.projects.findMany({
    limit: PAGE_LIMIT,
    where: inArray(
    girls.id,
    girlsIds.map(({ id }) => id),
    ),
    offset: calcOffset(Number(qs.page), PAGE_LIMIT),
})

const data = await db.query.projects.findMany({
    limit: PAGE_LIMIT,
    where: inArray(
    girls.id,
    girlsIds.map(({ id }) => id),
    ),
    offset: calcOffset(Number(qs.page), PAGE_LIMIT),
})

const data = await db.query.projects.findMany({
    limit: PAGE_LIMIT,
    where: inArray(
    girls.id,
    girlsIds.map(({ id }) => id),
    ),
    offset: calcOffset(Number(qs.page), PAGE_LIMIT),
})

const data = await db.query.projects.findMany({
    limit: PAGE_LIMIT,
    where: inArray(
    girls.id,
    girlsIds.map(({ id }) => id),
    ),
    offset: calcOffset(Number(qs.page), PAGE_LIMIT),
})

M

Max (@rozenmd)•4/11/24, 9:06 AM

(I am probably going to be posting this every few days until we shut down the old alpha DBs)

On the off-chance you're still using an alpha D1 database, we've made a guide to make it easier to move across to the newer, faster (40x more requests per second) D1 DBs:

https://developers.cloudflare.com/d1/platform/alpha-migration

Original message was deleted

J

johtso•4/11/24, 9:25 AM

No, you're all good if you use batch, not 100% what the limits are for a single batch operation, but I think they're really high.. and not based on params

G

Gyurmatag•4/11/24, 9:44 AM

Hi guys! If I want to move from D1 to another Cloud provider, then what are my options? Thank you very much for the answers!

GGyurmatag Hi guys! If I want to move from D1 to another Cloud provider, then what are my o...

B

Beny•4/11/24, 9:49 AM

Export your data [1]:

wrangler d1 export <DATABASE_NAME> --output db.sql --remote

wrangler d1 export <DATABASE_NAME> --output db.sql --remote

wrangler d1 export <DATABASE_NAME> --output db.sql --remote

wrangler d1 export <DATABASE_NAME> --output db.sql --remote

Then upload it to another cloud & either use their API or Hyperdrive to connect your worker to the db [2]
[1] https://developers.cloudflare.com/workers/wrangler/commands/#export
[2] https://developers.cloudflare.com/hyperdrive/

CCole Xemi Maximum bound parameters per query is 100. https://developers.cloudflare.com/d1/...

U

unk•4/11/24, 9:57 AM

Suppose you wrote a query like this using offset

const data = await db.query.projects.findMany({
  where: inArray(
    projects.key,
    [... //over 100 items]
  ),
  offset: 50,
})

const data = await db.query.projects.findMany({
  where: inArray(
    projects.key,
    [... //over 100 items]
  ),
  offset: 50,
})

const data = await db.query.projects.findMany({
  where: inArray(
    projects.key,
    [... //over 100 items]
  ),
  offset: 50,
})

const data = await db.query.projects.findMany({
  where: inArray(
    projects.key,
    [... //over 100 items]
  ),
  offset: 50,
})

but But this exceeds the limit.
Is it not feasible to combine the search and OFFSET for more than 100 arrays?

G

Gunnar•4/11/24, 10:28 AM

Hi, sorry if this has been asked before, but how are you guys gonna work with this limit, if your service explodes in popularity?
Maximum database size 10 GB (Workers Paid)
https://developers.cloudflare.com/d1/platform/limits/

Cloudflare Docs

Limits · Cloudflare D1 docs

If you would like to explore other storage solutions for your application, Cloudflare also offers Workers KV, Durable Objects, and R2.

GGunnar Hi, sorry if this has been asked before, but how are you guys gonna work with th...

B

bun•4/11/24, 10:38 AM

10gb is plenty enough for a lot of users

can this be used independently of running my next app through wrangler? as in it can just let me con

Similar Threads

Similar Threads

Similar Threads