My D1 database said too many queue operation. Any recommendation ? is D1 is not feasible for many us

T

Tesbarmix•11/23/23, 12:53 AM

Hello

Y

YokoWasisOP•11/23/23, 12:59 AM

What about kv ? does kv can handle R/W requests better than d1 ?

YYokoWasis My D1 database said too many queue operation. Any recommendation ? is D1 is not ...

M

Max (@rozenmd)•11/23/23, 8:54 AM

what's your use case?

MMax (@rozenmd)what's your use case?

Y

YokoWasisOP•11/23/23, 9:17 AM

student's national exam.

YYokoWasis student's national exam.

M

Max (@rozenmd)•11/23/23, 9:20 AM

as in, are you using D1 as a single database for an API that your frontend talks to? how many requests per second?

MMax (@rozenmd)as in, are you using D1 as a single database for an API that your frontend talks...

Y

YokoWasisOP•11/23/23, 9:54 AM

Yes, worker as a backend api. About 1k req per second.

H

Hearse•11/23/23, 11:17 AM

wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Could not read file: ./drizzle/0000_short_lockheed.sql

  ENOENT: no such file or directory, open
  '/Users/administrator/backend/project/drizzle/0000_short_lockheed.sql'
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Could not read file: ./drizzle/0000_short_lockheed.sql

  ENOENT: no such file or directory, open
  '/Users/administrator/backend/project/drizzle/0000_short_lockheed.sql'
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Could not read file: ./drizzle/0000_short_lockheed.sql

  ENOENT: no such file or directory, open
  '/Users/administrator/backend/project/drizzle/0000_short_lockheed.sql'
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Could not read file: ./drizzle/0000_short_lockheed.sql

  ENOENT: no such file or directory, open
  '/Users/administrator/backend/project/drizzle/0000_short_lockheed.sql'
  
  If you think this is a bug, please open an issue at:
  https://github.com/cloudflare/workers-sdk/issues/new/choose

H

Hearse•11/23/23, 11:18 AM

Why is it doing this when following https://github.com/drizzle-team/drizzle-orm/blob/main/examples/cloudflare-d1/README.md

GitHub

drizzle-orm/examples/cloudflare-d1/README.md at main · drizzle-team...

TypeScript ORM that feels like writing SQL. Contribute to drizzle-team/drizzle-orm development by creating an account on GitHub.

R

Rob M.•11/23/23, 11:19 AM

Is the file really there?

RRob M.Is the file really there?

H

Hearse•11/23/23, 11:20 AM

it doesnt need to be i thought .

RRob M.Is the file really there?

H

Hearse•11/23/23, 11:20 AM

https://orm.drizzle.team/docs/quick-sqlite/d1

Cloudflare D1 - Drizzle ORM

Drizzle ORM is a lightweight and performant TypeScript ORM with developer experience in mind.

H

Hearse•11/23/23, 11:21 AM

i thought the command creates it

H

Hearse•11/23/23, 11:22 AM

literally just run the command in the directory

H

Hearse•11/23/23, 11:22 AM

i have d1 setup in my wrangler config and its working fine, running this command in the same project folder doesnt work

H

Hearse•11/23/23, 11:23 AM

if i do create a dummy file, it literally say this.

mkdir drizzle
touch drizzle/0000_short_lockheed.sql
wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Error: must provide --command or --file.


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose
🪵  Logs were written to "/Users/administrator/Library/Preferences/.wrangler/logs/wrangler-2023-11-23_11-23-02_962.log"

mkdir drizzle
touch drizzle/0000_short_lockheed.sql
wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Error: must provide --command or --file.


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose
🪵  Logs were written to "/Users/administrator/Library/Preferences/.wrangler/logs/wrangler-2023-11-23_11-23-02_962.log"

mkdir drizzle
touch drizzle/0000_short_lockheed.sql
wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Error: must provide --command or --file.


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose
🪵  Logs were written to "/Users/administrator/Library/Preferences/.wrangler/logs/wrangler-2023-11-23_11-23-02_962.log"

mkdir drizzle
touch drizzle/0000_short_lockheed.sql
wrangler d1 execute 'cloudflare-db' --local --file='./drizzle/0000_short_lockheed.sql'

✘ [ERROR] Error: must provide --command or --file.


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose
🪵  Logs were written to "/Users/administrator/Library/Preferences/.wrangler/logs/wrangler-2023-11-23_11-23-02_962.log"

H

Hearse•11/23/23, 11:24 AM

wrangler 3.17.1

wrangler 3.17.1

wrangler 3.17.1

wrangler 3.17.1

btw, it should be latest.

R

Rob M.•11/23/23, 11:44 AM

maybe, there is a newline symbol after "--"?

HHearse if i do create a dummy file, it literally say this. ``` mkdir drizzle touch driz...

M

Max (@rozenmd)•11/23/23, 12:06 PM

thats weird, do you mind filing a github issue? looks like a bug

M

Max (@rozenmd)•11/23/23, 12:07 PM

ohhhh

H

Hearse•11/23/23, 12:07 PM

Will do when i wake up

M

Max (@rozenmd)•11/23/23, 12:07 PM

no thats just a bad error message

M

Max (@rozenmd)•11/23/23, 12:07 PM

it throws "Error: must provide --command or --file" if there's an empty string too

M

Max (@rozenmd)•11/23/23, 12:08 PM

I think you need to run

npm run generate

npm run generate

npm run generate

npm run generate for drizzle to create the SQL

MMax (@rozenmd)I think you need to run `npm run generate` for drizzle to create the SQL

H

Hearse•11/23/23, 12:14 PM

huh thats weird.

H

Hearse•11/23/23, 12:14 PM

because in the quickstart it doesnt address that

H

Hearse•11/23/23, 12:14 PM

https://orm.drizzle.team/docs/quick-sqlite/d1

Cloudflare D1 - Drizzle ORM

Drizzle ORM is a lightweight and performant TypeScript ORM with developer experience in mind.

MMax (@rozenmd)I think you need to run `npm run generate` for drizzle to create the SQL

H

Hearse•11/23/23, 12:15 PM

literally just says have your wrangler.toml which i already know is right

H

Hearse•11/23/23, 12:15 PM

and then run the command.

H

Hearse•11/23/23, 12:16 PM

ill do that though

M

Max (@rozenmd)•11/23/23, 12:16 PM

actually wait

M

Max (@rozenmd)•11/23/23, 12:16 PM

it seems like their docs are written for you to clone their example project

M

Max (@rozenmd)•11/23/23, 12:16 PM

because the file is here: https://github.com/drizzle-team/drizzle-orm/blob/main/examples/cloudflare-d1/drizzle/0000_short_lockheed.sql

H

Hearse•11/23/23, 12:18 PM

wtf

H

Hearse•11/23/23, 12:27 PM

oh okay, i got it, you have to generate the sql file with ur schema and then use the generated file name

F

forslunds•11/23/23, 12:59 PM

Yes, generate migrations/schema with drizzle and upload with wrangler/d1

R

Rob M.•11/24/23, 10:57 AM

Hey

If I have two simultaneous write operations that increment the same cell in D1 using one-shot sql query. Will it work right out of the box or will I need to implement something special for this?

R

Rob M.•11/24/23, 11:01 AM

SQL Example:

UPDATE table_name 
SET column_name = column_name + 1
WHERE condition;

UPDATE table_name 
SET column_name = column_name + 1
WHERE condition;

UPDATE table_name 
SET column_name = column_name + 1
WHERE condition;

UPDATE table_name 
SET column_name = column_name + 1
WHERE condition;

RRob M.Hey 👋 If I have two simultaneous write operations that increment the same cell ...

M

Max (@rozenmd)•11/24/23, 11:14 AM

it'll work, D1 uses a single writer

I

IvanN•11/24/23, 11:29 AM

Hello everyone, have a question about D1, is there a way to ALTER table and add FOREIGN KEY on existing table?

Ccras6 @Ivan Najdovski i have the same question actually

I

IvanN•11/24/23, 1:44 PM

If i find a way i will make sure to get you informed

I

IvanN•11/24/23, 1:46 PM

If there is no way to alter D1 tables and add FOREIGN KEY i have fallowup question and that is, what is the best way to create database backup and restore database

IIvanN If there is no way to alter D1 tables and add FOREIGN KEY i have fallowup questi...

R

Rob M.•11/24/23, 2:01 PM

maybe "Time Travel":
https://developers.cloudflare.com/d1/learning/time-travel/

R

Rob M.•11/24/23, 2:02 PM

or manually via
https://github.com/nora-soderlund/cloudflare-d1-backups

M

Max (@rozenmd)•11/24/23, 2:02 PM

For undoing mistakes/restoring data, use Time Travel. For downloading the db and loading locally, nora's tool: https://github.com/nora-soderlund/cloudflare-d1-backups

MMax (@rozenmd)For undoing mistakes/restoring data, use Time Travel. For downloading the db and...

I

IvanN•11/24/23, 2:04 PM

Thanks.

IIvanN Hello everyone, have a question about D1, is there a way to ALTER table and add...

M

Max (@rozenmd)•11/24/23, 2:14 PM

Seems like it works

MMax (@rozenmd)Seems like it works

I

IvanN•11/24/23, 2:15 PM

From cloudflare console or with worker statement?