Is there a way to listen to table changes and trigger webhooks?

Ggbaranski how can I use Cloudflare D1 during SvelteKit development?

S

Steved•3/3/24, 3:20 PM

I use the miniflare/wrangler emulation for local development with Sveltekit, and that allows me to use

npm run dev

npm run dev

and get the lightning fast reloads you're after. Take a look at: https://github.com/sdarnell/cf-svelte for a working example.

GitHub

GitHub - sdarnell/cf-svelte: A basic starter project for working lo...

A basic starter project for working locally in sveltekit on Cloudflare - sdarnell/cf-svelte

GGagan Suie Is there a way to listen to table changes and trigger webhooks?

T

Tony Leung•3/3/24, 6:22 PM

i don't think there is and old-school sql database has that feature. Only in my experience, only dynamodb can capture that event and put them in dynamo stream

U

Unsmart•3/3/24, 6:30 PM

AWS Aurora has the feature and is an SQL database so it’s not exclusively NoSQL

T

Tony Leung•3/3/24, 6:32 PM

I think AWS Aurora is a NewSQL, mysql, mariadb and postgres does not have that feature tho

T

Tony Leung•3/3/24, 6:34 PM

actually SQL Server can achieve that by using

xp_cmdshell

xp_cmdshell

but it's not recommended to be turned on (according to OWASP)

U

Unsmart•3/3/24, 6:53 PM

aws aurora is mysql and postgres

UUnsmart aws aurora is mysql and postgres

T

Tony Leung•3/3/24, 7:19 PM

my bad, MySQL procedure can send webhook request by using

curl

curl

Original message was deleted

U

Unsmart•3/3/24, 7:21 PM

It will have read replicas soon but not sure if it will be multi-region

C

chientrm.com•3/4/24, 2:33 AM

I'm looking for a way to bulk import data into D1

C

chientrm.com•3/4/24, 2:36 AM

is to avoid the written count to D1

Cchientrm.com is to avoid the written count to D1 😗

I

Isaac McFadyen•3/4/24, 3:09 AM

Any way to write data to D1 will incur charges for writing.

I

Isaac McFadyen•3/4/24, 3:09 AM

There's no way to import data without incurring rows written, unfortunately

Nnoman hello, could someone please tell me how to create an FTS5 table in D1? I've trie...

C

Chaika•3/4/24, 4:13 AM

lowercase fts

CREATE VIRTUAL TABLE words_fts USING fts5 (episode, title, description, words);

CREATE VIRTUAL TABLE words_fts USING fts5 (episode, title, description, words);

S

Sandro•3/4/24, 6:24 AM

Hey

I'm a bit confused about the storage limit in D1.

The limits say: Maximum database size: 2GB Paid / 500 MB Free <- Is this a hard limit?

The pricing page says: Storage: You are only billed for storage above the included limits of your plan.

From the pricing page it sounds like its not a limit just the free tier.
But from the limit page it sounds like it.

IIsaac McFadyen Any way to write data to D1 will incur charges for writing.

C

chientrm.com•3/4/24, 6:44 AM

imma just use

Miniflare.getBindings()

Miniflare.getBindings()

for my production on a NodeJS server

SSandro Hey 👋🏽 I'm a bit confused about the storage limit in D1. The limits say: *M...

D

daniel-supalang•3/4/24, 6:48 AM

Yes, that's a hard limit for now. They have a plan to increase the limit to 10GB this year, but I don't think they will increase the limit by much due to performance issues. If you want more storage, they recommend sharding the database MANUALLY right now.

SSteved I use the miniflare/wrangler emulation for local development with Sveltekit, and...

G

gbaranski•3/4/24, 9:41 AM

looks great, thanks :)

Original message was deleted

G

gbaranski•3/4/24, 9:42 AM

i can't seem to use that create-cloudflare

G

gbaranski•3/4/24, 9:42 AM

i mean it generates something weird

G

gbaranski•3/4/24, 9:42 AM

which exact template are u using to get the code you sent?

G

gbaranski•3/4/24, 10:09 AM

okay nevermind, i got everything solved

G

gbaranski•3/4/24, 10:09 AM

that works really great

G

gbaranski•3/4/24, 10:09 AM

it should be in the docs

G

gbaranski•3/4/24, 10:09 AM

and btw, have u managed to get drizzle studio to work with such local D1?

X

Xazu•3/4/24, 10:51 AM

Hi! How to move out whole remote D1 to local D1?

XXazu Hi! How to move out whole remote D1 to local D1?

M

Max (@rozenmd)•3/4/24, 11:22 AM

until we finish building it natively, https://github.com/nora-soderlund/cloudflare-d1-backups is likely the best option

GitHub

GitHub - nora-soderlund/cloudflare-d1-backups: A package to dump a ...

A package to dump a copy of your experimental D1 database through a worker. - nora-soderlund/cloudflare-d1-backups

X

Xazu•3/4/24, 11:23 AM

Thank you!

D

DC•3/4/24, 3:41 PM

Hello eveyone. Does anyone know when D1 will be GA so that it can be used in production?

DDC Hello eveyone. Does anyone know when D1 will be GA so that it can be used in pr...

E

Epailes•3/4/24, 4:42 PM

Planned for April

d1-database

d1-database

I

Ian•3/4/24, 10:47 PM

Do we have news of when dynamic bindings are available

U

Unsmart•3/4/24, 10:48 PM

Planned/hope to be by GA could be later

I

Ian•3/4/24, 11:48 PM

thanks, ill be waiting :Copium:

J

Junseong Park•3/5/24, 2:21 AM

Is the value of

database_id

database_id

in the

wrangler.toml

wrangler.toml

file acceptable information to be made public?
If not, is there a way to hide this value from the Github repository? It looks like I can't use environment variables in this file.

J

James•3/5/24, 2:28 AM

Yes it’s fine. Anything you add in your wrangler.toml can be public

JJames Yes it’s fine. Anything you add in your wrangler.toml can be public

J

Junseong Park•3/5/24, 2:30 AM

Thank you for good information!

Original message was deleted

M

Max (@rozenmd)•3/5/24, 10:09 AM

did it throw an error or hang?

L

Lemon•3/5/24, 1:20 PM

Hey guy I cannot find a solution to this error I'm facing.
I'm running D1 locally and I want to init my db and its throwing me this error, I tried deleting the node_modules as another dude said in this discord but it did nothing.
I tried different node versions too and rebuilding with the command but same thing happens...
Any idea?

Platform: Windows 11
Node: 16.13.0
App: Next.js with D1 and using the app router

testing-next-d1 on git main [!?] via nodejs v16.13.0 
> wrangler d1 execute --file ./init.sql pollo-4 --local
▲ [WARNING] Processing wrangler.toml configuration:

    - D1 Bindings are currently in alpha to allow the API to evolve before general availability.
      Please report any issues to https://github.com/cloudflare/workers-sdk/issues/new/choose
      Note: Run this command with the environment variable NO_D1_WARNING=true to hide this message

      For example: `export NO_D1_WARNING=true && wrangler <YOUR COMMAND HERE>`


--------------------
🚧 D1 is currently in open alpha and is not recommended for production data and traffic
🚧 Please report any bugs to https://github.com/cloudflare/workers-sdk/issues/new/choose
🚧 To request features, visit https://community.cloudflare.com/c/developers/d1
🚧 To give feedback, visit https://discord.gg/cloudflaredev
--------------------

🌀 Mapping SQL input into an array of statements

✘ [ERROR] The module '\\?\C:\Users\REDACTED\AppData\Roaming\npm\node_modules\wrangler\node_modules\better-sqlite3\build\Release\better_sqlite3.node'

  was compiled against a different Node.js version using
  NODE_MODULE_VERSION 111. This version of Node.js requires
  NODE_MODULE_VERSION 93. Please try re-compiling or re-installing
  the module (for instance, using `npm rebuild` or `npm install`).


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose

testing-next-d1 on git main [!?] via nodejs v16.13.0 
x

testing-next-d1 on git main [!?] via nodejs v16.13.0 
> wrangler d1 execute --file ./init.sql pollo-4 --local
▲ [WARNING] Processing wrangler.toml configuration:

    - D1 Bindings are currently in alpha to allow the API to evolve before general availability.
      Please report any issues to https://github.com/cloudflare/workers-sdk/issues/new/choose
      Note: Run this command with the environment variable NO_D1_WARNING=true to hide this message

      For example: `export NO_D1_WARNING=true && wrangler <YOUR COMMAND HERE>`


--------------------
🚧 D1 is currently in open alpha and is not recommended for production data and traffic
🚧 Please report any bugs to https://github.com/cloudflare/workers-sdk/issues/new/choose
🚧 To request features, visit https://community.cloudflare.com/c/developers/d1
🚧 To give feedback, visit https://discord.gg/cloudflaredev
--------------------

🌀 Mapping SQL input into an array of statements

✘ [ERROR] The module '\\?\C:\Users\REDACTED\AppData\Roaming\npm\node_modules\wrangler\node_modules\better-sqlite3\build\Release\better_sqlite3.node'

  was compiled against a different Node.js version using
  NODE_MODULE_VERSION 111. This version of Node.js requires
  NODE_MODULE_VERSION 93. Please try re-compiling or re-installing
  the module (for instance, using `npm rebuild` or `npm install`).


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose

testing-next-d1 on git main [!?] via nodejs v16.13.0 
x

testing-next-d1 on git main [!?] via nodejs v16.13.0 
> wrangler d1 execute --file ./init.sql pollo-4 --local
▲ [WARNING] Processing wrangler.toml configuration:

    - D1 Bindings are currently in alpha to allow the API to evolve before general availability.
      Please report any issues to https://github.com/cloudflare/workers-sdk/issues/new/choose
      Note: Run this command with the environment variable NO_D1_WARNING=true to hide this message

      For example: `export NO_D1_WARNING=true && wrangler <YOUR COMMAND HERE>`


--------------------
🚧 D1 is currently in open alpha and is not recommended for production data and traffic
🚧 Please report any bugs to https://github.com/cloudflare/workers-sdk/issues/new/choose
🚧 To request features, visit https://community.cloudflare.com/c/developers/d1
🚧 To give feedback, visit https://discord.gg/cloudflaredev
--------------------

🌀 Mapping SQL input into an array of statements

✘ [ERROR] The module '\\?\C:\Users\REDACTED\AppData\Roaming\npm\node_modules\wrangler\node_modules\better-sqlite3\build\Release\better_sqlite3.node'

  was compiled against a different Node.js version using
  NODE_MODULE_VERSION 111. This version of Node.js requires
  NODE_MODULE_VERSION 93. Please try re-compiling or re-installing
  the module (for instance, using `npm rebuild` or `npm install`).


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose

testing-next-d1 on git main [!?] via nodejs v16.13.0 
x

testing-next-d1 on git main [!?] via nodejs v16.13.0 
> wrangler d1 execute --file ./init.sql pollo-4 --local
▲ [WARNING] Processing wrangler.toml configuration:

    - D1 Bindings are currently in alpha to allow the API to evolve before general availability.
      Please report any issues to https://github.com/cloudflare/workers-sdk/issues/new/choose
      Note: Run this command with the environment variable NO_D1_WARNING=true to hide this message

      For example: `export NO_D1_WARNING=true && wrangler <YOUR COMMAND HERE>`


--------------------
🚧 D1 is currently in open alpha and is not recommended for production data and traffic
🚧 Please report any bugs to https://github.com/cloudflare/workers-sdk/issues/new/choose
🚧 To request features, visit https://community.cloudflare.com/c/developers/d1
🚧 To give feedback, visit https://discord.gg/cloudflaredev
--------------------

🌀 Mapping SQL input into an array of statements

✘ [ERROR] The module '\\?\C:\Users\REDACTED\AppData\Roaming\npm\node_modules\wrangler\node_modules\better-sqlite3\build\Release\better_sqlite3.node'

  was compiled against a different Node.js version using
  NODE_MODULE_VERSION 111. This version of Node.js requires
  NODE_MODULE_VERSION 93. Please try re-compiling or re-installing
  the module (for instance, using `npm rebuild` or `npm install`).


If you think this is a bug then please create an issue at https://github.com/cloudflare/workers-sdk/issues/new/choose

testing-next-d1 on git main [!?] via nodejs v16.13.0 
x

LLemon Hey guy I cannot find a solution to this error I'm facing. I'm running D1 locall...

C

Cyb3r-Jak3•3/5/24, 1:25 PM

What version of wrangler are you using? It looks extremely old.

LLemon Hey guy I cannot find a solution to this error I'm facing. I'm running D1 locall...

L

Lemon•3/5/24, 1:25 PM

If someone looking for a fix i got it ITS WEIRD
TLDR; Use pnpm....
When executing it with either

wrangler ....

wrangler ....

or

npm exec wrangler ...

npm exec wrangler ...

it throws the error above

CCyb3r-Jak3 What version of wrangler are you using? It looks extremely old.

L

Lemon•3/5/24, 1:26 PM

its 3.28.4
not that old

L

Lemon•3/5/24, 1:27 PM

its 10 days old...
i saw a video how to setup Next with D1 and the video is 11days old XD

L

Lemon•3/5/24, 1:27 PM

anyways pnpm fixes that sqlite issue for some reason

C

Cyb3r-Jak3•3/5/24, 1:28 PM

Pretty sure that alpha warning has been removed for a while.

L

Lemon•3/5/24, 1:28 PM

C

Cyb3r-Jak3•3/5/24, 1:32 PM

It looks like you might be using global installed wrangler and not specific to project.

I

Isaac McFadyen•3/5/24, 1:41 PM

~~It also looks like your Node version might be very old?~~ EDIT: see Leo's answer below.

I

Isaac McFadyen•3/5/24, 1:41 PM

That looks like a warning stating that you're using Node 11?

Is there a way to listen to table changes and trigger webhooks?

Similar Threads

Similar Threads

Similar Threads