How often do you read/write on your db?

C

chand1012•3/1/24, 4:44 PM

Who should I contact if I’m looking at using D1 in a production capacity and need more than a gigabyte in storage?

C

Cyb3r-Jak3•3/1/24, 4:58 PM

It should be 2 GB for beta DBs and best place for limit increases is https://forms.gle/ukpeZVLWLnKeixDu7

Google Docs

Cloudflare Developer Platform: Limit Increase Request Form

Want to increase the limits of your current plan? Let us know what your requirements are here.

V

Vy•3/1/24, 5:13 PM

Right now, we're not evaluating per-database limit increases. But we're actively working towards 10GB databases

A

anymaniax•3/1/24, 5:15 PM

We will probably rebuild a product with 5 million of users on it. It’s a chat base application which use an external provider for the chat. So the db only handle some informations about users and it’s mostly use for a community feature with a list of all users and a search on it. Do you think D1 could be a good fit for that us case? (I am a bit afraid of reaching the size limit)

U

Unsmart•3/1/24, 5:20 PM

I think a database actually built for search would probably suit that better (i.e algolia/elasticsearch/etc).

A

anymaniax•3/1/24, 5:28 PM

For the search part probably (I was also thinking using a worker ai for the search part with vectorize) but I cannot put everything in it no? I would still need something for the community part and some other features

A

ajgeiss0702•3/1/24, 7:08 PM

is there any way to see previous month's usage? I would like to get an idea what my billing will look like

A

ajgeiss0702•3/1/24, 7:10 PM

yes, but I would like to see my previous usage to see what my bill will look like in the future once it does start counting

Aajgeiss0702 yes, but I would like to see my previous usage to see what my bill will look lik...

V

Vy•3/1/24, 7:11 PM

you can do this via GraphQL API, row metrics are also available in the UI

A

ajgeiss0702•3/1/24, 7:12 PM

previous month's?

A

ajgeiss0702•3/1/24, 7:12 PM

I meant to look at the dashboard yesterday but completly forgot, so im wondering if theres any way to check that now

V

Vy•3/1/24, 7:17 PM

yes, GraphQL API has 31 day history

F

fre2mansur•3/2/24, 7:11 AM

billing enabling for d1 means, is the beta ending?

TTony Leung How often do you read/write on your db?

I

impairedFelon•3/2/24, 7:30 AM

I can't assume, it's online mobile app and highly depends to Worker and D1. But i can say I will stay in free quotas even with 1000 daily user.

T

Tony LeungOP•3/2/24, 7:32 AM

If you don't write much, like 10-20% write and 80% read then it's fine. Mine is 10% write and it's more than ok.

IimpairedFelon I can't assume, it's online mobile app and highly depends to Worker and D1. But ...

T

Tony LeungOP•3/2/24, 7:34 AM

Mine don't have more than 20CCU...

I

impairedFelon•3/2/24, 7:35 AM

Then it will fine i guess.

O

oof2win2•3/2/24, 10:22 AM

hi. so my migration just failed locally because i'm not authorized? no idea what is going on, it worked before

@oof2win2 ➜ /workspaces/fdgl/apps/server (master) $ bun wrangler d1 migrations apply fdgl-maindb --local
 ⛅️ wrangler 3.29.0 (update available 3.30.1)
-------------------------------------------------------
Migrations to be applied:
┌─────────────────────────────────────────────┐
│ name                                        │
├─────────────────────────────────────────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │
└─────────────────────────────────────────────┘
✔ About to apply 1 migration(s)
Your database may not be available to serve requests during the migration, continue? … yes
🌀 Mapping SQL input into an array of statements
🌀 Executing on local database fdgl-maindb (fb5ec937-8f92-4532-a8c4-9d2d0abc9675) from .wrangler/state/v3/d1:
┌─────────────────────────────────────────────┬────────┐
│ name                                        │ status │
├─────────────────────────────────────────────┼────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │ ❌       │
└─────────────────────────────────────────────┴────────┘

❌ Migration 0002_change_proof_to_use_proof_id_as_id.sql failed with the following
errors:

✘ [ERROR] not authorized

@oof2win2 ➜ /workspaces/fdgl/apps/server (master) $ bun wrangler d1 migrations apply fdgl-maindb --local
 ⛅️ wrangler 3.29.0 (update available 3.30.1)
-------------------------------------------------------
Migrations to be applied:
┌─────────────────────────────────────────────┐
│ name                                        │
├─────────────────────────────────────────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │
└─────────────────────────────────────────────┘
✔ About to apply 1 migration(s)
Your database may not be available to serve requests during the migration, continue? … yes
🌀 Mapping SQL input into an array of statements
🌀 Executing on local database fdgl-maindb (fb5ec937-8f92-4532-a8c4-9d2d0abc9675) from .wrangler/state/v3/d1:
┌─────────────────────────────────────────────┬────────┐
│ name                                        │ status │
├─────────────────────────────────────────────┼────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │ ❌       │
└─────────────────────────────────────────────┴────────┘

❌ Migration 0002_change_proof_to_use_proof_id_as_id.sql failed with the following
errors:

✘ [ERROR] not authorized

@oof2win2 ➜ /workspaces/fdgl/apps/server (master) $ bun wrangler d1 migrations apply fdgl-maindb --local
 ⛅️ wrangler 3.29.0 (update available 3.30.1)
-------------------------------------------------------
Migrations to be applied:
┌─────────────────────────────────────────────┐
│ name                                        │
├─────────────────────────────────────────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │
└─────────────────────────────────────────────┘
✔ About to apply 1 migration(s)
Your database may not be available to serve requests during the migration, continue? … yes
🌀 Mapping SQL input into an array of statements
🌀 Executing on local database fdgl-maindb (fb5ec937-8f92-4532-a8c4-9d2d0abc9675) from .wrangler/state/v3/d1:
┌─────────────────────────────────────────────┬────────┐
│ name                                        │ status │
├─────────────────────────────────────────────┼────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │ ❌       │
└─────────────────────────────────────────────┴────────┘

❌ Migration 0002_change_proof_to_use_proof_id_as_id.sql failed with the following
errors:

✘ [ERROR] not authorized

@oof2win2 ➜ /workspaces/fdgl/apps/server (master) $ bun wrangler d1 migrations apply fdgl-maindb --local
 ⛅️ wrangler 3.29.0 (update available 3.30.1)
-------------------------------------------------------
Migrations to be applied:
┌─────────────────────────────────────────────┐
│ name                                        │
├─────────────────────────────────────────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │
└─────────────────────────────────────────────┘
✔ About to apply 1 migration(s)
Your database may not be available to serve requests during the migration, continue? … yes
🌀 Mapping SQL input into an array of statements
🌀 Executing on local database fdgl-maindb (fb5ec937-8f92-4532-a8c4-9d2d0abc9675) from .wrangler/state/v3/d1:
┌─────────────────────────────────────────────┬────────┐
│ name                                        │ status │
├─────────────────────────────────────────────┼────────┤
│ 0002_change_proof_to_use_proof_id_as_id.sql │ ❌       │
└─────────────────────────────────────────────┴────────┘

❌ Migration 0002_change_proof_to_use_proof_id_as_id.sql failed with the following
errors:

✘ [ERROR] not authorized

O

oof2win2•3/2/24, 10:25 AM

when running against remote it additionally gives a code 7500

VVy Right now, we're not evaluating per-database limit increases. But we're actively...

A

Advany•3/2/24, 10:55 AM

You guys are awesome!!!

I

impairedFelon•3/2/24, 11:52 AM

Can we make join | query with using 2 different D1 database?

Original message was deleted

T

Tony LeungOP•3/2/24, 3:54 PM

it's fairly cheap for them I guess. SQLite does not need a running server like mysql and it's basically useless if there is no worker included.

Original message was deleted

T

Tony LeungOP•3/2/24, 3:58 PM

I guess that SQLite is cheaper to manage. KV is smth like RocksDB, needs an active runtime server to host, unlike SQLite, don't really need that to run.

Original message was deleted

O

oof2win2•3/2/24, 4:41 PM

ah my bad. prisma generated a migration including pragma stuff

Original message was deleted

T

Tony LeungOP•3/2/24, 4:54 PM

it's cheap so it can be given away for free and it's also cf's strategy to attract new users.

O

oof2win2•3/2/24, 7:55 PM

whats the pricing on reading with an index? say i have users in groups and i want to select all users from a group and have an index on groups, do i get billed only for the users that are in the group?

K

kian•3/2/24, 7:59 PM

https://developers.cloudflare.com/d1/build-databases/use-indexes/

K

kian•3/2/24, 8:00 PM

D1 prices on rows_read and rows_written, index or not - the index just reduces how many rows need to be read.

O

oof2win2•3/2/24, 8:01 PM

okay thanks

G

gbaranski•3/3/24, 12:05 AM

how can I use Cloudflare D1 during SvelteKit development?

G

gbaranski•3/3/24, 12:05 AM

that's one thing that I feel like is really lacking right now

G

gbaranski•3/3/24, 12:05 AM

or at least i haven't found any solution to that

G

gbaranski•3/3/24, 12:06 AM

and that sucks to do

pnpm build

pnpm build

and then

wrangler pages dev .svelte-kit/cloudflare

wrangler pages dev .svelte-kit/cloudflare

wrangler pages dev .svelte-kit/cloudflare

wrangler pages dev .svelte-kit/cloudflare every time

G

gbaranski•3/3/24, 12:06 AM

HMR is a thing

G

Gagan Suie•3/3/24, 9:23 AM

Is there a way to listen to table changes and trigger webhooks?

Ggbaranski how can I use Cloudflare D1 during SvelteKit development?

S

Steved•3/3/24, 3:20 PM

I use the miniflare/wrangler emulation for local development with Sveltekit, and that allows me to use

npm run dev

npm run dev

and get the lightning fast reloads you're after. Take a look at: https://github.com/sdarnell/cf-svelte for a working example.

GitHub

GitHub - sdarnell/cf-svelte: A basic starter project for working lo...

A basic starter project for working locally in sveltekit on Cloudflare - sdarnell/cf-svelte

GGagan Suie Is there a way to listen to table changes and trigger webhooks?

T

Tony LeungOP•3/3/24, 6:22 PM

i don't think there is and old-school sql database has that feature. Only in my experience, only dynamodb can capture that event and put them in dynamo stream

U

Unsmart•3/3/24, 6:30 PM

AWS Aurora has the feature and is an SQL database so it’s not exclusively NoSQL

T

Tony LeungOP•3/3/24, 6:32 PM

I think AWS Aurora is a NewSQL, mysql, mariadb and postgres does not have that feature tho

T

Tony LeungOP•3/3/24, 6:34 PM

actually SQL Server can achieve that by using

xp_cmdshell

xp_cmdshell

xp_cmdshell

xp_cmdshell but it's not recommended to be turned on (according to OWASP)

U

Unsmart•3/3/24, 6:53 PM

aws aurora is mysql and postgres

UUnsmart aws aurora is mysql and postgres

T

Tony LeungOP•3/3/24, 7:19 PM

my bad, MySQL procedure can send webhook request by using

curl

curl

Original message was deleted

U

Unsmart•3/3/24, 7:21 PM

It will have read replicas soon but not sure if it will be multi-region

C

chientrm.com•3/4/24, 2:33 AM

I'm looking for a way to bulk import data into D1

C

chientrm.com•3/4/24, 2:36 AM

is to avoid the written count to D1

Cchientrm.com is to avoid the written count to D1 😗

I

Isaac McFadyen•3/4/24, 3:09 AM

Any way to write data to D1 will incur charges for writing.

I

Isaac McFadyen•3/4/24, 3:09 AM

There's no way to import data without incurring rows written, unfortunately

How often do you read/write on your db?

Similar Threads

Similar Threads

Similar Threads