Cloudflare Developers•16mo ago

Dynamic bindings when 😭

Dynamic bindings when

Deep•9/16/24, 3:23 PM

hi is there anyway to sync a local sqlite db for a desktop app with D1?

Bboop Dynamic bindings when 😭

�

𝓈𝒽𝓎•9/16/24, 3:27 PM

:NotLikeThis:

Bboop Dynamic bindings when 😭

oof2win2•9/16/24, 4:10 PM

i bet on cf birthday week

oof2win2•9/16/24, 5:56 PM

once

oof2win2•9/16/24, 5:56 PM

also probably use r2 for logs

Original message was deleted

oof2win2•9/16/24, 5:58 PM

the reason theres a limit and you will be forced to use dynamic bindings is just filesize. its not practical to load a 10gb file for a database for every request

oof2win2•9/16/24, 5:59 PM

you wouldnt load all 10 at once

oof2win2•9/16/24, 5:59 PM

then yes i guess lol

�

𝓈𝒽𝓎•9/17/24, 10:42 AM

is anyone already sharding? I'm interested on how would that work what if I had to query customer's info that lived in two separate db's

神

神龙出海•9/17/24, 2:42 PM

Error: D1_ERROR: Network connection lost.

神

神龙出海•9/17/24, 2:43 PM

神

神龙出海•9/17/24, 2:44 PM

The database is not connected again: 339c818f-a6d1-44c7-b860-32cfb8564809

davey•9/17/24, 8:02 PM

is there a roadmap for dynamic bindings?

davey•9/17/24, 8:04 PM

bc otherwise unsure how to get around db limit

Ddavey is there a roadmap for dynamic bindings?

o7•9/17/24, 8:25 PM

I'm waiting for birthday week where they mighttttt announce it

Acе•9/19/24, 12:15 PM

Looks like we’re getting embedded D1 in Durable Objects very soon

Acе•9/19/24, 12:16 PM

https://github.com/cloudflare/cloudflare-docs/pull/16903

Mas Inis•9/20/24, 1:31 AM

Since each D1 database is limited to 10gb. Is there any recommendation to architect our data from cloudflare guys?

IIsaac McFadyen Production ready: yes, D1 is Generally Available. Maximum limit: no, cannot be r...

Mas Inis•9/20/24, 1:38 AM

Hi Isaac, since you are recommending multiple smaller DBs. Is there any guidance to do multiple DBs migration? Also can we bind D1 database dynamically now?

o7•9/20/24, 5:48 AM

Would D1's future implementation of transactions be similar to Durable Object's Transactional Storage API?

I.e. increasing a count a hundred times in a second ensures the count will be at 100.

Jadugar_Jaggu•9/20/24, 10:15 AM

Is there anyone facing some issues with D1 ?

my D1 throwing 1200 error code

Jadugar_Jaggu•9/20/24, 10:17 AM

JJadugar_Jaggu Click to see attachment

boopOP•9/20/24, 1:50 PM

The error message does say that you are providing an invalid JSON object

Isaac McFadyen•9/20/24, 5:44 PM

Are you inserting JSON into D1 yourself or is that error from D1's internal binding?

Robin Genz•9/21/24, 9:16 AM

Hey

Quick question: Is there an easy way to find the most „expensive“ (most reads/writes) queries in my code (e.g. a list in the Cloudflare dashboard) without manually checking the meta data of every single query?

RRobin Genz Hey 👋🏻 Quick question: Is there an easy way to find the most „expensive“ (most...

boopOP•9/21/24, 10:10 AM

https://developers.cloudflare.com/d1/observability/metrics-analytics/#query-insights

Cloudflare Docs

Metrics and analytics | Cloudflare D1 docs

D1 exposes database analytics that allow you to inspect query volume, query latency, and storage size across all and/or each database in your account.

naourass•9/23/24, 2:58 AM

Hi all, I'm using Astro.build with the Cloudflare integration and I'm trying to add a staging and a prod database beside the local dev one. Anyone has an idea for how to achieve that so the api endpoints would pick the local db when in dev environment, and the staging or prod db when in the staging or prod db respectively? I've added a different db binding under each environment in

wrangler.toml

wrangler.toml

, but I have no idea and can't find any info for how to make the api endpoint pick the right db on each environment (using

locals.runtime.env.DB

locals.runtime.env.DB

celer•9/23/24, 12:41 PM

Howdy y'all! I have a D1 DB with several tables, which have some foreign keys to each other (never making a cycle). Sometimes I need to recreate the DB (for testing purposes), but I don't want to regenerate db_id (because it's in wrangler.toml), so I want to drop all tables and recreate them. However, querying all table names and generating/executing a script to drop one-by-one always fails on FK related error. Even when there's no data in DB. Even when using PRAGMA defer_foreign_keys=true. Looks like the only way is to construct a dependency graph and drop tables in correct order, so there's never a FK poiting to already dropped table.
Does anyone know if there is a way to work around this and drop all tables at once without FK check? Thanks!

Deep•9/23/24, 3:48 PM

does anyone know if the 50k databases limit is a hard limit per account? or when we hit 50k databases (users) can we then upgrade to enterprise account for unlimited number of databases?

DDeep does anyone know if the 50k databases limit is a hard limit per account? or whe...

o7•9/23/24, 3:50 PM

d1-database also dynamic bindings are coming soon and they probably correlate with a higher number of dbs (natively without having to contact support for a higher limit (but thats just my speculation))

Oo7 [soft limit](https://discord.com/channels/595317990191398933/992060581832032316/...

Acе•9/23/24, 7:37 PM

From what I’ve seen, that’s likely coming out this week, there will be a 1GB database size limit (10GB after beta), and you can make unlimited. It will be that a Durable Object can have a SQL database for storage. You’ll be able to choose whether a DO class uses KV storage or SQL.

AAcе From what I’ve seen, that’s likely coming out this week, there will be a 1GB dat...

Isaac McFadyen•9/23/24, 7:41 PM

From the previous blog posts I believe DO SQLite will be a seperate opt-in thing, not the same as D1 dynamic bindings.

Isaac McFadyen•9/23/24, 7:41 PM

More for people who want low-level access to SQLite.

Acе•9/23/24, 7:50 PM

Ah yeah that makes sense, I’m sure the DO thing will solve most of our use cases in the meantime. I imagine dynamic D1 would work similar to how Workers for Platforms is essentially just dynamic service bindings

Deep•9/23/24, 8:12 PM

@qo7ems @Acе @Isaac | AS213339 thanks everyone! i have a unique use case for D1. i'm both a desktop app and web/saas. in the case of desktop/local users, then they upgrade to paid accounts or if web users want to dowload all of their data or data compliance requires their data be physically located in one geo region, i initially want to keep all user data in a single sqlite db whether local/desktop or web....

Deep•9/23/24, 8:13 PM

but since that's not really viable option with current per DB size limit (glad to hear its increasing), i had to re-architect this whole "1 db : 1 user" strategy. but, for me, that is the goal and i'll just stay on top of D1 and see what upgrades happen over time

Acе•9/23/24, 8:14 PM

Yeah I feel that’s one of the main things we’re all waiting for. Cloudflare suggest 1 db per user but give us no easy way to actually do that

Deep•9/23/24, 8:15 PM

i see, so i'm not alone

Deep•9/23/24, 8:16 PM

yeah, i'm going with turso for now for sqlite bc it's easier to move DBs to edge/geo for customers that need it in EU for instance. and, same kinda deal with them though, the DB size limits / total space GB per account limits make my goal of giving up to 1GB per user in a sqlite DB a non-starter....

Deep•9/23/24, 8:18 PM

i may actually just do it myself since i already have edge servers i'm setting up with GPUs around all of the US and then into EU... wouldn't be that hard to then throw a storage server or two into that configuration and just store my own SQLite db's..... but for now, i'm rolling with Turso + CF (KV + R2 for binary/files). kinda a pain in reality but i'll make it work.

[

[FDG] H4kuna•9/24/24, 2:07 PM

Hello, I don't know if anyone can help me or if this is the right channel, but I have a problem with my Linux server (Ubuntu 22.04) when trying to route MariaDB. Could someone help me?

[[FDG] H4kuna Hello, I don't know if anyone can help me or if this is the right channel, but I...

Sam•9/24/24, 2:28 PM

This is not really the server to ask these kind of questions. Maybe in #off-topic ?

Acе•9/24/24, 8:04 PM

kian•9/24/24, 8:16 PM

Different things - SQLite in DOs is the "raw" primitive that D1 (the managed solution) is built on top of.

kian•9/24/24, 8:17 PM

tl;dr D1 is staying at 10 GB (it isn't going down), SQLite in DOs will launch with 1 GB and eventually match at 10 GB

Dynamic bindings when 😭

Similar Threads

Similar Threads

Similar Threads