social media application similar to letterboxd, bad idea or no? im between using D1 because im alrea

social media application similar to letterboxd, bad idea or no? im between using D1 because im already using R2 + Pages for hosting or just using Planetscale

Aadjlsncm social media application similar to letterboxd, bad idea or no? im between using...

Max (@rozenmd)•4/4/24, 8:43 PM

Planetscale would support scaling and replication from the start, D1 is still building it

Original message was deleted

Max (@rozenmd)•4/4/24, 8:47 PM

No but cool idea - best is probably logging the prepared query string

wrangler d1 insights

wrangler d1 insights

could tell you summary stats but it only shows the query string too

MMax (@rozenmd)Planetscale would support scaling and replication from the start, D1 is still bu...

adjlsncmOP•4/4/24, 8:47 PM

regardless of that technically speaking, SQLite would be worse?

Aadjlsncm regardless of that technically speaking, SQLite would be worse?

Max (@rozenmd)•4/4/24, 8:48 PM

there's no better/worse here, It Depends

MMax (@rozenmd)there's no better/worse here, It Depends

adjlsncmOP•4/4/24, 8:50 PM

on?

Original message was deleted

Max (@rozenmd)•4/4/24, 8:50 PM

query execution time inside D1, yeah

Aadjlsncm on?

Max (@rozenmd)•4/4/24, 9:01 PM

expected reads/writes per second and amount of data stored to start with - sqlite can be really good for scaling simple read-heavy use cases really far as there's less to worry about

Max (@rozenmd)•4/4/24, 9:03 PM

whereas the tech underneath planetscale powers youtube, but you pay a price for that scalability

adjlsncmOP•4/4/24, 9:05 PM

thanks for the run down

adjlsncmOP•4/4/24, 9:06 PM

is there a simple reason why CF chose SQLite then since mySQL seems superior

Aadjlsncm is there a simple reason why CF chose SQLite then since mySQL seems superior

Max (@rozenmd)•4/4/24, 9:08 PM

simple reason? easiest, most battle-tested path to enable an sql interface for storing data for Workers

adjlsncmOP•4/4/24, 9:23 PM

got it

adjlsncmOP•4/4/24, 9:38 PM

ill just stick with keeping everything under cloudflare for now then and down the line when i do need "more" if CF isnt enough ill look into Planetscale

adjlsncmOP•4/4/24, 10:17 PM

im reading the docs to query D1 locally with bindings, but im using next-pages and so when i develop locally i just use npm run dev for fast refresh, how am i supposed to initialize the prisma client in that case?

adjlsncmOP•4/4/24, 10:18 PM

this is what i was using before for planetscale but obviously no database_url for d1

Aadjlsncm is there a simple reason why CF chose SQLite then since mySQL seems superior

Tony Leung•4/5/24, 2:17 AM

It's hard to maintain a large mysql cluster for the edge. Even if they do, the price will be as high as everest

MMax (@rozenmd)expected reads/writes per second and amount of data stored to start with - sqlit...

Tony Leung•4/5/24, 3:57 AM

In my case, D1, KV and R2 is perfectly fit. Most of the time my request are pagination, filtering with some predefined selected columns and get by ID. In mysql I will need a DB proxy to reduce the connections created and cache requests. With D1, it's not really faster but it's much cheaper without the worrying of connection managing and query caching.

Kkoudelka Hi everyone, I read that d1 now supports 50k databases per account to enable” da...

Tony Leung•4/5/24, 7:07 AM

yeah there are no dynamic binding yet

Tony Leung•4/5/24, 7:07 AM

but having a 50k warming database at the same time is mindblown

Kkoudelka Hi everyone, I read that d1 now supports 50k databases per account to enable” da...

Max (@rozenmd)•4/5/24, 7:15 AM

Looks like we still need to manually configure database IDs in a global wrangler file as there’s no programmatic way to manage a fleet of D1 instances

Yeah, dynamic bindings hasn't shipped yet, there's an unofficial package to automate the HTTP API steps you'd need to do atm though https://github.com/nora-soderlund/cloudflare-dynamic-bindings

Original message was deleted

Max (@rozenmd)•4/5/24, 7:17 AM

what does D1 per DO mean

MMax (@rozenmd)what does D1 per DO mean

Hello, I’m Allie!•4/5/24, 7:18 AM

SQLite Storage Bindings for DOs?

Max (@rozenmd)•4/5/24, 7:18 AM

not sure, unrelated work

Max (@rozenmd)•4/5/24, 7:19 AM

You aren't going to get D1's in DO though, you'd get a raw sqlite instance

MMax (@rozenmd)You aren't going to get D1's in DO though, you'd get a raw sqlite instance

Hello, I’m Allie!•4/5/24, 7:19 AM

Would the SQLite instance support replication?

Hello, I’m Allie!•4/5/24, 7:20 AM

That would be metal...

HHello, I’m Allie!Would the SQLite instance support replication?

Max (@rozenmd)•4/5/24, 7:20 AM

only if DO itself did

MMax (@rozenmd)only if DO itself did

Hello, I’m Allie!•4/5/24, 7:21 AM

Aren't they two different storage systems?

Hello, I’m Allie!•4/5/24, 7:21 AM

Or...

Max (@rozenmd)•4/5/24, 7:21 AM

think of D1 as the opinionated way to build a database service on top of raw sqlite+DO

MMax (@rozenmd)think of D1 as the opinionated way to build a database service on top of raw sql...

Hello, I’m Allie!•4/5/24, 7:23 AM

Or something like Code Procedures?

Hello, I’m Allie!•4/5/24, 7:23 AM

Or whatever that "Colocate-your-code-next-to-D1" thing was called

HHello, I’m Allie!Or something like Code Procedures?

Max (@rozenmd)•4/5/24, 7:26 AM

oh you're asking if DO will support things we announced for D1

Max (@rozenmd)•4/5/24, 7:26 AM

no idea

MMax (@rozenmd)?

Hello, I’m Allie!•4/5/24, 7:27 AM

In one of the earlier blog posts for D1, there was something talking about being able to colocate some code next to a D1 instance. Not sure if that is actually a DO, or Service Binding, or something else

jayMakes11•4/5/24, 2:04 PM

Trying to determine if D1 is right for a current project...

For use cases where the size of a single table could grow quite large (think hundreds of thousands of rows), is D1 simply not a good option due to the 10GB limit?

Max (@rozenmd)•4/5/24, 2:06 PM

we have dbs with millions of rows, no dramas

jayMakes11•4/5/24, 2:06 PM

this is reassuring to hear... so basically I shouldn't ever have to worry about it (assuming i go with a per-user approach).

jayMakes11•4/5/24, 2:07 PM

for the dbs with millions of rows, what's the approximate size?

jayMakes11•4/5/24, 2:07 PM

i've seen postgres dbs at 300 to 400 GB... that's my only context for this... maybe sqlite is inherently smaller or something?

JjayMakes11 for the dbs with millions of rows, what's the approximate size?

Max (@rozenmd)•4/5/24, 2:11 PM

2ish GB

JjayMakes11 i've seen postgres dbs at 300 to 400 GB... that's my only context for this... ma...

Max (@rozenmd)•4/5/24, 2:11 PM

Workers also supports big classic postgres DBs - using Hyperdrive

jayMakes11•4/5/24, 2:13 PM

This is all very helpful. Thank you.

Yeah, no base64 images or anything, mostly just simple String and such.

JjayMakes11 i've seen postgres dbs at 300 to 400 GB... that's my only context for this... ma...

Max (@rozenmd)•4/5/24, 2:20 PM

we picked sqlite particularly because we could load millions of dbs across the world really quickly - that pattern breaks down for extremely large, monolith-style DBs

MMax (@rozenmd)we picked sqlite particularly because we could load millions of dbs across the w...

jayMakes11•4/5/24, 2:20 PM

makes sense... trying to work with 300-400 GB DBs is also just flat-out painful...

jayMakes11•4/5/24, 2:21 PM

(from my experience at least)

TTony Leung It's hard to maintain a large mysql cluster for the edge. Even if they do, the p...

adjlsncmOP•4/5/24, 3:12 PM

this makes sense, thanks

social media application similar to letterboxd, bad idea or no? im between using D1 because im alrea

Similar Threads

Similar Threads

Similar Threads