if it's an important project, which "large project" sounds like, then no it's not a good choice. I

if it's an important project, which "large project" sounds like, then no it's not a good choice.

In the meantime, I suggest you use another database service. For example I'm very excited about D1, but I'm watching my project with planetscale. I'll migrate as soon as I can.

Cloudflare will never give a release date for any product or fix or service. The canned response is always soontm

JJustinNoel if it's an important project, which "large project" sounds like, then no it's no...

MetalGear•4/21/23, 2:45 PM

Okay. Thank you. Would a specific database be similar enough where transition later can be much easier? Would planet scale be the next best option?

MMetalGear Okay. Thank you. Would a specific database be similar enough where transition la...

JustinNoelOP•4/21/23, 8:54 PM

I didn't put a lot of effort into research. I just knew that planetscale would meet my needs and had a serverless driver.

you might also want to check out:

• Turso https://chiselstrike.com
• xata.io

Turso | SQLite Developer Experience in an Edge Database

Eliminate application bottlenecks by bringing the performance and data portability of open source, lightweight SQL close to your users with low overhead

Aagarcia_me I don't have much d1-specific experience, but here's a typical pattern for passi...

Saifulapm•4/21/23, 11:17 PM

This is working good

Uuser6251 We are currently evaluating DO, which seem to check all the boxes for us, when w...

Max (@rozenmd)•4/22/23, 1:20 PM

@elithrar ^

Uuser6251 We are currently evaluating DO, which seem to check all the boxes for us, when w...

Matt Silverlock•4/22/23, 2:19 PM

We’ll be announcing (just announcing: not enabling) pricing in a few weeks, but it’s very much an “it depends” case. DO is key-value based, whereas D1 is a queryable database. If you have a lot of small reads, then D1 is likely to be much cheaper. DO charges on 4KB boundaries. I’d need to know a LOT more about your query patterns here.

MetalGear•4/22/23, 2:23 PM

What are the limits of d1

MetalGear•4/22/23, 2:23 PM

Like as far as how much data it can store

Original message was deleted

Matt Silverlock•4/22/23, 2:28 PM

(Remembering that D1 is an alpha: a true alpha, not a marketing alpha!)

MMatt Silverlock (Remembering that D1 is an alpha: a true alpha, not a marketing alpha!) 😉

MetalGear•4/22/23, 2:32 PM

So if d1 is 100mb limit I’m trying to understand how that can be useful? Like say I’m storing e-commerce orders. What do we do when we reach a limit

MMetalGear So if d1 is 100mb limit I’m trying to understand how that can be useful? Like sa...

Matt Silverlock•4/22/23, 2:33 PM

It’s an alpha. Per-DB storage limits will increase dramatically when we get to beta. Hold tight!

MetalGear•4/22/23, 2:34 PM

Regardless though just trying to understand how that would be handled in prod. Say it’s 10gb even. What do I do when I reach my cap

Uuser6251 Thanks for the quick response! We will have lots of small reads and writes, usua...

Matt Silverlock•4/22/23, 2:35 PM

DO prices a read & write on 4KB boundaries. Many web-facing database workloads are selecting single rows of user data (500 bytes!), or simple reads to generate lists. These are very small.

Original message was deleted

MetalGear•4/22/23, 2:35 PM

We’ll the thing is a database is forever expanding right. If you are constantly adding data to your db you are guaranteed to one day reach that cap. Just trying to understand how one would handle that

MMetalGear Regardless though just trying to understand how that would be handled in prod. S...

Matt Silverlock•4/22/23, 2:36 PM

Same thing if you hit 50GB? It takes a lot of traditional relational data to add up, and you will be able to create many databases. Each DB will have its own limits.

MMatt Silverlock Same thing if you hit 50GB? It takes a lot of traditional relational data to add...

MetalGear•4/22/23, 2:37 PM

So we would just create a new database to store the orders after the first one adds up you’re saying?

MetalGear•4/22/23, 2:38 PM

Sorry if I’m not understanding this correctly as I have mostly worked with DO. Like planet scale I’m pretty sure if you reach your plan limit you just upgrade and get more storage. So with d1 I’m trying to understand what efforts will be required

MetalGear•4/22/23, 2:39 PM

I’m building a e-commerce saas. The order data will add up very quickly

MMetalGear So we would just create a new database to store the orders after the first one a...

Matt Silverlock•4/22/23, 2:39 PM

I think it’s worth stepping back a second. I understand that hitting a storage limit sounds concerning, but… if you have 500 bytes per row, and 10M order rows: that’s just 5GB.

MMatt Silverlock I think it’s worth stepping back a second. I understand that hitting a storage l...

MetalGear•4/22/23, 2:40 PM

So let’s say I reach that In a year with 100 tenants

Original message was deleted

Erisa•4/22/23, 2:41 PM

From https://developers.cloudflare.com/d1/

While in the Alpha period, there is a possibility of breaking changes. The Alpha is meant for testing purposes and using it for Production traffic is not recommended.

MMetalGear So let’s say I reach that In a year with 100 tenants

Matt Silverlock•4/22/23, 2:41 PM

I’m just going to restate here: D1 is in alpha. A lot will change. I’d love to share more, but much of this is subject to change. Storage limits included.

MMatt Silverlock I’m just going to restate here: D1 is in alpha. A lot will change. I’d love to s...

MetalGear•4/22/23, 2:42 PM

Yeah my concern is not that it’s in alpha and only 100mb but rather if we can’t expand storage what do we do when we reach limits. Sorry if I’m going in circles I’m new to data storage and just trying to learn. I love CF and a fanboy of all services. Trying to do everything within the ecosystem

MMetalGear Yeah my concern is not that it’s in alpha and only 100mb but rather if we can’t ...

Matt Silverlock•4/22/23, 2:44 PM

As with any DB - you end up potentially splitting/sharding it out - by date or user ID or order ID. Even if you can scale AWS RDS up to 1TB, you often don’t want to do that as it ultimately has performance and risk trade-offs. Same with PlanetScale.

MMatt Silverlock As with any DB - you end up potentially splitting/sharding it out - by date or u...

MetalGear•4/22/23, 2:45 PM

What about with something like planet scale?

MMetalGear Yeah my concern is not that it’s in alpha and only 100mb but rather if we can’t ...

Matt Silverlock•4/22/23, 2:45 PM

I’m just going to reiterate the need to hold tight: I haven’t said anything concrete about per-DB limits, and we’re not quite ready to share those.

MMatt Silverlock I’m just going to reiterate the need to hold tight: I haven’t said anything conc...

MetalGear•4/22/23, 2:46 PM

Okay. Tysm Very excited.

kw•4/23/23, 3:27 PM

my project is also in alpha, so I'll go beta once D1 goes into beta lol

MMatt Silverlock (Remembering that D1 is an alpha: a true alpha, not a marketing alpha!) 😉

aarhus•4/23/23, 10:39 PM

Hi @elithrar, can you give us a steer around how we can expect to handle breaking changes? Is there going to be a compatibility flag/date or will it just stop working?

Gguoyk93 Hi, I've been thinking, may be database with native HTTP api matches cloudflare ...

Max (@rozenmd)•4/24/23, 9:10 AM

have you tried KV? https://www.cloudflare.com/products/workers-kv/

Cloudflare

Cloudflare Workers KV | Serverless Computing | Cloudflare

Cloudflare Workers KV is low-latency key-value storage at the edge. Leverage serverless computing and build serverless architecture with key-value storage.

Unsmart•4/24/23, 9:21 AM

Or #durable-objects

Dahoom•4/24/23, 9:44 AM

Hello, I'm confused as to how im supposed to upload sql files to d1.
When using wrangler d1 excecute <db> --file=file.sql
i get this error:

kian•4/24/23, 9:45 AM

You've typo'd executeexecute

Dahoom•4/24/23, 9:46 AM

okay this never happened

Dahoom•4/24/23, 9:46 AM

thank you

Max (@rozenmd)•4/24/23, 9:57 AM

if you want to try something super bleeding edge, you can also paste sql files into the console:

Dahoom•4/24/23, 10:33 AM

query is too long for that

TTumas2 I have an feature request/idea that I'm unsure how useful it is (or if it's even...

Max (@rozenmd)•4/24/23, 10:48 AM

yep

DDahoom query is too long for that 😄

Max (@rozenmd)•4/24/23, 10:48 AM

I've pasted a 500KB query in there, 2200 rows inserted no worries

Max (@rozenmd)•4/24/23, 10:48 AM

might lag tho

Dahoom•4/24/23, 10:48 AM

140k here

MMax (@rozenmd)I've pasted a 500KB query in there, 2200 rows inserted no worries

Dahoom•4/24/23, 6:00 PM

good news, the console seems to be better than wrangler. Inserted 140k rows in about 15s no problem.

Thank you for the suggestion, props to whoever worked on this feature its amazing

DDahoom good news, the console seems to be better than wrangler. Inserted 140k rows in a...

Max (@rozenmd)•4/24/23, 6:06 PM

thanks

justaname•4/24/23, 11:30 PM

Is there a timeline of when things are announced like pricing announced with beta. not like eta but what features will be shipped

if it's an important project, which "large project" sounds like, then no it's not a good choice. I

Similar Threads