architecturally D1 is a single writer multiple reader replicas type of situation? are there any guar

architecturally D1 is a single writer multiple reader replicas type of situation? are there any guarantees for the reader replicas or they are eventually consistent?

Vvassbence architecturally D1 is a single writer multiple reader replicas type of situation...

Hello, I’m Allie!•6/24/23, 2:47 PM

Currently, it is a single-reader/single-writer setup, though I believe the plan is for eventually consistent read-replicas.

vassbenceOP•6/24/23, 2:48 PM

Is it a good idea to push immutable/rarely edited but heavily read data to KV to act as a cache in front of D1? I guess definitely now but even later on with read replicas it should be cheaper to get a key from KV than to run a query on D1

Unsmart•6/24/23, 3:02 PM

D1 will be way cheaper than KV is (assuming small values at least). And I would use the cache api as a cache

vassbenceOP•6/24/23, 3:04 PM

It will be cheaper? Damn.. how? If it will have the same eventual consistency characteristict I don't see why would they make it cheaper

Unsmart•6/24/23, 3:04 PM

https://developers.cloudflare.com/d1/platform/pricing/

Pricing · Cloudflare D1 docs

While in public Alpha, D1 is currently free to use on all Workers plans. Refer to the our recent announcement) for more information.

vassbenceOP•6/24/23, 3:04 PM

A lot more computes goes into serving a D1 request than just a KV get, or thats what it feels like anyways

Unsmart•6/24/23, 3:05 PM

Storage is more expensive but reads/writes are cheaper but you have to use small values

vassbenceOP•6/24/23, 3:07 PM

at 2 MB / read they are the same price

vassbenceOP•6/24/23, 3:07 PM

2MB is a lot..

Unsmart•6/24/23, 3:07 PM

1MB is the max size of a value in D1

Unsmart•6/24/23, 3:10 PM

and do note that writes are significantly more expensive than that of reads... 1 million writes of 1MB is $1000

Unsmart•6/24/23, 3:13 PM

5KB would cost the same as far as writes go but generally you probably wont go over 5KB that often for a normal DB usage

vassbenceOP•6/24/23, 3:28 PM

so for large or somewhat large writes/reads KV is cheaper

Unsmart•6/24/23, 3:29 PM

yes

Vvassbence It will be cheaper? Damn.. how? If it will have the same eventual consistency ch...

Matt Silverlock•6/24/23, 3:39 PM

They won't have the same eventual consistency. KV is minimum of 60 seconds. Eventual consistency isn't the same across storage systems.

vassbenceOP•6/24/23, 3:42 PM

By that you mean that D1 aims for an even better consistency model? So like less than 60?

Vvassbence By that you mean that D1 aims for an even better consistency model? So like less...

Matt Silverlock•6/24/23, 5:02 PM

Yes, by far. Most databases replicate far more quickly than a minute.

vassbenceOP•6/24/23, 5:04 PM

Is that because in the case of D1 replication means sending the list of changes to every replica and in the case of KV it could mean sending over 20MB of data?

Unsmart•6/24/23, 5:13 PM

KV doesnt replicate data it uses a cache and the cache gets invalidated after a minute
https://developers.cloudflare.com/workers/learning/how-kv-works/#how-kv-works

Because Workers KV stores data centrally and uses pull-based replication to store data in cache...

Steved•6/24/23, 7:00 PM

FYI there's a recent blog post about how the latest KV handles push vs pull : https://blog.cloudflare.com/faster-workers-kv-architecture/

Yyamiteru Is anyone working on fixing this? https://github.com/cloudflare/workers-sdk/issu...

itsmatteomanf•6/25/23, 7:05 PM

I have seen this, too. I think it does the same thing even with .all(), though.

Yyamiteru Yes it does.

itsmatteomanf•6/25/23, 7:33 PM

You can solve with the AS command, if you really need, but it’s a problem when you want to return everything

Yyamiteru Can you give me an example? Sorry I'm not very good with SQL.

itsmatteomanf•6/25/23, 7:50 PM

Let me get home, it’s hard on mobile and I want to do that properly.

itsmatteomanf•6/25/23, 7:51 PM

If I don’t reply in a couple hours ping me

vassbenceOP•6/25/23, 8:02 PM

select user.id as userid, data.id as dataid from user, dataselect user.id as userid, data.id as dataid from user, data

vassbenceOP•6/25/23, 8:03 PM

basially you just have to give a name for the keys which are the same

Vvassbence `select user.id as userid, data.id as dataid from user, data`

itsmatteomanf•6/25/23, 8:10 PM

This is what I wanted to do, @yamiteru

Walshy•6/26/23, 10:04 AM

https://developers.cloudflare.com/workers/wrangler/configuration/#d1-databases

MMr.D3V1L Is there a object like the one for KV: kv_namespaces = [ { binding = "<TEST_NA...

Matt Silverlock•6/26/23, 10:22 AM

Also strongly recommend following the guide: https://developers.cloudflare.com/d1/get-started/

Get started · Cloudflare D1 docs

This guide will instruct you through:

MMr.D3V1L I am getting error at: https://developers.cloudflare.com/d1/get-started/#configu...

Max (@rozenmd)•6/26/23, 10:31 AM

which version of wrangler are you using?

Max (@rozenmd)•6/26/23, 10:34 AM

personally:

% wrangler -v
 ⛅️ wrangler 3.1.0 (update available 3.1.1)
-----------------------------------------------------

% wrangler -v
 ⛅️ wrangler 3.1.0 (update available 3.1.1)
-----------------------------------------------------

MMr.D3V1L 1.20.0

Max (@rozenmd)•6/26/23, 10:35 AM

https://developers.cloudflare.com/workers/wrangler/install-and-update/#installupdate-wrangler

Max (@rozenmd)•6/26/23, 10:36 AM

you might need to follow these steps to remove v1: https://developers.cloudflare.com/workers/wrangler/migration/v1-to-v2/update-v1-to-v2/#1-uninstall-wrangler-v1

LLiudmila Hey everyone! Quick question to D1 devs: (you're awesome:) do you guys plan to d...

Adi•6/26/23, 2:08 PM

If you're on the old backend for D1, it should take backups every few hours automatically.
Afaik time travel for the new backend is planned but no release date is set.

John Spurlock•6/26/23, 5:44 PM

D1 preparing for a world with fractional bytes! : )

architecturally D1 is a single writer multiple reader replicas type of situation? are there any guar

Similar Threads

Similar Threads

Similar Threads