when sending a batched KV write request, what is the pricing? one write / key or one write / request

KKai when sending a batched KV write request, what is the pricing? one write / key or...

D

DaniFoldi•8/10/23, 4:08 PM

each entry in the batch counts as a write

K

KaiOP•8/10/23, 4:08 PM

oh well sad

L

leostera•8/10/23, 8:36 PM

how come wrangler doesn't let me create kv namespaces with the same restrictions as the web ui? I created most of my ns on the dashboard so they have dashes

L

leostera•8/10/23, 8:45 PM

does listing by prefix force replication of bucket data or does it work only with bucket-local data?

L

leostera•8/10/23, 8:58 PM

what's the easiest way to clean up my kv stores?

short of manually listing/bulk-deleting all the keys in each of them

J

James•8/10/23, 9:03 PM

if you don't care about the ID changing, you could just delete the namespace and recreate it

J

James•8/10/23, 9:03 PM

otherwise unfortunately you'll have to bulk list/delete things

L

leostera•8/10/23, 9:03 PM

yeah, i started doing that but i have many kvs and i think i'm gonna need to wipe 'em regularly until I nail the data design

L

leostera•8/10/23, 9:04 PM

cool, no worries, thanks!

L

leostera•8/10/23, 10:07 PM

i made a few namespaces in the console, named:

pachadb-{kind}-store

pachadb-{kind}-store

pachadb-{kind}-store

pachadb-{kind}-store for several things

but

wranlger kv:namespace create

wranlger kv:namespace create

wranlger kv:namespace create

wranlger kv:namespace create only lets me do

_

_s and it'll prefix things with

worker-

worker-

worker-

worker-.

So calling

wrangler kv:namespace create pachadb_{kind}_store

wrangler kv:namespace create pachadb_{kind}_store

wrangler kv:namespace create pachadb_{kind}_store

wrangler kv:namespace create pachadb_{kind}_store got me kv ns named

worker-pachadb_{kind}_store

worker-pachadb_{kind}_store

worker-pachadb_{kind}_store

worker-pachadb_{kind}_store

CCharlie Hey @leostera we should probably make that experience more consistent. What ar...

M

Matt Silverlock•8/11/23, 12:35 AM

https://github.com/cloudflare/workers-sdk/blob/9d8509e08acf082604ca896b4ab9ad5c05ae7505/packages/wrangler/src/kv/index.ts#L61-L68

GitHub

workers-sdk/packages/wrangler/src/kv/index.ts at 9d8509e08acf082604...

Home to Wrangler, the CLI for Cloudflare Workers® - cloudflare/workers-sdk

C

chientrm.com•8/11/23, 12:40 PM

my image stored in

KV

KV

KV

KV as base64 encoded string, how can I leverage the browser to treat them as normal images so that I can make the cache happen?

If I embed the base64 string in my rest response, it won't be cache.

C

chientrm.com•8/11/23, 1:01 PM

Done

export const GET = (async ({ params, locals }) => {
  const { id } = params,
    value = await locals.KV.get(memeTemplateFileKey(id)),
    buffer = Buffer.from(value!.split(',')[1], 'base64');
  return new Response(buffer, { headers: { 'Content-Type': 'image/png' } });
}) satisfies RequestHandler;

export const GET = (async ({ params, locals }) => {
  const { id } = params,
    value = await locals.KV.get(memeTemplateFileKey(id)),
    buffer = Buffer.from(value!.split(',')[1], 'base64');
  return new Response(buffer, { headers: { 'Content-Type': 'image/png' } });
}) satisfies RequestHandler;

export const GET = (async ({ params, locals }) => {
  const { id } = params,
    value = await locals.KV.get(memeTemplateFileKey(id)),
    buffer = Buffer.from(value!.split(',')[1], 'base64');
  return new Response(buffer, { headers: { 'Content-Type': 'image/png' } });
}) satisfies RequestHandler;

export const GET = (async ({ params, locals }) => {
  const { id } = params,
    value = await locals.KV.get(memeTemplateFileKey(id)),
    buffer = Buffer.from(value!.split(',')[1], 'base64');
  return new Response(buffer, { headers: { 'Content-Type': 'image/png' } });
}) satisfies RequestHandler;

L

leostera•8/11/23, 3:26 PM

@chientrm can you store the raw binary image on r2 instead? that + a public domain should get you all the caching you need on the browsers end

A

andrewp•8/11/23, 3:50 PM

@chientrm have you tried setting cache directives? https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Cache-Control

Cache-Control - HTTP | MDN

The Cache-Control HTTP header field holds directives (instructions) — in both requests and responses — that control caching in browsers and shared caches (e.g. Proxies, CDNs).

Aandrewp @chientrm have you tried setting cache directives? https://developer.mozilla.org...

C

chientrm.com•8/11/23, 3:56 PM

I made it to decode and serve the value as an image.
Just not sure how to get the cache done right.

C

chientrm.com•8/11/23, 3:56 PM

TTL cache-control is not good imho.

Lleostera @chientrm can you store the raw binary image on r2 instead? that + a public doma...

C

chientrm.com•8/11/23, 3:57 PM

The image is preprocessed and encoded as base64 when first import.
Also the size is guaranteed to be < 25MB and KV is already available in my app.

Cchientrm.com TTL cache-control is not good imho.

U

Unsmart•8/11/23, 3:58 PM

why not

UUnsmart <:meowwaitwhat:356860875795202050> why not

C

chientrm.com•8/11/23, 3:58 PM

Maybe calculate a hash and then throw redirect and set the cache to forever?

U

Unsmart•8/11/23, 3:59 PM

I'm very confused... I would just set a cache control header

UUnsmart I'm very confused... I would just set a cache control header 🤷

C

chientrm.com•8/11/23, 4:00 PM

using time-out?

U

Unsmart•8/11/23, 4:00 PM

Im not sure what time outs have to do with a header?

C

chientrm.com•8/11/23, 4:00 PM

because, the images are serve at

/images/[id]

/images/[id]

/images/[id]

/images/[id]. There was no hash pre-calculated.

UUnsmart Im not sure what time outs have to do with a header?

C

chientrm.com•8/11/23, 4:02 PM

what should the cache header look like?

Cchientrm.com what should the cache header look like? 🤔

A

andrewp•8/11/23, 6:35 PM

This document is a great overview of the different caching options: https://developer.mozilla.org/en-US/docs/Web/HTTP/Caching . The caching headers that you decide use will vary based on your application's use cases. I encourage you to read through the options and test out a few of them, to see what works best.

HTTP caching - HTTP | MDN

The HTTP cache stores a response associated with a request and reuses the stored response for subsequent requests.

J

James•8/14/23, 1:01 AM

Read heavy workloads. Storing assets is a great example

J

James•8/14/23, 1:02 AM

It’s also just fine for storing stuff you don’t mind taking 60 seconds to be invalidated. Caches is another great example

J

James•8/14/23, 1:08 AM

KV is much faster than R2: https://developers.cloudflare.com/workers/learning/how-kv-works/

How KV works · Cloudflare Workers docs

Workers KV is a global, low-latency, key-value data store. It stores data in a small number of centralized data centers, then caches that data in …

J

James•8/14/23, 1:09 AM

Data is cached in local datacenters after being retrieved once

J

James•8/14/23, 1:09 AM

Whereas R2 is always in a single location

J

James•8/14/23, 1:09 AM

KV is also cheaper IIRC

E

Erisa•8/14/23, 1:10 AM

Nah, R2 is slower but cheaper

J

James•8/14/23, 1:10 AM

Ahh fair, thanks for clarification

J

James•8/14/23, 1:12 AM

I love the simplicity of KV for storing things like assets, and caches personally. Those things might not change for days, weeks, or months, so I just don’t need strong consistency.

J

James•8/14/23, 1:16 AM

You can’t put CDN cache in front of a worker. You could use workers cache api but that’s still gonna incur a cold read to R2 which’ll be slower than KV

J

James•8/14/23, 1:18 AM

Sure if you’re just doing that then R2 makes more sense

when sending a batched KV write request, what is the pricing? one write / key or one write / request

Similar Threads

Similar Threads

Similar Threads