Can't seem to find it, if I add a KV using: ``` const readable_stream = new Response(JSON.stringify

Can't seem to find it, if I add a KV using:

const readable_stream = new Response(JSON.stringify(res)).body;
await c.env.CACHE.put('key' + uuid, readable_stream, { type: "stream", expirationTtl: 86400 });

const readable_stream = new Response(JSON.stringify(res)).body;
await c.env.CACHE.put('key' + uuid, readable_stream, { type: "stream", expirationTtl: 86400 });

const readable_stream = new Response(JSON.stringify(res)).body;
await c.env.CACHE.put('key' + uuid, readable_stream, { type: "stream", expirationTtl: 86400 });

const readable_stream = new Response(JSON.stringify(res)).body;
await c.env.CACHE.put('key' + uuid, readable_stream, { type: "stream", expirationTtl: 86400 });

and return it using:

var cache = await c.env.CACHE.get('key' + uuid, { type: "stream" });
  if(cache && !reset) {
    console.log('Cached', sql)
    return new Response(cache, { status: 200, headers: { "Content-Type": "application/json" } });
  }

var cache = await c.env.CACHE.get('key' + uuid, { type: "stream" });
  if(cache && !reset) {
    console.log('Cached', sql)
    return new Response(cache, { status: 200, headers: { "Content-Type": "application/json" } });
  }

var cache = await c.env.CACHE.get('key' + uuid, { type: "stream" });
  if(cache && !reset) {
    console.log('Cached', sql)
    return new Response(cache, { status: 200, headers: { "Content-Type": "application/json" } });
  }

var cache = await c.env.CACHE.get('key' + uuid, { type: "stream" });
  if(cache && !reset) {
    console.log('Cached', sql)
    return new Response(cache, { status: 200, headers: { "Content-Type": "application/json" } });
  }

That would be the fastest way of returning a json thats streamed back right? or am I missing something?

AAdvany Can't seem to find it, if I add a KV using: ``` const readable_stream = new Res...

Hello, I’m Allie!•2/26/24, 6:14 AM

For the first one, you can just put the json string

HHello, I’m Allie!For the first one, you can just put the json string

AdvanyOP•2/26/24, 9:10 AM

"For large values, the choice of type can have a noticeable effect on latency and CPU usage. For reference, the type can be ordered from fastest to slowest as stream, arrayBuffer, text, and json."

would that not make it slower?

AAdvany "For large values, the choice of type can have a noticeable effect on latency an...

Hello, I’m Allie!•2/26/24, 9:13 AM

That's for retrieval. All values in KV are stored as ArrayBuffersArrayBuffers, then are streamed out as a ReadableStreamReadableStream to your Worker, which is why it is fastest. A value stored as a

string

string

can still retrieve be retrieved as a ReadableStreamReadableStream.

HHello, I’m Allie!That's for retrieval. All values in KV are stored as `ArrayBuffers`, then are st...

AdvanyOP•2/26/24, 8:57 PM

didn't know that!

Darick•2/27/24, 6:53 PM

We're planning on using KV as an immutable cache that's accessed by (multiple) Durable Objects in a single location. According to https://developers.cloudflare.com/kv/reference/how-kv-works/, KV data first gets written to a "central store". Is the location of this central store fixed or can it be selected? Ideally we'd want it to be in the same location as our DOs.

As a higher level question, is KV a good tool for this? We want fast / cheap storage in a single location ... the global replication feature of KV is not particularly useful for our case. Are there better alternatives?

DDarick We're planning on using KV as an immutable cache that's accessed by (multiple) D...

Hello, I’m Allie!•2/27/24, 6:56 PM

You can't configure the KV origins. As for an immutable Cache, would a single DO per region not work?

Unsmart•2/27/24, 6:59 PM

KV is not cheap on storage at all. Im confused why you would even introduce KV at all why not just use the durable object storage itself?

UUnsmart KV is not cheap on storage at all. Im confused why you would even introduce KV a...

aarhus•2/27/24, 8:26 PM

KV is much cheaper for larger key values - don't forget that the DO's are charged per 4KB block. Most of my values are in the 40-50KB size - it was much cheaper to switch to DO to be the "single source of truth", use it to coordinate the updates (i.e. replicate DO storage to KV) and then all of the reads are then from KV....

Tony Leung•3/1/24, 11:57 AM

hi guys is there any plan that cloudflare would support bulk put on KV Workers API?

Tony Leung•3/1/24, 11:57 AM

using CF API is not convenient though

ogshadowfiend•3/6/24, 4:00 PM

Question: do KV

delete

delete

calls fail if the key doesn't exist/was auto-expired?

Tyler Hillery•3/7/24, 2:33 AM

Anyone able to help me here?

I'm trying to get Static Form Pages Plugin working with KV on my Astro site. pages-helpTrouble getting Static Form Pages Plugin working with KV on Astro Site

iman•3/8/24, 9:06 AM

Hi everyone, I have two Cloudflare workers deployed on my account. Can I use a shared KV between them?

Iiman Hi everyone, I have two Cloudflare workers deployed on my account. Can I use a s...

Hello, I’m Allie!•3/8/24, 9:08 AM

Yes, if both Workers have a binding with the same ID, then they should write to the same Namespace

iman•3/8/24, 9:11 AM

@HardlyWorkin' Thanks for your response. Will tests and 'wrangler dev' work correctly with this configuration? I believe it only works on the server.

Iiman @HardlyWorkin' Thanks for your response. Will tests and 'wrangler dev' work corr...

Hello, I’m Allie!•3/8/24, 9:14 AM

wrangler dev

wrangler dev

uses local KV namespaces by default. These can be shared with other local instances, but will not affect the KV Namespaces in the cloud

iman•3/8/24, 9:16 AM

I think there might be an issue when two workers attempt to connect to the same shared KV on my local system. I use lerna to have two separate worker. each of them has its own KV storage.

Iiman I think there might be an issue when two workers attempt to connect to the same ...

Hello, I’m Allie!•3/8/24, 9:17 AM

You need to use

--persist-to

--persist-to

to ensure they are both pushing their data to the same directory

iman•3/8/24, 9:19 AM

OMG! I wasn't aware of that. Let me test it out. @HardlyWorkin' , Thank you so much!

39dylan•3/9/24, 12:49 AM

Is there a way for wrangler to kv:bulk putkv:bulk put on local dev?

339dylan Is there a way for wrangler to `kv:bulk put` on local dev?

Cyb3r-Jak3•3/9/24, 12:51 AM

Add

--local

--local

to the command

CCyb3r-Jak3 Add `--local` to the command

39dylan•3/9/24, 12:58 AM

oh nice i must've missed that flag in the docs

bun•3/9/24, 3:22 AM

how much time does it take for kv to be replicated across all regions? seems like after one worker interacting with KV takes for the other worker ~20-ish seconds to get those changes

bun•3/9/24, 3:23 AM

im not actually sure this is the case though

bun•3/9/24, 3:25 AM

like, pages project puts a key, then worker tries to read that key, but it takes 10-20-30 seconds sometimes to changes to occur

Bbun how much time does it take for kv to be replicated across all regions? seems lik...

Chaika•3/9/24, 3:30 AM

It doesn't do replication (except across the two central stores), it works basically like CDN Cache being pull based. When you update a KV value, it will update it in the local cache of the location you updated it in, and also in the central stores.
For other locations, when the cacheTTL expires (default/min 60s), it will fetch from central store again

bun•3/9/24, 3:31 AM

oh so default cache is 60 s ?

Chaika•3/9/24, 3:32 AM

Yes, 60s is the default if you don't specify it, and the minimum

bun•3/9/24, 3:33 AM

minimum O.o ?

Chaika•3/9/24, 3:33 AM

There was talk about KV 2.0 (or whatever you want to call it) where it would automagically revalidate keys in the background, and even work with higher cache values while still seeing all changes less then 60s (and the how KV works docs page still references this, confusingly), but currently it's just really simple like CDN Cache

bun•3/9/24, 3:34 AM

i cant remove the cache entirely ?

Chaika•3/9/24, 3:34 AM

correct, by it's nature KV is eventually consistent

Chaika•3/9/24, 3:35 AM

It's meant to be a low write, high read volume/low latency eventually consistent data store. For example, Cloudflare Pages uses KV for all of its assets

bun•3/9/24, 3:35 AM

how come the 60s cache is not documented absolutely anywhere

bun•3/9/24, 3:35 AM

ther is literally no mention of cache in entire kv documentation i thnk

Chaika•3/9/24, 3:36 AM

https://developers.cloudflare.com/kv/api/read-key-value-pairs/#cachettl-parameter

Cloudflare Docs

Read key-value pairs · Cloudflare Workers KV

To get the value for a given key, call the get() method on any KV namespace you have bound to your Worker code:

Chaika•3/9/24, 3:36 AM

The cacheTtl parameter must be an integer greater than or equal to 60, which is the default.

bun•3/9/24, 3:37 AM

bun•3/9/24, 3:37 AM

guess going to have to use durable objects for this one

Chaika•3/9/24, 3:37 AM

What are you trying to do? Cloudflare has plenty of storage products that may fit your case better. I know a few people who prefer DOs over KV due to local speed / transactions

bun•3/9/24, 3:39 AM

i use it for cli authentication.

cli generates a code -> you enter that code in browser (pages) -> pages project writes that code + token into KV -> cli tries authenticating by communicating with a worker that checks the validity of that code in KV

Chaika•3/9/24, 3:41 AM

If it's a brand new key that hasn't been used before it wouldn't have any delay, as it would go to the central store. KV does have negative caching as well though if you tried too fast

Chaika•3/9/24, 3:42 AM

Your use case might just be better with DOs anyway though, generally closer to user, always consistent

bun•3/9/24, 3:43 AM

im not sure how do i invoke the same DO from pages/workers

Chaika•3/9/24, 3:43 AM

In your Pages Project you can bind to any DO in your account

bun•3/9/24, 3:44 AM

wtf

Chaika•3/9/24, 3:44 AM

Pages can't even create DOs, has to be the Worker who creates is/is attached to it, and then Pages can attach (Worker could be empty other then the DO though)

bun•3/9/24, 3:44 AM

ok ima try that

bun•3/9/24, 3:44 AM

do you use hono ?

Chaika•3/9/24, 3:44 AM

I've used hono before but not with DOs if that's what you're asking about

Can't seem to find it, if I add a KV using: ``` const readable_stream = new Response(JSON.stringify

Similar Threads

Similar Threads

Similar Threads