I think there might be an issue when two workers attempt to connect to the same shared KV on my loca

I think there might be an issue when two workers attempt to connect to the same shared KV on my local system. I use lerna to have two separate worker. each of them has its own KV storage.

Iiman I think there might be an issue when two workers attempt to connect to the same ...

Hello, I’m Allie!•3/8/24, 9:17 AM

You need to use

--persist-to

--persist-to

to ensure they are both pushing their data to the same directory

imanOP•3/8/24, 9:19 AM

OMG! I wasn't aware of that. Let me test it out. @HardlyWorkin' , Thank you so much!

39dylan•3/9/24, 12:49 AM

Is there a way for wrangler to

kv:bulk put

kv:bulk put

on local dev?

339dylan Is there a way for wrangler to `kv:bulk put` on local dev?

Cyb3r-Jak3•3/9/24, 12:51 AM

Add

--local

--local

to the command

CCyb3r-Jak3 Add `--local` to the command

39dylan•3/9/24, 12:58 AM

oh nice i must've missed that flag in the docs

bun•3/9/24, 3:22 AM

how much time does it take for kv to be replicated across all regions? seems like after one worker interacting with KV takes for the other worker ~20-ish seconds to get those changes

bun•3/9/24, 3:23 AM

im not actually sure this is the case though

bun•3/9/24, 3:25 AM

like, pages project puts a key, then worker tries to read that key, but it takes 10-20-30 seconds sometimes to changes to occur

Bbun how much time does it take for kv to be replicated across all regions? seems lik...

Chaika•3/9/24, 3:30 AM

It doesn't do replication (except across the two central stores), it works basically like CDN Cache being pull based. When you update a KV value, it will update it in the local cache of the location you updated it in, and also in the central stores.
For other locations, when the cacheTTL expires (default/min 60s), it will fetch from central store again

bun•3/9/24, 3:31 AM

oh so default cache is 60 s ?

Chaika•3/9/24, 3:32 AM

Yes, 60s is the default if you don't specify it, and the minimum

bun•3/9/24, 3:33 AM

minimum O.o ?

Chaika•3/9/24, 3:33 AM

There was talk about KV 2.0 (or whatever you want to call it) where it would automagically revalidate keys in the background, and even work with higher cache values while still seeing all changes less then 60s (and the how KV works docs page still references this, confusingly), but currently it's just really simple like CDN Cache

bun•3/9/24, 3:34 AM

i cant remove the cache entirely ?

Chaika•3/9/24, 3:34 AM

correct, by it's nature KV is eventually consistent

Chaika•3/9/24, 3:35 AM

It's meant to be a low write, high read volume/low latency eventually consistent data store. For example, Cloudflare Pages uses KV for all of its assets

bun•3/9/24, 3:35 AM

how come the 60s cache is not documented absolutely anywhere

bun•3/9/24, 3:35 AM

ther is literally no mention of cache in entire kv documentation i thnk

Chaika•3/9/24, 3:36 AM

https://developers.cloudflare.com/kv/api/read-key-value-pairs/#cachettl-parameter

Cloudflare Docs

Read key-value pairs · Cloudflare Workers KV

To get the value for a given key, call the get() method on any KV namespace you have bound to your Worker code:

Chaika•3/9/24, 3:36 AM

The cacheTtl parameter must be an integer greater than or equal to 60, which is the default.

bun•3/9/24, 3:37 AM

bun•3/9/24, 3:37 AM

guess going to have to use durable objects for this one

Chaika•3/9/24, 3:37 AM

What are you trying to do? Cloudflare has plenty of storage products that may fit your case better. I know a few people who prefer DOs over KV due to local speed / transactions

bun•3/9/24, 3:39 AM

i use it for cli authentication.

cli generates a code -> you enter that code in browser (pages) -> pages project writes that code + token into KV -> cli tries authenticating by communicating with a worker that checks the validity of that code in KV

Chaika•3/9/24, 3:41 AM

If it's a brand new key that hasn't been used before it wouldn't have any delay, as it would go to the central store. KV does have negative caching as well though if you tried too fast

Chaika•3/9/24, 3:42 AM

Your use case might just be better with DOs anyway though, generally closer to user, always consistent

bun•3/9/24, 3:43 AM

im not sure how do i invoke the same DO from pages/workers

Chaika•3/9/24, 3:43 AM

In your Pages Project you can bind to any DO in your account

bun•3/9/24, 3:44 AM

wtf

Chaika•3/9/24, 3:44 AM

Pages can't even create DOs, has to be the Worker who creates is/is attached to it, and then Pages can attach (Worker could be empty other then the DO though)

bun•3/9/24, 3:44 AM

ok ima try that

bun•3/9/24, 3:44 AM

do you use hono ?

Chaika•3/9/24, 3:44 AM

I've used hono before but not with DOs if that's what you're asking about

39dylan•3/9/24, 5:24 AM

is there a gui tool for viewing our local dev kv?

Jadugar_Jaggu•3/9/24, 1:40 PM

hey is there any issue going with kV.delete ?

Jadugar_Jaggu•3/10/24, 5:34 AM

Hey There I have keys with expiration of 7 days but recently they are not deleting using kV.delete method and also they are not updating to the latest value

I don't know why that is. I have per day 100,000 + reads

Walshy•3/10/24, 7:07 AM

Not deleting as in you're still seeing the keys exist? How long are you waiting after delete before checking again?

Elixir•3/12/24, 9:55 AM

I want to export my KV namespace having thousands of keys using pyhton but after reasearching for an hour it seems this is not possible or is not easy, I am stuck what should I do?

kian•3/12/24, 11:45 AM

All you can do is list and then get each individual key.

Elixir•3/12/24, 2:59 PM

But that is rate limited :(, I checked and there are 54000+ keys

x03•3/12/24, 11:40 PM

any way to have kv auto-delete a key after a certain period of time? I'm trying to see if it's viable to swap from redis to kv, but I cant seem to find an equivalent of that redis function.

x03•3/12/24, 11:40 PM

And I mean automatically, without having to make a cron job or anything.

Cyb3r-Jak3•3/12/24, 11:46 PM

Yes, you expire them https://developers.cloudflare.com/kv/api/write-key-value-pairs/#expiring-keys

Cloudflare Docs

Write key-value pairs · Cloudflare Workers KV

To create a new key-value pair, or to update the value for a particular key, call the put() method on any KV namespace you have bound to your Worker …

CCyb3r-Jak3 Yes, you expire them https://developers.cloudflare.com/kv/api/write-key-value-pa...