Hey folks. We're designing a new feature for Workers KV to make it easier to retrieve multiple kv pa

Hey folks. We're designing a new feature for Workers KV to make it easier to retrieve multiple kv pairs at once. I'd love to get some feedback on some early designs. If you're up for it, snag 15 minutes on my calendar and I'll share with you some of the things we're thinking (or DM me) https://calendar.app.google/ABB6TtNyg7jPg82j8

Appointments

Tthomasgauvin Hey folks. We're designing a new feature for Workers KV to make it easier to ret...

森

森@VerseLink (RW)•1/31/25, 5:44 PM

Scheduled! First time doing this, would it be on discord?

jd•2/3/25, 7:40 PM

hi qq -- im trying to convert a largely kv-based lookup metadata of ~7GB in size of json and gets 10+ GB in size later with parallel reads, updates. Metadata needs persistence storage for consistency and availability too.

My metadata has 10M+ entries where each entry is a small dict of mostly nested strings of a loose schema, mixed with floats.

Is this size a good use case for cloudflare kv? thanks!

alotabits•2/4/25, 2:35 PM

Sorry for the cross-post. I asked this in workers before I knew about this channel.

Are values written to KV automatically compressed for storage?

iLearn•2/4/25, 9:25 PM

how much is "expirationTtl (option in Workers-KV)" reliable ? .. i mean, if ttl is set for 10-minutes, can i expect the key to deleted after 10-minutes ? or what error margin need to be taken in consideration ?

RRob We will not serve an object after expiration/expirationTtl has passed. This is a...

iLearn•2/5/25, 4:57 PM

Brilliant. Thanks for confirmation.

RRob We will not serve an object after expiration/expirationTtl has passed. This is a...

iLearn•2/5/25, 5:00 PM

QQ : if i use get(my_key) after expiration/expirationTTL .. i shall be getting "null" / "undefined" as returned value ?

IiLearn QQ : if i use get(my_key) after expiration/expirationTTL .. i shall be getting "...

1984 Ford Laser•2/6/25, 4:21 AM

It will be

null

null

cosbgn•2/7/25, 2:58 PM

What's the difference between expirationTtl vs cachettl ?

cosbgn•2/7/25, 2:59 PM

If I use for example:

expirationTtl: 21600

expirationTtl: 21600

do I also need to use cacheTtl?

cosbgn•2/7/25, 2:59 PM

or it will be cached by default?

Ccosbgn What's the difference between expirationTtl vs cachettl ?

Chaika•2/7/25, 3:09 PM

expirationTtl: after this time, the key (and thus its value) will be gone forever
cacheTtl: Cache it x long, to reduce cold requests to KV's Central Stores, but of course also impacts how quickly you'll see updates if you do delete/update it

Ccosbgn or it will be cached by default?

Chaika•2/7/25, 3:09 PM

cacheTtl is 60 seconds minimum. If you don't set it, it'll be 60s.

cosbgn•2/7/25, 3:14 PM

If I have a key which won't change till I manually delete it, I normally use

expirationTtl: 21600

expirationTtl: 21600

so I know that even if something goes wrong it will expire in 6 hours.

I guess it would help a lot to also add cacheTtl: 21600, right?

cache will be delete when I delete the key manually?

cosbgn•2/7/25, 3:19 PM

For example I do:

const [key, value] = ["something", "whatever"]

binding.put(key, value, { expirationTtl: 21600 })

Then after 5 minutes I do: 

binding.get(key, {cacheTtl:21600})

Then after 5 minutes I do:

binding.delete(key)

Then after 5 minutes I do:

binding.get(key, {cacheTtl:21600}) 
Will this last one return null or the cached value?

const [key, value] = ["something", "whatever"]

binding.put(key, value, { expirationTtl: 21600 })

Then after 5 minutes I do: 

binding.get(key, {cacheTtl:21600})

Then after 5 minutes I do:

binding.delete(key)

Then after 5 minutes I do:

binding.get(key, {cacheTtl:21600}) 
Will this last one return null or the cached value?

pandalambda2•2/9/25, 12:31 AM

it isn't clear to me, that if cacheTtl is absent what happens - is the default min of 60 seconds applied, or is it no cache what so ever?

Walshy•2/9/25, 12:38 AM

default 60s yeah

FFlikTeoh Was the KV tutorial page always this empty? https://developers.cloudflare.com/kv...

James•2/15/25, 3:14 PM

That looks like a bug. You may want to file an issue at https://github.com/cloudflare/cloudflare-docs/issues

Constantin•2/16/25, 10:08 PM

hey there, any wrapper around KV to easly query thinks?

James•2/16/25, 10:15 PM

What kind of wrapper are you looking for? The KV bindings in Workers work really well, for example to read values: https://developers.cloudflare.com/kv/api/read-key-value-pairs/

James•2/16/25, 10:15 PM

Was there an issue you hit or some use-case or workflow where you think a wrapper for something would be helpful?

Constantin•2/16/25, 10:30 PM

well, i'm looking for a more orm like .. thing; i'm using KV to store objects, that have some relations stored via metadata

Constantin•2/16/25, 10:31 PM

i was just wondered if there's something out there that simplifies this, by adding some syntax sugar

Constantin•2/16/25, 10:33 PM

but probably using prefix, would make more sense

matt•2/18/25, 1:10 AM

would KV be a good replacement for upstash redis?

matt•2/18/25, 1:11 AM

low-latency batch reads (eg. HMGET) would be a requirement

matt•2/18/25, 1:11 AM

fast global replication also a must, i remember a couple of years ago reading that KV was up to 30 seconds, but there was a performance release a few months ago right?

matt•2/18/25, 1:39 AM

oh boyo, that 30 seconds is now 60 seconds :\

matt•2/18/25, 1:40 AM

what is cloudflare kv used for? I thought it was intended to be a redis-like db, but the performance profile is too detached from what redis offers

Mmatt fast global replication also a must, i remember a couple of years ago reading th...

Isaac McFadyen•2/18/25, 2:33 AM

It's always been 60 seconds except for a short time during a rollout that ended up being rolled back.

Isaac McFadyen•2/18/25, 2:33 AM

KV is primarily designed for read-heavy workloads that rarely write.

Isaac McFadyen•2/18/25, 2:34 AM

For example, KV backs Cloudflare Pages and Workers Assets, where you deploy a site infrequently but people access often and quickly.

Isaac McFadyen•2/18/25, 2:35 AM

KV caches at your nearest colo (that's why the 60 second limit), and future reads during the time it's cached will be very low-latency.

Mmatt low-latency batch reads (eg. HMGET) would be a requirement

Chaika•2/18/25, 3:12 AM

not a thing currently but they talked about doing stuff for it recently: kv

Mmatt fast global replication also a must, i remember a couple of years ago reading th...

Chaika•2/18/25, 3:14 AM

worth keeping in mind along with what Isaac said, KV doesn't replicate as much as it does cache: https://developers.cloudflare.com/kv/concepts/how-kv-works/
Two Central stores, US and EU, all the colos/data reads are behind cache and cacheTtl. It's not actively pushing, they're pulling

Cloudflare Docs

How KV works · Cloudflare Workers KV

KV is a global, low-latency, key-value data store. It stores data in a small number of centralized data centers, then caches that data in Cloudflare's data centers after access.

nukely•2/24/25, 6:03 PM

Which is faster and has lower latency for random reads/writes: KV or D1?

Nnukely Which is faster and has lower latency for random reads/writes: KV or D1?

Isaac McFadyen•2/24/25, 6:20 PM

Likely KV because it's cached much more heavily than d1 (D1 is single-location), but updates may take up to 60s to be visible globally.

o7•2/28/25, 7:08 AM

I racked up 700K (free plan) delete operations testing worst case cleanup operations, then 1.27M with a paid plan.
The paid plan includes 1M deletes, so will I be charged fractionally for 270k deletes? Or rounded up to $5?

o7•2/28/25, 7:09 AM

Also is delete performance irrelevant if the key exists or not? I was deleting blank keys via the bulk api since it returned successful_key_countsuccessful_key_count regardless

FaustKreationen•3/2/25, 12:17 PM

hey Devs! I am bit confused with KV- encryption. The doc's are pretty clear data are encrypted on rest and transit. But when sending a new entry via Wrangler the value can be read and editetd without any encryption in the dashboard? I am planing to store API keys in KV so a encryption is necessary. I am pretty sure i am missing something?

Walshy•3/2/25, 12:27 PM

Yeah, it's encrypted when stored and during transit. However, users should still be able to see their data so it's unencrypted before it's given back to you

I'd recommend encrypting yourself if you want to better control when the values are visible to you.

FaustKreationen•3/2/25, 12:29 PM

thank you! I will do so

saitharun•3/3/25, 4:50 PM

We're experiencing consistently high latency (~1000ms) when using the Cloudflare KV REST API for basic key-value operations in our authentication flow. This seems excessive compared to the expected performance of KV storage.

Our implementation uses standard API calls following your documentation:

GET/PUT to https://api.cloudflare.com/client/v4/accounts/{account_id}/storage/kv/namespaces/{namespace_id}/values/{key}https://api.cloudflare.com/client/v4/accounts/{account_id}/storage/kv/namespaces/{namespace_id}/values/{key}
Authentication via X-Auth-Email and X-Auth-Key headers
Small data payloads (<2KB)

Is this latency (1 second) expected behavior for the REST API endpoint? If not, are there known optimizations, best practices, or alternative approaches you'd recommend to reduce this latency to more reasonable levels for an authentication system?

Ssaitharun We're experiencing consistently high latency (~1000ms) when using the Cloudflare...

Isaac McFadyen•3/3/25, 4:51 PM

Rest API latency is fairly expected because the REST API is located in a few core locations and all requests must travel through those locations before hitting the end service.

Isaac McFadyen•3/3/25, 4:51 PM

In the case of KV, a lot of the benefits come because of the caching done at the edge colos where the data is retrieved from, which doesn't happen with the REST API either iirc

Isaac McFadyen•3/3/25, 4:52 PM

Your best bet might be creating a Worker that uses the KV binding (even if it's a single Worker that just services a similar API as the REST API does)

saitharun•3/3/25, 4:53 PM

What's the most efficient way to access Cloudflare KV from a Python backend application?

Ssaitharun What's the most efficient way to access Cloudflare KV from a Python backend appl...

Hard@Work•3/3/25, 4:53 PM

Write a Worker that implements an API for you to call

const [key, value] = ["something", "whatever"] binding.put(key, value, { expirationTtl: 21600 }) Then after 5 minutes I do: binding.get(key, {cacheTtl:21600}) Then after 5 minutes I do: binding.delete(key) Then after 5 minutes I do: binding.get(key, {cacheTtl:21600}) Will this last one return null or the cached value?

Hey folks. We're designing a new feature for Workers KV to make it easier to retrieve multiple kv pa

Similar Threads