Hi guys! The documentation is a little murky on this one, how do I specify the expiration on the KV

Hi guys! The documentation is a little murky on this one, how do I specify the expiration on the KV PUT REST body? https://developers.cloudflare.com/api/operations/workers-kv-namespace-write-key-value-pair-with-metadata

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

Kkindaraffy Hi guys! The documentation is a little murky on this one, how do I specify the e...

Marcus•9/28/24, 7:57 PM

Ooh yeah they should have an example body there, for sure. I assume it's the same as the

wrangler kv bulk put

wrangler kv bulk put

entries: https://developers.cloudflare.com/workers/wrangler/commands/#kv-bulk-put

JJamieD132 help I am trying to import kv to my javascript worker with `import { KVNameSpace...

Marcus•9/28/24, 8:02 PM

was that a suggestion from an AI tool? that's my best guess :D anyway, follow https://developers.cloudflare.com/kv/get-started/#3-bind-your-worker-to-your-kv-namespace and https://developers.cloudflare.com/kv/get-started/#5-access-your-kv-namespace-from-your-worker to use a KV namespace with a worker

Kkindaraffy Hi guys! The documentation is a little murky on this one, how do I specify the e...

thomasgauvin•9/30/24, 1:47 PM

Thanks for flagging! let me verify

thomasgauvin•9/30/24, 2:27 PM

@kindaraffy yes, expiration is supported in the REST API, we'll be fix that in docs

You can specify expiration or expirationTtl as a query param

So I can tell the users: https://api.cloudflare.com/client/v4
/accounts/{account_id}/storage/kv/namespaces/{namespace_id}/values/{key_name}?expiration=<secondsSinceEpoch>

or https://api.cloudflare.com/client/v4
/accounts/{account_id}/storage/kv/namespaces/{namespace_id}/values/{key_name}?expirationTtl=<secondsFromNow>

kindaraffyOP•9/30/24, 2:28 PM

Thank you.

carlos-alberto•10/1/24, 3:22 PM

Hey! Are there documented (or undocumented) rate limits on number of writes to different KV keys from a worker (on the paid plan)? We are seeing 429s when we try to write a few thousand keys within a few seconds.

thomasgauvin•10/1/24, 3:29 PM

KV has 1 write per second per key limit from the binding https://developers.cloudflare.com/kv/platform/limits/ and the APIs have global rate limits https://developers.cloudflare.com/fundamentals/api/reference/limits/#:~:text=The%20global%20rate%20limit%20for,receiving%20a%20HTTP%20429%20response.

carlos-alberto•10/1/24, 3:31 PM

Do the api rate limits apply to calls made from a worker binding?

carlos-alberto•10/1/24, 3:32 PM

We are writing to different keys, so the 1 per second should not apply

thomasgauvin•10/1/24, 3:41 PM

DM'd

ItsWendell•10/1/24, 4:41 PM

Related to the new upcoming cache purging changes, couldn't these also apply to KV?

https://blog.cloudflare.com/instant-purge/

Is it generally possible to purge a specific KV key? I think if a KV value is locally cached, and you update this it could in theory especially with the new purging system 'instantly' purge all regional KV caches right? Think this could bring quite some benefits to keep KV reads latency.

E.g. I need super quick access to a 'configuration' stored in KV, this 'configuration' is updated at most a couple of times a day. If we can keep this in the cache until this value is updated or deleted, it would speed up calls to KV a lot. Currently it's documented that KV updates do not purge KV caches, in this case it would be great if it did!

thomasgauvin•10/2/24, 7:37 PM

Thanks for the feedback @ItsWendell, like you mentioned, KV doesn't have cache purges but it's something we're keeping our eyes on

w3bcode•10/3/24, 1:03 PM

can we use https://github.com/cloudflare/cloudflare-typescript with local wrangler created kv namespace ?

GitHub

GitHub - cloudflare/cloudflare-typescript: The official Typescript ...

The official Typescript library for the Cloudflare API - cloudflare/cloudflare-typescript

Ww3bcode can we use https://github.com/cloudflare/cloudflare-typescript with local wrangl...

Hello, I’m Allie!•10/3/24, 2:30 PM

No, since it does not expose an HTTP API

w3bcode•10/3/24, 2:46 PM

ohh, got it, thanks

AAshish Rawat I think KV is good for storing permission level data on top of D1. Like checking...

thousandmiles•10/6/24, 2:47 AM

i am guessing maybe DB is more suitable for production level deployment for permissions? to ensure consistency.

Tthousandmiles i am guessing maybe DB is more suitable for production level deployment for perm...

Isaac McFadyen•10/6/24, 2:49 AM

The "inconsistency" of KV would just mean that an update might take 60 seconds to propogate globally. If you're OK with 60-second delays when adding or removing permissions then KV would still be suitable, but if not then KV isn't for you.

IIsaac McFadyen The "inconsistency" of KV would just mean that an update might take 60 seconds t...

thousandmiles•10/6/24, 2:52 AM

yes, I did assume permissions are usually crucial for production environment best with zero latency and 100% consistency.
what about D1? that said, I actually stick to D1 for auth data for my development project... simply because D1 offers more free allowances.

Isaac McFadyen•10/6/24, 2:58 AM

D1 is single-region currently, so while you'd get consistency there you're definitely not going to get zero latency.

Isaac McFadyen•10/6/24, 2:59 AM

In general there's no such thing as zero-latency, 100% consistency - all databases are just trading one for the other, some fully (i.e. KV prioritizes speed, D1 prioritizes consistency) and some partially (i.e. in etcd you can choose to read possibly-stale values or consistent values and your app can make that choice itself)

Tthousandmiles yes, I did assume permissions are usually crucial for production environment bes...

Ashish Rawat•10/6/24, 6:21 PM

Permissions doesn't change often. Firebase auth token cache auth tokens upto 1 hr by default. 60sec doesn't seems to be problem.

Isaac McFadyen•10/6/24, 6:38 PM

Yeah IMO 60 seconds is perfectly OK for permission use-cases. Even if you need to revoke permissions from a user quickly because of an issue, 60 seconds is very quick and won't give them much time to do anything dangerous.

Isaac McFadyen•10/6/24, 6:39 PM

You can also implement it as a tiered system: for most permission requests you can check KV, but then if there's something extremely sensitive (like billing details or a purchase or something) you can go back to a central DB that is consistent.

JonV•10/6/24, 7:25 PM

Hello!

Have way to use KV in local dev env? or an emulator?

JJonV Hello! Have way to use KV in local dev env? or an emulator?

Hello, I’m Allie!•10/6/24, 7:45 PM

Wrangler can emulate KV in a Worker for you

jrydberg•10/6/24, 7:49 PM

I'm running a worker locally (

wrangler dev

wrangler dev

) and trying to access some KV keys I've set using

wrangler kv key put ... --local <key> <value>

wrangler kv key put ... --local <key> <value>

but my <kvnamespace>.get in my worker always returns null. I tried listing them from the worker too, and there's no keys at all. Listing them with "kv key list --local" tells me they are there. I can also read them with

kv key get

kv key get

. Any suggestions on where I should start to dig to figure it out?

JonV•10/6/24, 8:31 PM

Any example to use KV with Typescript? All examples I see, have bugs =/

JonV•10/6/24, 8:38 PM

find: https://blog.cloudflare.com/improving-workers-types/

JonV•10/7/24, 1:46 AM

What I did wrong?

Try to use Cloudflare KV, in

npm run preview

npm run preview

and in

deploy

deploy

, get some error:

 Error adding key-value pair: Error: Error adding key-value pair: ReferenceError: env is not defined

 Error adding key-value pair: Error: Error adding key-value pair: ReferenceError: env is not defined

export const runtime = 'edge';

export const putKV = async (key, value) => {
try {
await env.KV_PREVIEW.put(key, value);
return;
} catch (error) {
throw new Error(
Error adding key-value pair: ${error}
Error adding key-value pair: ${error}
);
}
};

Walshy•10/7/24, 2:01 AM

How are you invoking putKV

Walshy•10/7/24, 2:01 AM

And where is env coming from there

Walshy•10/7/24, 2:01 AM

(May be better to ask in #next-on-pages )

JonV•10/7/24, 5:12 AM

@Walshy | Deploying I dont know how to make this with TypeScript, try a lot of examples and tutorials.

But, I change to Node.JS standard code, and work.

In loca env: pass, not generate error but, not save in KVS.

Only work 100% in CF Worker.

TTigersWay I somehow understand it needs time to fix it, but shouldn't WE have a test perio...

thomasgauvin•10/7/24, 12:07 PM

Hey folks, in reference to the above inaccurate metrics and free tier quota exhaustion, this fix has now been rolled out!

m0uka•10/7/24, 12:29 PM

Hi, running into some weird eventual consistency behavior with KV - when updating a KV key value pair (via the API), accessing it via worker seemingly randomly returns the old version and switches back and forth to the new updated one. Any ideas? cacheTtl used to be set to 5 minutes, but this issue has been apparently occurring for the past 24 hours

m0uka•10/7/24, 12:30 PM

when looking at the KV dashboard, the correct version is present there, but workers still return the old version, even after several hours

Mm0uka Hi, running into some weird eventual consistency behavior with KV - when updatin...

Jax•10/8/24, 11:54 AM

Hello.
Did u solve this issue?

thomasgauvin•10/8/24, 1:19 PM

@Jax Please DM me the details of your KV namespace

acusti•10/8/24, 7:27 PM

I'm using KV to cache browser screenshots as described in this doc: https://developers.cloudflare.com/browser-rendering/get-started/screenshots/

In that doc, the

expirationTtl

expirationTtl

for the screenshots in KV is being set to 24 hours. My ideal would be to make the expiry much longer (e.g. 1 month), but with an implementation like an LRU cache where the TTL would reset whenever the value is read, so that only keys that haven’t been read for 1 month are evicted. Is there a way to accomplish something like that with KV, or is there another product that would be better suited for that kind of implementation? I did a search in discord and found kv, which suggests that KV’s expiration TTL isn’t the way to achieve this, but then because reading a value with a

cacheTtl

cacheTtl

parameter resets any previous cacheTtl from a previous read, I thought there could be something there.

Bryan•10/10/24, 7:32 PM

Is there any plan in cloudflare to implement "kv but without cache"? I know I can use D1 / Durable Objects in some scenarios, but they both have some trade-offs, and to bypass the trade-off requires too much effort.

BBryan Is there any plan in cloudflare to implement "kv but without cache"? I know I ca...

Chaika•10/10/24, 7:34 PM

Why not just use R2?

CChaika Why not just use R2?

Bryan•10/10/24, 7:40 PM

A very interesting alt method. I may consider this, though I doubt whether it can handle frequently CRUD.

BBryan A very interesting alt method. I may consider this, though I doubt whether it ca...

Chaika•10/10/24, 7:43 PM

It can handle it a lot better then KV does. KV is eventually consistent and should only be one write per key per second

Chaika•10/10/24, 7:44 PM

https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after write/strongly consistent.
Although it may be worth mentioning: Why did you say Durable Objects has some trade offs you don't like? R2 is backed by DOs for metadata and then stores the actual objects elsewhere

CChaika https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after wri...

Bryan•10/11/24, 3:35 AM

For my next purpose, I want to use it for de-duplicate. Each of my ID is 128-byte, and the durable objects' size limit is 128KB, so only 1k records will exceed the limit, which will happen in less than one second. Even the durable objects' with SQLite backend can be filled with only 16k records. Since I need to store at least 7 days data, it's far from my need.

CChaika https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after wri...

Bryan•10/11/24, 3:37 AM

Oh, that's first time I know that some part of KV is backed by DO.

But, from the document, I don't find any related to the cache time around the metadata in KV. I guess the cache policy is the same as value, right?

BBryan For my next purpose, I want to use it for de-duplicate. Each of my ID is 128-byt...

Chaika•10/11/24, 12:52 PM

ahh ok, yea the max key size for R2 is 1,024 bytes and there's no bucket max

Oh, that's first time I know that some part of KV is backed by DO.

R2 is, not KV

But, from the document, I don't find any related to the cache time around the metadata in KV. I guess the cache policy is the same as value, right?

For KV yea should be the same, but that document I linked was about R2, not KV

newbie•10/15/24, 6:06 PM

hi. beginner here. i'm having trouble with accessing KV from a worker. i did the binding but keep getting errors

newbie•10/15/24, 6:10 PM

keep getting "Property 'get' does not exist"

Hi guys! The documentation is a little murky on this one, how do I specify the expiration on the KV

Similar Threads

Similar Threads

Similar Threads