Is there a way to purge specific keys (or forcing a purge by resetting the cacheTtl)? I have the p

Is there a way to purge specific keys (or forcing a purge by resetting the cacheTtl)?

I have the perfect use case for KV: read heavy, long cacheTtls and very infrequent writes. However, I do need kv updates to be reflected relatively quickly. Should I delete the key and re-insert? What's the recommendation for this when you have very long ttls but need to refresh quickly when it is (rarely) needed?

Kkindaraffy Is there a way to purge specific keys (or forcing a purge by resetting the cache...

thomasgauvin•6/25/24, 6:05 PM

That's not possible @kindaraffy, no. Deletions are also eventual (may still be cached elsewhere in the network). The recommended for a refresh is to have 60s ttl to have your KV pairs expire, and then return the updated value after expiry. What's your use case/what are you building? Might help us determine a better alternative

EEisenbergEffect Reading up on the limites of KV store, I have a few questions I wonder if someon...

thomasgauvin•6/25/24, 6:13 PM

1. they will fail silently, ie one write will apply and the others will be dropped. 2. you can make 1000 KV operations (lists, reads, puts, deletes) within a single Worker invocation/request.

Tthomasgauvin That's not possible @kindaraffy, no. Deletions are also eventual (may still be c...

kindaraffyOP•6/25/24, 6:34 PM

I wanted to break off a part of our permission’s system to be stored almost entirely within a cf KV store.

These permissions are essentially just read-heavy strings and most of them gets written to once during a setup phase.

We expect to have high ttls on these strings. Only issue is that when a user changes permissions, we expect these change to be reflected relatively quickly.

Nameless Monster•6/25/24, 7:06 PM

I was following the Cloudflare Workers KV quick start guide and ran into an unavoidable error:

✘ [ERROR] Error processing request: TypeError: Cannot read properties of undefined (reading 'put')

I have no idea what this error means, and there aren't any docs or resources available to help.

NNameless Monster I was following the Cloudflare Workers KV quick start guide and ran into an unav...

Hello, I’m Allie!•6/25/24, 7:07 PM

That sounds like you didn't bind a KV namespace

HHello, I’m Allie!That sounds like you didn't bind a KV namespace

Nameless Monster•6/25/24, 7:09 PM

I did

NNameless Monster I did

Hello, I’m Allie!•6/25/24, 7:09 PM

What does your

wrangler

wrangler

config look like?

PPerry Sahnow right, and at that point I might as well just keep a DO as my index.

Chinoman10•6/25/24, 9:21 PM

Speaking from experience, a really nice use-case for DO's is having one per user. Has several benefits, one of them being that they'll always be physically located close to that specific user, making your webapp seem super fast, unless the person is constantly travelling between different countries, but even still...

NNameless Monster I was following the Cloudflare Workers KV quick start guide and ran into an unav...

Chinoman10•6/25/24, 9:22 PM

Yea, I had the same issue.

On your wrangler toml you have to define the kv_namespace for all the environments and also under "no environment". Only then did it work "well" for me (binding wise) for dev, preview and prod.

Chinoman10•6/25/24, 9:23 PM

I agree that the docs should be made clearer though IMHO

mohamed.adham•6/28/24, 7:51 PM

Hello everyone!

I need to integrate my nextJs app with cloudflare KV, I made the app with next-on-pages from cloudflare CLI

cosbgn•6/29/24, 3:29 PM

I'm building something like google sheets. Each user could have multiple sheets and I could have thousands of users. I'm thinking how to store individual rows. I would use d1, but I'm scared to hit the 10GB limit and multiple databases seems like a lot of work.

I first though to store it as kv, key being the spreadsheet_id and value being the csv. This seems fairly easy, but my issue is that with every update I need to replace the entire csv, having "eventually" consistent data will most likely lead to loosing data when multiple updates occur.

cosbgn•6/29/24, 3:29 PM

My final solution is:

KV, with key being spreadsheet_id/row_id and value being the csv only for that row

cosbgn•6/29/24, 3:30 PM

this seems fine, but it means I'll have all data of all spreadsheets in the same kv

cosbgn•6/29/24, 3:30 PM

is this feasable? will it become super slow?

cosbgn•6/29/24, 3:31 PM

I've read about prefix, are these like indexes and will they speed up my queries? so if I prefix by spreadsheet_id it will look only there and avoid looking on millions of rows?

cosbgn•6/29/24, 3:31 PM

any suggestions on how to do this? How would you do it?

Ccosbgn I'm building something like google sheets. Each user could have multiple sheets ...

Matt Silverlock•6/29/24, 4:21 PM

You almost definitely want strong consistency (serializable) - Durable Objects would be the fit here.

Each DO is a sheet. Use y.js to manage state/changes/apply deltas. A framework like PartyKit can help simplify this: https://www.partykit.io/

KV is almost definitely not a fit as any changes you make won’t be immediately reflected to other users.

cosbgn•6/29/24, 4:26 PM

Ok I'll have a look at do. Thanks!

Chiquinho2001•6/30/24, 11:02 AM

Hi everyone,

I'm currently facing issues with using KV Storage in my project. Specifically, I'm having trouble getting an image to load when I test my worker locally. I've followed the documentation, but I still can't seem to get it to work. Has anyone encountered a similar problem or have any suggestions on how to resolve this?

Thanks in advance for your help!

EEisenbergEffect When getting a value from a KV store, is there a network hop involved in that op...

Hello, I’m Allie!•6/30/24, 5:08 PM

There may be a network hop, depending on whether or not the value is cached in the local datacenter

CChiquinho2001 Hi everyone, I'm currently facing issues with using KV Storage in my project. S...

Tilon•6/30/24, 6:02 PM

When running locally in dev mode, then your local KV values are different from the remote KV running in the Cloud I think. Maybe that explains the behavior you are experiencing.

thomasgauvin•6/30/24, 6:19 PM

What type of application are you trying to build? Are you frequently accessing the same kv value? And what do your data patterns look like, how often are you writing/deleting/reading?

thomasgauvin•6/30/24, 6:56 PM

Seems like the right tool (frequent reads, infrequent writes), what are the KVs storing for you use case (feel free to dm me if you prefer a private communication channel)? How quickly after a write do you need to access the KV pair? Any updates?

TTilon When running locally in dev mode, then your local KV values are different from t...

Chiquinho2001•6/30/24, 7:57 PM

But the values of the KV storage when I test locally should not be the same as those when I test with the cloud values? The image represents the result when I run the program.

CChiquinho2001 But the values of the KV storage when I test locally should not be the same as t...

thomasgauvin•6/30/24, 8:59 PM

When you use 'wrangler dev', there's a locally emulated KV store that is used (not the cloud values), here's the docs section that explains it in detail https://developers.cloudflare.com/kv/get-started/#4-develop-locally-with-wrangler

Any cloud values will not be in your locally emulated KV. You can either populate your KV locally or run your workers in the cloud use wrangler dev --remote

Cloudflare Docs

Get started · Cloudflare Workers KV

Workers KV provides low-latency, high-throughput global storage to your Cloudflare Workers applications. Workers KV is ideal for storing user …

Tthomasgauvin When you use 'wrangler dev', there's a locally emulated KV store that is used (n...

Chiquinho2001•6/30/24, 10:15 PM

After following the instructions from the link you sent, I still haven't managed to solve the problem. I'm not sure if the image needs to be saved as a JPEG or if it has to be saved in base64 format.

thomasgauvin•6/30/24, 11:53 PM

I'm not sure, would depend on how you're saving it/using it. It does seem like it's present in the dashboard so I wonder why it's not returning with 'wrangler kv key list ...'. are you logged in to the right user with wrangler?

Chiquinho2001•7/1/24, 8:38 AM

Yes, I have the data well stored in the KV storage. I have the account login and I put everything correctly in the TOML file, but it still gives an error.

mattp•7/1/24, 9:08 AM

https://developers.cloudflare.com/fundamentals/api/reference/limits/ <- Rate limits of REST API.
Does this include worker binding calls?

CChiquinho2001 After following the instructions from the link you sent, I still haven't managed...

Matt Silverlock•7/1/24, 2:01 PM

Are you setting the correct content-typecontent-type header in the response?

MMatt Silverlock Are you setting the correct `content-type` header in the response?

Chiquinho2001•7/1/24, 2:02 PM

Thanks everyone, it's working.

Aditya Mathur•7/1/24, 6:35 PM

Hello! I am using WorkerKVWorkerKV for some experiment and this is my code

await this.namespace.put(keyWithPrefix, JSON.stringify(payload), {
  expiration: Math.floor(payload.resetTime.getTime() / 1000),
});

await this.namespace.put(keyWithPrefix, JSON.stringify(payload), {
  expiration: Math.floor(payload.resetTime.getTime() / 1000),
});

So here are the problems I am facing -

1. The key is not getting deleted, I am still getting the old value when I fetch it. Even if I just wait for it the expire without sending anymore request, it's still not getting delete.
2. If I want to update the value for a key but still want to have the same expiration time, what will be implmentation for that? Should I just pass the expirationexpiration props again?

Chaitanya•7/2/24, 1:15 PM

Hello, I would like to trigger a worker before stream is getting connected in cloudflare (rtmp ingest protocol)? Please help me is this possible ?

Iim bomu Hi ! New here, do i need workers to access KV ? Are workers script only uploaded...

Hard@Work•7/4/24, 9:49 AM

Using the cloudflarecloudflare package is probably the easiest way, though note that using it is not ideal for performance reasons, so we recommend running KV operations through a Worker

npm

cloudflare

The official TypeScript library for the Cloudflare API. Latest version: 3.4.0, last published: 15 days ago. Start using cloudflare in your project by running npm i cloudflarenpm i cloudflare. There are 81 other projects in the npm registry using cloudflare.

sadsciencee•7/5/24, 8:07 AM

hi, has anyone been able to successfully connect to remote KV from local pages dev? I'm using the --local=false flag but it's still connecting to a local KV, which doesnt work bc I am testing with a few other bindings that reference the KV in the cloud (need this to auth into shopify's local admin dev)

Ssadsciencee hi, has anyone been able to successfully connect to *remote* KV from local pages...