the issue seems to be happening with the `2025/03/21:snippet` and `2025/03/21:videoId` keys. Other k

the issue seems to be happening with the

2025/03/21:snippet

2025/03/21:snippet

2025/03/21:snippet

2025/03/21:snippet and

2025/03/21:videoId

2025/03/21:videoId

2025/03/21:videoId

2025/03/21:videoId keys. Other keys that were written around the same time (

2025/03/21:mainShowStart

2025/03/21:mainShowStart

2025/03/21:mainShowStart

2025/03/21:mainShowStart would have been written within a few minutes of the others) do not have this issue oddly

IIsaac McFadyen The fact that the dashboard is also sometimes not returning the keys makes me th...

o7•3/22/25, 5:01 AM

I had a similar issue not too long ago where nothing would return and it would spam list requests. My only fix was recreating the namespace
kv

ajgeiss0702OP•3/22/25, 5:02 AM

im not sure if its the same issue, as listing in my dashbaord appears to work for everything except for these two keys

o7•3/22/25, 5:02 AM

ah interesting. still wanted to share it incase it helped

IIsaac McFadyen The fact that the dashboard is also sometimes not returning the keys makes me th...

ajgeiss0702OP•3/22/25, 5:02 AM

thank you!

Isaac McFadyen•3/22/25, 5:03 AM

OK I escalated this, I'm heading to sleep but when/if CSUP gets to it I'll ask them to communicate here directly. No promises on timeline though.

ajgeiss0702OP•3/22/25, 5:04 AM

thank you. i'll see if I can work around it for now, as ive got things that depend on reading this data that I want to be processed ASAP

Aajgeiss0702 the issue seems to be happening with the `2025/03/21:snippet` and `2025/03/21:vi...

Isaac McFadyen•3/22/25, 5:06 AM

Do you know around when the keys were written?

ajgeiss0702OP•3/22/25, 5:06 AM

a few hours ago, i can get a rough time 1s

ajgeiss0702OP•3/22/25, 5:06 AM

it would have been somewhere around this timestamp: 2025-03-21T23:56:12Z2025-03-21T23:56:12Z

ajgeiss0702OP•3/22/25, 5:07 AM

probably before, but might have been the same time. i don't remember exactly what order theyre written, but i can look if important

Isaac McFadyen•3/22/25, 5:07 AM

I'm wondering if it would perhaps have occurred during this incident earlier https://discord.com/channels/595317990191398933/895794943182909470/1352765245877391421, I didn't think KV and R2 were connected but perhaps they now share some infra internally that might have failed?

Aajgeiss0702 probably before, but might have been the same time. i don't remember exactly wha...

Isaac McFadyen•3/22/25, 5:07 AM

No don't worry, just wanted to get an approx. timestamp.

ajgeiss0702OP•3/22/25, 5:14 AM

the earliest it could been written is 23:45 UTC

ajgeiss0702OP•3/22/25, 5:14 AM

which it looks like the r2 issue was resolved by then

ajgeiss0702OP•3/22/25, 5:27 AM

please ping me if there is any movement on this

ajgeiss0702OP•3/22/25, 6:08 AM

it looks like it might be fixed now? its been showing consistently the past few minutes

Aajgeiss0702 it looks like it might be fixed now? its been showing consistently the past few ...

cfmicky•3/22/25, 4:48 PM

Hey there, thanks for the update on this. Are you still seeing the issue with the KV keys that you were initially reporting?

Ccfmicky Hey there, thanks for the update on this. Are you still seeing the issue with th...

ajgeiss0702OP•3/22/25, 8:02 PM

it looks like those keys I mentioned are still sometimes not showing up in the dashboard.
but I have a cron task that collects those keys into a single one, and that appears to have read them correctly this time so its no longer interrupting my application

ajgeiss0702OP•3/22/25, 8:02 PM

also i realized I forgot to mention this before, but those keys also have an expiration set (15 days)

ajgeiss0702OP•3/22/25, 8:04 PM

If it helps, here is what this kv namespace is for:
each of those keys with colons are "fragments" of an event. they are fragmented because each piece of info is available at different times and I need to record them. that cron then combines them into a single key after the event for easier reading, so those fragments get an expiration ttl of 15 days (enough so that I can diagnose things if something goes wrong with the collapsing, and small enough so that they don't stick around forever wasting storage)

ajgeiss0702OP•3/22/25, 8:06 PM

this part of the application was made before D1 existed, otherwise I probably would have used D1. Once D1 read replicas are launched, i might consider migrating this specific namespace to d1 instead, since that would probably better fit this usecase

ajgeiss0702OP•3/22/25, 8:11 PM

even though its no longer effecting my application, lmk if theres any other info I can provide if you want to look into preventing this from happening in the future

zecanard•3/22/25, 8:18 PM

This is the same issue I’m experiencing kv and I’m still seeing it. I can refresh the Dashboard, and randomly get my old or new KV entries.

thomasgauvin•3/24/25, 4:33 PM

We're looking into how to resolve this, it seems like some routing was changed up which is making it take more time for you to see updates in the dashboard

Tuấn Nguyễn•3/26/25, 2:27 AM

I am having issue with KV.
I query a record from D1 Database, it took me 15ms, then I cache that record as json in KV.
I read that record from KV with record id, so I expected it should be faster than D1 but it actually took me 500ms, way slower.
Am I doing it wrong?

Tuấn Nguyễn•3/26/25, 2:30 AM

TTuấn Nguyễn I am having issue with KV. I query a record from D1 Database, it took me 15ms, t...

Tuấn Nguyễn•3/26/25, 3:25 PM

I finally found a bug that continuously write and invalidate the cache. MY BADDDDDD.

Bbanyan My site was too slow, so I had to switch from KV to Cache API. Is it normal for ...

Chaika•3/26/25, 3:38 PM

Read status to show this many Not Found results?

Depends entirely on how you're calling KV. If you're using it to serve static assets and people are requesting non-existent paths, not too surprising. If you have a manifest or something in front, making it so every KV get request should always exist, could be a bug in your code.

Your p50 is really high there, how are you using KV? Could you increase cacheTTL/hit the same keys more?

thomasgauvin•3/27/25, 3:20 PM

KV is a global key-value store. If there's not heavy traffic on your keys, then they won't be getting cached in all of the Cloudflare locations. When this is the case, then it needs to fetch the result from the central stores for key-value data. See https://developers.cloudflare.com/kv/concepts/how-kv-works/ for an explanation on this

Cloudflare Docs

How KV works · Cloudflare Workers KV docs

KV is a global, low-latency, key-value data store. It stores data in a small number of centralized data centers, then caches that data in Cloudflare's data centers after access.

Sam•3/27/25, 8:15 PM

Can we store complex JSON in KV as a value? I have a json that’s 4,5 levels deep and need to know if that’s possible with KV.

SSam Can we store complex JSON in KV as a value? I have a json that’s 4,5 levels deep...

Isaac McFadyen•3/27/25, 8:34 PM

At its core, KV stores bytes so any value (including JSON) that can be serialized/deserialized as bytes can be stored in KV.

Isaac McFadyen•3/27/25, 8:34 PM

Note that in contrast to JSON-oriented databases, KV just stores the bytes. You can't query on nested JSON fields or anything because KV has no idea it's JSON, it's just storing the content.

IIsaac McFadyen At its core, KV stores bytes so any value (including JSON) that can be serialize...

Sam•3/27/25, 8:43 PM

That’s good to know, do you have an example showing json value into KV? How do I translate the object into a Value?

IIsaac McFadyen Note that in contrast to JSON-oriented databases, KV just *stores* the bytes. Yo...

Sam•3/27/25, 8:44 PM

That’s not an issue. I’m planning to use the KV as a cache to avoid hitting network excessively

SSam That’s good to know, do you have an example showing json value into KV? How do I...

o7•3/27/25, 8:45 PM

if ur JSON is small enough (and since you're working with JSON) you can/should probably also insert it into the metadata https://developers.cloudflare.com/kv/api/write-key-value-pairs/#metadata

https://developers.cloudflare.com/kv/api/list-keys/#optimizing-storage-with-metadata-for-list-operations

SSam That’s good to know, do you have an example showing json value into KV? How do I...

Isaac McFadyen•3/27/25, 8:45 PM

The putput accepts any string, ReadableStream, or ArrayBuffer so you can just JSON.stringify it: https://developers.cloudflare.com/kv/api/write-key-value-pairs/

Sam•3/27/25, 8:47 PM

It’s Pirate weather data: https://docs.pirateweather.net/en/latest/API/#example

I hope there’s a way to cache it?

IIsaac McFadyen The `put` accepts any string, ReadableStream, or ArrayBuffer so you can just JSO...

Sam•3/27/25, 8:50 PM

I’ll try this one out tomorrow. Serialising/ Deserialising from ReadableStream should be fine

SSam I’ll try this one out tomorrow. Serialising/ Deserialising from ReadableStream s...

thomasgauvin•3/28/25, 1:36 PM

You should probably store it as a string and then read it with json. Check out the new KV examples, this is one where a list of translations are stored https://developers.cloudflare.com/kv/examples/workers-kv-to-serve-assets/#:~:text=Default%20to%20English-,const,-translations%20%3A%20%7B (could have more depth there, as much as you want)

Cloudflare Docs

Store and retrieve static assets · Cloudflare Workers KV docs

Example of how to use Workers KV to store static assets

Tthomasgauvin You should probably store it as a string and then read it with json. Check out t...

Sam•3/28/25, 2:50 PM

True, If there is no performance penalty,

json.Stringify

json.Stringify

is what I'll go with . Thanks for the example, they are helpful.

Sam•3/29/25, 6:51 PM

It worked and is pretty fast. I have 2 follow-up questions:
1: I uploaded a json to KV under

_preview

_preview

KV dashboard. How do I get it available locally? I run

npx wrangler dev —remote

npx wrangler dev —remote

Is there a way to clean the stale KV values, using some cron type job?

thomasgauvin•3/30/25, 3:57 AM

There are going to be 3 'envs' for KV. 1 is prod, 1 is preview, 1 is local. the prod is when your worker is deployed. the preview is in cloudflare when you are running

npx wrangler dev --remote

npx wrangler dev --remote

. the local is when your worker is running only locally

npx wrangler dev

npx wrangler dev

. each is independent and you would need to write data in any of these dev modes to get data in there

thomasgauvin•3/30/25, 3:58 AM

you could technically make the preview id and the production id the same for development as long as you are aware that you are using your production env with

npx wrangler dev --remote

npx wrangler dev --remote

, this is quite dangerous which is why the preview namespace is the default

thomasgauvin•3/30/25, 3:58 AM

For stale kv values, you should look at https://developers.cloudflare.com/kv/api/write-key-value-pairs/#expiring-keys or https://developers.cloudflare.com/workers/configuration/cron-triggers/ for cron jobs

Cloudflare Docs

Cron Triggers · Cloudflare Workers docs

Enable your Worker to be executed on a schedule.

Cloudflare Docs

Write key-value pairs · Cloudflare Workers KV docs

To create a new key-value pair, or to update the value for a particular key, call the put() method of the KV binding on any KV namespace you have bound to your Worker code:

Marcel Overdijk•4/1/25, 8:19 PM

Is there a way to purge a complete namespace?
I periodically refresh my D1 database (full import) and in that use case I want to purge the full namespace that I use as cache before D1

Pedro Ribeiro•4/2/25, 3:28 AM

I'm new to the Cloudflare environment. I would like to know how can I export all the KV data from an account to a file. We need to do some migration at work.

the issue seems to be happening with the `2025/03/21:snippet` and `2025/03/21:videoId` keys. Other k

Similar Threads

Similar Threads

Similar Threads