Is there any plan in cloudflare to implement "kv but without cache"? I know I can use D1 / Durable O

Is there any plan in cloudflare to implement "kv but without cache"? I know I can use D1 / Durable Objects in some scenarios, but they both have some trade-offs, and to bypass the trade-off requires too much effort.

BBryan Is there any plan in cloudflare to implement "kv but without cache"? I know I ca...

Chaika•10/10/24, 7:34 PM

Why not just use R2?

CChaika Why not just use R2?

BryanOP•10/10/24, 7:40 PM

A very interesting alt method. I may consider this, though I doubt whether it can handle frequently CRUD.

BBryan A very interesting alt method. I may consider this, though I doubt whether it ca...

Chaika•10/10/24, 7:43 PM

It can handle it a lot better then KV does. KV is eventually consistent and should only be one write per key per second

Chaika•10/10/24, 7:44 PM

https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after write/strongly consistent.
Although it may be worth mentioning: Why did you say Durable Objects has some trade offs you don't like? R2 is backed by DOs for metadata and then stores the actual objects elsewhere

CChaika https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after wri...

BryanOP•10/11/24, 3:35 AM

For my next purpose, I want to use it for de-duplicate. Each of my ID is 128-byte, and the durable objects' size limit is 128KB, so only 1k records will exceed the limit, which will happen in less than one second. Even the durable objects' with SQLite backend can be filled with only 16k records. Since I need to store at least 7 days data, it's far from my need.

CChaika https://developers.cloudflare.com/r2/reference/consistency/ R2 is read after wri...

BryanOP•10/11/24, 3:37 AM

Oh, that's first time I know that some part of KV is backed by DO.

But, from the document, I don't find any related to the cache time around the metadata in KV. I guess the cache policy is the same as value, right?

BBryan For my next purpose, I want to use it for de-duplicate. Each of my ID is 128-byt...

Chaika•10/11/24, 12:52 PM

ahh ok, yea the max key size for R2 is 1,024 bytes and there's no bucket max

Oh, that's first time I know that some part of KV is backed by DO.

R2 is, not KV

But, from the document, I don't find any related to the cache time around the metadata in KV. I guess the cache policy is the same as value, right?

For KV yea should be the same, but that document I linked was about R2, not KV

newbie•10/15/24, 6:06 PM

hi. beginner here. i'm having trouble with accessing KV from a worker. i did the binding but keep getting errors

newbie•10/15/24, 6:10 PM

keep getting "Property 'get' does not exist"

newbie•10/15/24, 6:12 PM

in the worker code, should i refer to the name or to the value of the binding?

newbie•10/15/24, 6:13 PM

would appreciate any assistance

Nnewbie in the worker code, should i refer to the name or to the value of the binding?

Chaika•10/15/24, 6:16 PM

Whatever you set bindingbinding to is what you access in your

env

env

, ex: https://developers.cloudflare.com/kv/concepts/kv-bindings/#access-kv-from-workers

Cloudflare Docs

KV bindings | Cloudflare Workers KV

KV bindings allow for communication between a Worker and a KV namespace.

Chaika•10/15/24, 6:17 PM

If you're using service worker format addEventListener('fetch',... addEventListener('fetch',... (migrate to module workers is recommended) then it's a global var

newbie•10/15/24, 6:21 PM

if i have that, which should i use for .get and .put, the name or the value?

Nnewbie if i have that, which should i use for .get and .put, the name or the value?

Chaika•10/15/24, 6:25 PM

wishlist_kvwishlist_kv, the name

newbie•10/15/24, 6:29 PM

if i did that binding to the worker in the ui, do i need to declare or initialize that kv var before using it? wishlist_kv.get(key)wishlist_kv.get(key) gives me Cannot find name 'wishlist_kv'.Cannot find name 'wishlist_kv'.

newbie•10/15/24, 6:30 PM

and Property 'put' does not exist on type '"wishlist_kv"'Property 'put' does not exist on type '"wishlist_kv"'

Nnewbie if i did that binding to the worker in the ui, do i need to declare or initializ...

Chaika•10/15/24, 6:30 PM

no, show more code though. If you're using module workers/exporting fetch, it's on env and not in global, there's a nice tutorial here: https://developers.cloudflare.com/kv/concepts/kv-bindings/#access-kv-from-workers

Cloudflare Docs

KV bindings | Cloudflare Workers KV

KV bindings allow for communication between a Worker and a KV namespace.

newbie•10/15/24, 6:31 PM

code starts with

addEventListener('fetch', event => {
  event.respondWith(handleRequest(event.request));
});

addEventListener('fetch', event => {
  event.respondWith(handleRequest(event.request));
});

newbie•10/15/24, 6:31 PM

do i need to add env there?

Chaika•10/15/24, 6:32 PM

no, you're using the old only supported for some products service worker format which should have it as a global var

newbie•10/15/24, 6:33 PM

i'll have to read up on migrating to module workers?

Chaika•10/15/24, 6:35 PM

KV should work fine with service workers but module workers are a smarter thing to use for performance/more features/etc reasons, and not that hard if you're just starting to switch: https://developers.cloudflare.com/workers/reference/migrate-to-module-workers/
Otherwise would need to show more of the full code of the service worker

Cloudflare Docs

Migrate from Service Workers to ES Modules | Cloudflare Workers docs

Write your Worker code in ES modules syntax for an optimized experience.

newbie•10/15/24, 6:36 PM

thanks

Tthomasgauvin Thanks for the feedback @ItsWendell, like you mentioned, KV doesn't have cache p...

djoker•10/16/24, 2:20 PM

I have some follow up questions for the same, can I DM you?

tadhglewis•10/18/24, 8:44 AM

Ddjoker I have some follow up questions for the same, can I DM you?

thomasgauvin•10/18/24, 2:12 PM

Of course! DMs always open

aquarhead•10/18/24, 7:32 PM

Hi, I'm having some trouble expiring keys in KV, I'm using Rust and it's an open source project so you can see I set it here https://github.com/aquarhead/nextgame/blob/master/src/lib.rs#L502 I just enabled logs and according to it I should have set an example object to expire at 19:20 UTC (10min ago)

PutOptionsBuilder { this: Object { obj: JsValue(Object({})) }, put_function: Function { obj: Object { obj: JsValue(Function(put)) } }, name: JsValue("27c43d0052d59077f496"), value: JsValue("{"description":"test game, don't register","players":{},"guests":[],"comments":[]}"), expiration: Some(1729279200), expiration_ttl: None, metadata: None }

PutOptionsBuilder { this: Object { obj: JsValue(Object({})) }, put_function: Function { obj: Object { obj: JsValue(Function(put)) } }, name: JsValue("27c43d0052d59077f496"), value: JsValue("{"description":"test game, don't register","players":{},"guests":[],"comments":[]}"), expiration: Some(1729279200), expiration_ttl: None, metadata: None }

But it's still there even now. Am I missing something apparent here? (This seems to work correctly locally in dev mode)

GitHub

nextgame/src/lib.rs at master · aquarhead/nextgame

Who's playing?! Contribute to aquarhead/nextgame development by creating an account on GitHub.

aquarhead•10/18/24, 7:33 PM

The GameGame should not exist after 19:20

Constantin•10/19/24, 12:40 PM

hey there.

I'm having two workers - one serving astro and another as a service auth worker
getting this response type when calling the service worker: ProxyStub { name: 'Object', poisoned: false }

Constantin•10/19/24, 12:41 PM

still, the response in the service worker (the user object) comes fine from the KV

Constantin•10/19/24, 1:07 PM

oh it looks i have to stringify when i'm getting the object

BBryan For my next purpose, I want to use it for de-duplicate. Each of my ID is 128-byt...

sadsciencee•10/19/24, 9:55 PM

where did you get the 16k record limit for DO sqlite? I've got like 4MB in there and def more than 16k records

danielsundq•10/23/24, 8:03 AM

We are suddenly experiencing a significant latency when updating a value in the KV. We are experiencing something like 30 seconds latency. Is there some known problem in the datacenter?

Ddanielsundq We are suddenly experiencing a significant latency when updating a value in the ...

Anthony•10/23/24, 8:10 AM

I am having the same issue

danielsundq•10/23/24, 8:18 AM

So is this a known problem at Cloudflare? This causes big issues in our application

Anthony•10/23/24, 8:18 AM

Doesn't seem so, nothing on their status page

danielsundq•10/23/24, 8:18 AM

Yeah saw that too

Anthony•10/23/24, 8:19 AM

but I think generally write latency can be up to a minute
but it usually isn't

danielsundq•10/23/24, 8:49 AM

Yeah it's usually more or less instant

danielsundq•10/23/24, 8:51 AM

Are US or Europe your nearest location? Seems that cloudflare kv storage location is primarily in US and Europe. Maybe the one in Europe is down and rerouted to US, that would explain the issue

danielsundq•10/23/24, 8:51 AM

But would be good to get some input from Cloudflare

Anthony•10/23/24, 8:52 AM

I am in europe but I respond to discord interactions (for a discord bot) which might not come from europe

danielsundq•10/23/24, 8:57 AM

Ddanielsundq We are suddenly experiencing a significant latency when updating a value in the ...

ivogt•10/23/24, 9:56 AM

We are seeing the same latency spikes. Actually came here because there was no update on the status page.

Jun•10/23/24, 10:16 AM

I'd like to flag this to the KV team - can you let us know whether you're using REST APIs or Binding APIs?

JJun I'd like to flag this to the KV team - can you let us know whether you're using ...

Anthony•10/23/24, 10:35 AM

I am using the binding API. I would also like to add that it's not only latency. For me in some cases the values are never written.

danielsundq•10/23/24, 10:45 AM

Binding API here also. We noticed the problem this morning, about 6 hours ago.

Jun•10/23/24, 10:50 AM

Thanks both, I've passed on all the info to the KV engineering. Hopefully someone with more domain knowledge from CF will pick this up when they see this

JJun Thanks both, I've passed on all the info to the KV engineering. Hopefully someon...

ivogt•10/23/24, 12:20 PM

Just to confirm that it doesn't look like isulated case we are seeing this on multiple deployments across regions.

Is there any plan in cloudflare to implement "kv but without cache"? I know I can use D1 / Durable O

Similar Threads

Similar Threads

Similar Threads