Cloudflare Developers•2y ago

The cache API is free

CCyb3r-Jak3 The cache API is free

Hello, I’m Allie!•5/19/24, 1:53 PM

Though if you mean a cached value from KV directly, then that is billed

HHello, I’m Allie!Though if you mean a cached value from KV **directly**, then that is billed

FTXflare•5/20/24, 12:47 PM

yes, I was asking about that, bc as I understand it worker is on the front to cache

SSasha 🐑💨 Koss Hey! I have a question. I want to use multi-tenant architecture and create separ...

thomasgauvin•5/20/24, 1:50 PM

Are you asking specifically about KV? What's you use case for multi-tenant architecture using KV? Feel free to DM me if you can't share the details. Building multi-tenant applications with KV is currently done by most the traditional way, with a single instance

arbfay•5/20/24, 6:20 PM

Hey I hope I don't sound too annoying talking about performance of KV.
It's just that I've been using KV for a lot of "indexing" tasks (to map resources to DOs, databases, etc), and for processes (oauth, etc). Often I'd have to read 2 or 3 keys then request a DO, then maybe do a write in KV, etc. But it's... slow. That can take several seconds (in Europe), sometimes > 10 secs, not good to provide a snappy experience at all. And I just discovered KV might be the slowest too... (according to https://deno.com/blog/comparing-deno-kv, but I don't trust benchmarks anyway). It feels like using DO automatically means losing any latency gain you'd think to get from deploying at the edge.

My ask is, are we going to hear about some performance improvements at some point?

Unsmart•5/20/24, 6:27 PM

That specific benchmark has already been debunked of any value. For DenoKV they do a simple read op, for every other service they do a list followed by reads thus the higher latency.

But yeah KV is not the fastest for when you need to hit origin for cold reads or for writes.

thomasgauvin•5/21/24, 2:28 PM

@arbfay just reached out to you, usually KV is highly performant for read heavy workloads but I want to better understand your use case

Jitendra•5/23/24, 10:57 AM

Hello everyone.

I need your opinion on using KV. I am using KV for cache as well as for rate limiting the email sending attempt.

Would you prefer it for rate limiting?? Before this I was using Redis. But I have decided to go all in Cloudflare

Also I am facing some issue

Like I want to limit total email count in a day to 10.
Focusing on it like I couldn't find any update function so how to update.
If I couldn't update that means it would change the TTL right??

JJitendra Hello everyone. I need your opinion on using KV. I am using KV for cache as wel...

Hello, I’m Allie!•5/23/24, 11:38 AM

KV is not a good idea for ratelimiting, since it is eventually consistent. I would go with a Durable Object instead

HHello, I’m Allie!KV is not a good idea for ratelimiting, since it is eventually consistent. I wou...

Jitendra•5/23/24, 11:39 AM

Thanks.

Walshy•5/23/24, 11:53 AM

Even better, the rate limit binding

WWalshy Even better, the rate limit binding 🙂

Hello, I’m Allie!•5/23/24, 12:04 PM

Note that this only applies to the datacenter/colo the requests hit, so if an account can trigger sends from multiple locations, they will not be applied to the same ratelimit.

[

[BR]Edson•5/24/24, 12:53 PM

anyone can help me underestand one point? im storing the url path as key of kv todo a rudimentary cache layer for some responses. but when i search on the GUI, none of the stored data shows on, it works fine on code but i cant check on the GUI. Theres any limitation for search keys started with / or having any special caracteres?

Kurzon•5/25/24, 5:37 AM

KV Namespace itself works but the key/value are null?

Kurzon•5/25/24, 5:37 AM

I'm running this in

wrangler dev

wrangler dev

Kurzon•5/25/24, 5:37 AM

This prints

null

null

Kurzon•5/25/24, 5:41 AM

Never mind, local development does not allow access, have to create a separate namespace in CLI.

Kurzon•5/25/24, 5:42 AM

But I never saw this in any of the Cloudflare Workers docs, it should be added into at least one of them for KV, I use the docs a lot. It is probably in one of them but I found my answer for this through stack overflow, not through the docs.

Puliczek•5/26/24, 2:58 PM

is it a good practice to store JSON as a value in KV? for example key:"user_123", value:"{"credits":15,email:"az@gmail.com"} ?

PPuliczek is it a good practice to store JSON as a value in KV? for example key:"user_123"...

Hello, I’m Allie!•5/26/24, 3:01 PM

Yeah, that's fine. In fact, when reading a value from KV, you can

await KV.get("key, "json")

await KV.get("key, "json")

to have KV automagically parse it for you

HHello, I’m Allie!Yeah, that's fine. In fact, when reading a value from KV, you can `await KV.get(...

Puliczek•5/26/24, 3:02 PM

cool, thanks

cosbgn•5/27/24, 11:05 AM

KV is giving me quite a bit of erorr

- Is there anything I can do? Is this normal?

cosbgn•5/27/24, 11:05 AM

for the past few weeks I get once/twice a day almost

raj.js•5/31/24, 8:19 PM

need a suggestion:
Need to have a counter but using kv can be an issue as its say only 1 write per second to same key. is there anyway around it? we need high frequent concurrent atleast 1000 writes per second (basically one write per read). is there anyway to do it using KV or have to go with redis like cache

Mrinank•5/31/24, 8:49 PM

Why kv doesn't work in typescript code. I am not getting error in js files, having problem with env in ts

MMrinank Why kv doesn't work in typescript code. I am not getting error in js files, havi...

Mrinank•5/31/24, 8:55 PM

Cannot read properties of undefined (reading 'put')

MMrinank Why kv doesn't work in typescript code. I am not getting error in js files, havi...

Matt Silverlock•6/2/24, 9:39 PM

Can you share the code, including how you have defined your bindings?

MMatt Silverlock Can you share the code, including how you have defined your bindings?

Mrinank•6/3/24, 7:29 PM

Its working now

Mrinank•6/3/24, 7:30 PM

sharing the code for others

name = "newcron"
main = "src/index.ts"
compatibility_date = "2024-05-29"


[triggers]
crons = ["* */12 * * *"]

[[kv_namespaces]]
binding = "KV"
id = "b6783170bcde4c6f9d9e6152dc8d1027"

[ai]
binding = "AI"

name = "newcron"
main = "src/index.ts"
compatibility_date = "2024-05-29"


[triggers]
crons = ["* */12 * * *"]

[[kv_namespaces]]
binding = "KV"
id = "b6783170bcde4c6f9d9e6152dc8d1027"

[ai]
binding = "AI"

AKStriker98•6/4/24, 10:06 PM

Is there a way to deal with the graveyard that is created from unread items being deleted by the TTL? Had about 5 GB of unread data expire and now we cannot get to the valid data with list because it’s stuck churning through the graveyard. We don’t want to delete and recreate the kv store since it’s tied to multiple apis inputting data to them and being read by workers

King Kazu•6/6/24, 4:48 AM

Im needing some help with kv fetching. I am using BetterKV for fetching a rarely-updated value (but pretty important to have latest value with semi-low latency). This value is actually stored in my db and passed into kv and cached for performance (i believe kv w/ caching is faster for global users but I need to still actually do performance testing). Ideally, I want the

cacheTtl

cacheTtl

and

kvCacheTtl

kvCacheTtl

to be high for low latency, but I dont want to have to wait for

kvCacheTtl

kvCacheTtl

to expire to fetch the updated value if needed. Am I thinking about this right and do I have to just bite the bullet and have low cache ttl values?

Rraj.js need a suggestion: Need to have a counter but using kv can be an issue as its sa...

Nob•6/6/24, 1:05 PM

go with redis

Rraj.js need a suggestion: Need to have a counter but using kv can be an issue as its sa...

Isaac McFadyen•6/6/24, 7:36 PM

KV isn't suited to a counter. KV is eventually consistent so you might not see updates at other locations for up to 60s, meaning your counter will easily fall behind/be invalid - for example, if I get + increment + set the counter, and you do it 15s later, you might not see my increment so it would be lost.

Isaac McFadyen•6/6/24, 7:36 PM

I'd recommend something like Durable Objects or Redis if you need consistency like a counter.

AstroDev•6/7/24, 2:45 PM

Hi - I'm thinking of using KV to debounce a webhook - is there a way to trigger a worker when a value with a TTL is deleted from KV?

AAstroDev Hi - I'm thinking of using KV to debounce a webhook - is there a way to trigger ...

thomasgauvin•6/7/24, 3:22 PM

What do you mean by this? It's not possible to trigger a worker when a value expires from TTL, but if you have more context around the problem I might be able to help come up with the right solution

Tthomasgauvin What do you mean by this? It's not possible to trigger a worker when a value exp...

AstroDev•6/7/24, 3:27 PM

Thanks Thomas - What I need to do is collect all webhook requests in a given X minute period - and emit one request. Just looking at Durable Objects - that has an alarm function - this sounds like a better option as I can schedule an alarm in future in X minutes?

thomasgauvin•6/7/24, 3:50 PM

Yes, Durable Objects seems like a better fit for the job, since you will be able to manage prior state (the calls you want to debounce) and hold/act upon the most recent event after debounce. I'm assuming here that you aren't able to debounce client side since the webhook is a feature you provide to your users?

Tthomasgauvin Yes, Durable Objects seems like a better fit for the job, since you will be able...

AstroDev•6/7/24, 3:58 PM

Yeah - this would be a nice feature to add to Pages - the ability to debounce the deployment hook for static sites - that are triggered by CMS save buttons. Some CMSes let you override the button to debouce it within the CMS some don't.

Is there documentation for this: import { DurableObject } from "cloudflare:workers";

Some examples on the CF site use it, some don't.

thomasgauvin•6/7/24, 4:27 PM

I don't have the answer for the import statement off the top of my head (the discrepancy might be something DO folks might be more aware of).

I DM'd you for more info about your setup, I'm curious how your users are using CMS', how you are using Pages, and then where you layer fits in

AKStriker98•6/7/24, 5:57 PM

Is there a way that a bulk get can be implemented for cloudflare KVs? Like in a way that can keep the limit but only require one call to limit the number of requests that are required to be sent for large data querying? For example, I want to create a bulk endpoint for a large number of lookups. Currently, my client is held up by making thousands of requests which are held up by browser limitations. If I can bundle them in say 200-300 requests to a bulk endpoint it would save my client very precious time

Eengrtitus It appears making an http request is faster than getting a record from kv. Our ...

Nob•6/7/24, 11:26 PM

yh kv seem slow, i removed it from my website and its faster now

Chaika•6/8/24, 7:45 PM

Well should be a fair bit faster if the key is cached/not having to pull from a central store

Eengrtitus It appears making an http request is faster than getting a record from kv. Our ...

Chaika•6/8/24, 7:48 PM

If you're just using KV as cache, you don't need to await the put to move onto your next action. You can do ctx.waitUntil(KV.put(...)); and it will not block the response and let it finish before killing the request context.

Kv only has two central stores (US, EU), so espec in some places like APAC cold reads will be expensive. If your API isn't that slow or expensive, you could consider just using the Cache API https://developers.cloudflare.com/workers/runtime-apis/cache/ to help out a bit, it's always going to be fast (only a few ms) and make sure to use waitUntil when putting into it as well to not have to block the client just for caching

name = "newcron" main = "src/index.ts" compatibility_date = "2024-05-29" [triggers] crons = ["* */12 * * *"] [[kv_namespaces]] binding = "KV" id = "b6783170bcde4c6f9d9e6152dc8d1027" [ai] binding = "AI"

The cache API is free

Similar Threads

Similar Threads

Similar Threads