I have some follow up questions for the same, can I DM you?
I have some follow up questions for the same, can I DM you?
T
TOf course! DMs always open
AHi, I'm having some trouble expiring keys in KV, I'm using Rust and it's an open source project so you can see I set it here https://github.com/aquarhead/nextgame/blob/master/src/lib.rs#L502 I just enabled logs and according to it I should have set an example object to expire at 19:20 UTC (10min ago)
But it's still there even now. Am I missing something apparent here? (This seems to work correctly locally in dev mode)
But it's still there even now. Am I missing something apparent here? (This seems to work correctly locally in dev mode)
GitHub
Who's playing?! Contribute to aquarhead/nextgame development by creating an account on GitHub.
AThe
Game should not exist after 19:20
Chey there.
I'm having two workers - one serving astro and another as a service auth worker
getting this response type when calling the service worker: ProxyStub { name: 'Object', poisoned: false }
I'm having two workers - one serving astro and another as a service auth worker
getting this response type when calling the service worker: ProxyStub { name: 'Object', poisoned: false }
Cstill, the response in the service worker (the user object) comes fine from the KV
Coh it looks i have to stringify when i'm getting the object
Swhere did you get the 16k record limit for DO sqlite? I've got like 4MB in there and def more than 16k records
DWe are suddenly experiencing a significant latency when updating a value in the KV. We are experiencing something like 30 seconds latency. Is there some known problem in the datacenter?
AI am having the same issue
DSo is this a known problem at Cloudflare? This causes big issues in our application
ADoesn't seem so, nothing on their status page
DYeah saw that too
Abut I think generally write latency can be up to a minute
but it usually isn't
but it usually isn't
DYeah it's usually more or less instant
DAre US or Europe your nearest location? Seems that cloudflare kv storage location is primarily in US and Europe. Maybe the one in Europe is down and rerouted to US, that would explain the issue
DBut would be good to get some input from Cloudflare
AI am in europe but I respond to discord interactions (for a discord bot) which might not come from europe
D
IWe are seeing the same latency spikes. Actually came here because there was no update on the status page.
JI'd like to flag this to the KV team - can you let us know whether you're using REST APIs or Binding APIs?
AI am using the binding API. I would also like to add that it's not only latency. For me in some cases the values are never written.
DBinding API here also. We noticed the problem this morning, about 6 hours ago.
JThanks both, I've passed on all the info to the KV engineering. Hopefully someone with more domain knowledge from CF will pick this up when they see this 
IJust to confirm that it doesn't look like isulated case we are seeing this on multiple deployments across regions.
TThanks everyone, we're looking into this
T@danielsundq @ivogt @Anthony can you share in this thread since when you've been encountering these issues?
II believe it started after 8:00 UTC yesterday. Speculating on the timing but definately wasn't there the day before. Also we haven't had such problems for months.
IPossibley somethig that happend in the afternoon as we started noticing past 12:00 UTC .
DWe detected the problem this morning, about 06:00 UTC. I don't think it was a problem the day before, because this latency causes big issues with our applications and we didn't notice anything the day before
TCan you all DM me your Workers account id and KV namespace id
L
GitHub
Eventual-consistent key-value data storage based on Workers KV - LuKks/workers-kv
AI just read: https://blog.cloudflare.com/how-we-built-cloudflare-queues/
Also the part "Workers KV acts as a fast metadata store: our Worker can quickly look up the shard map to perform load balancing across shards"
How can they use KV for that, as KV has a 60 second delay to update after writing? Won't the entire infrastructure have a 60 second delay to understand what the state is and how would the be able to update that state?
Also the part "Workers KV acts as a fast metadata store: our Worker can quickly look up the shard map to perform load balancing across shards"
How can they use KV for that, as KV has a 60 second delay to update after writing? Won't the entire infrastructure have a 60 second delay to understand what the state is and how would the be able to update that state?
The Cloudflare Blog
Learn how we built Cloudflare Queues using our own Developer Platform and how it evolved to a geographically-distributed, horizontally-scalable architecture built on Durable Objects. Our new architecture supports over 10x more throughput and over 3x lower latency compared to the previous version.
PI wrote a Cloudflare KV wrapper! I'd love feedback and if you'd add/remove things, including things that are not clear or could be improved (to the library overall or the KV workers bit). I almost did it with the REST API (to avoid having to init it within the
https://polystore.dev/documentation#cloudflare-kv
fetch()namespace_idaccount_idnamespace_idBearer tokenhttps://polystore.dev/documentation#cloudflare-kv
Add a unified API for any KV store like localStorage, Redis, FileSystem, etc.
GHey, just a general question, is KV appropriate for creating a authorization layer in my application created using worker?
I think we are okay with the eventual consistency of KV as long as it's under a minute or two.
The KV will be responsible for storing the data and we will create our own logic.
I am pretty much a noob when it comes to AuthZ, so is there a better solution with cloudflare worker? I am okay with a SaaS or an open source solution if available. Thank you.
I think we are okay with the eventual consistency of KV as long as it's under a minute or two.
The KV will be responsible for storing the data and we will create our own logic.
I am pretty much a noob when it comes to AuthZ, so is there a better solution with cloudflare worker? I am okay with a SaaS or an open source solution if available. Thank you.
BAny reason why you wouldn’t use d1/serverless database?
Ussssuuaaallllyyyyyy KV stores are meant to be for value caches rather than persistent stores of data.
As in, if you wiped the KV cache, your application would just fill it up again next time around.
(Note: I’m wicked new to the Cloudflare hosted services, but 15 years of other services)
Ussssuuaaallllyyyyyy KV stores are meant to be for value caches rather than persistent stores of data.
As in, if you wiped the KV cache, your application would just fill it up again next time around.
(Note: I’m wicked new to the Cloudflare hosted services, but 15 years of other services)
GI hadnt looked into it. The reason KV caught my eyes was because of its low latency and similarities to redis. Thank you for the suggestion
T@good_for_nothing KV is persistent storage, using KV as an authorization layer is definitely a good use case, lots of folks use KV for storing nosql data such as allow/deny lists, auth lists, a/b testing groups, other configuration.
SI recently re-read the "How KV works" article and wanted to flag this up from the article:
KV is not ideal for applications where you need support for atomic operations or where values must be read and written in a single transaction.In that regard I agree authorization is a good candidate, however lots of developers likely get it confused with authentication and session management — KV might not be a good case for sessions due to it being eventually-consistent. Thoughts I'd bring this up since I have had people on the team ask similar questions.
TThat's correct, if you need consistent access to your data today, you're better off using another service. However, @good_for_nothing noted
I think we are okay with the eventual consistency of KV as long as it's under a minute or two.On this topic, we're actually currently looking to provide consistent reads in Workers KV to give you more flexibility in how you use KV, if you're interested, please let us know your use case in this thread or DM me!
SSo KV will turn more like, um, Redis server rather than a Redis cluster, with strong atomic guarantees?
Alooking for advice - i'm hoping to build a dynamic redirector for an internal tool.
so, staging.example.com -> pr-123.example.workers.dev
so, staging.example.com -> pr-123.example.workers.dev
Awhat might be a good way to implement this? i'm thinking of a small worker that acts like a transparent proxy, and the proxy URL would be stored in a KV value
Athe idea is we'd be able to dynamically change the redirect on the fly, like /preview 123
Aand it'd work ~immediately after
Ai guess another alternative would be creating a Single Redirect rule via the cloudfalre REST API
BWhy not just modify dns to CNAME to the worker of your choice?
HAssuming that both are on CF, then you can’t just CNAME them
