Any issues with KV right now ? Our sites are down. Not able to access data

Our KV store is unaccessible and CF is returning errors even from the console to retrieve values.
25 Replies
ddsgadget
ddsgadget•5mo ago
same here. KV is obviously down. Cloudflare dashboard doesn't work. unfortunately, nothing in the status page at all
Chaika
Chaika•5mo ago
yup, they're working on it/is known, #kv
gruntlord6
gruntlord6•5mo ago
Cloudflare Status
Welcome to Cloudflare's home for real-time and historical data on system performance.
gruntlord6
gruntlord6•5mo ago
they updated the page to show there are auth issues
Taesu
Taesu•5mo ago
something is definitely off right now.
echowin - Kaushal
echowin - Kaushal•5mo ago
Half of the internet is down including Google Cloud.
Jameson
Jameson•5mo ago
its still down for me what happened did something cut a seafloor cable?
zehawk
zehawk•5mo ago
Unfortunately cloudflare always claims "intermittent failures" - even when we are getting reports from our customers around the world.
Jameson
Jameson•5mo ago
its a big failure but its also google not just cluodflare something big got broke
Chaika
Chaika•5mo ago
?gcp-outage
SuperHelpflare
SuperHelpflare•5mo ago
There is an ongoing GCP outage affecting Cloudflare, Discord, and many other services. Any issues you are seeing are likely because of this. You can follow the Cloudflare-specific impact here: https://www.cloudflarestatus.com/incidents/25r9t0vz99rp
zehawk
zehawk•5mo ago
Welcome to Friday the 13th
Chaika
Chaika•5mo ago
sir today is the 12th lol
Jameson
Jameson•5mo ago
damn well i give up for now guys gonna sleep and try again tomorrow
Chaika
Chaika•5mo ago
it should be recovering now
zehawk
zehawk•5mo ago
Is everyone in the world in your TZ? 🤷
Luciano
LucianoOP•5mo ago
Down for over an hour now
Chaika
Chaika•5mo ago
it is in utc
Jameson
Jameson•5mo ago
i feel bad for the intern that caused this crash
Chaika
Chaika•5mo ago
hmm, anything in specific? CF noted stuff should be recovering and personally I see way less errors (if any) from KV and such
zehawk
zehawk•5mo ago
KV is utterly not working "500 Internal Server Error"
CalBoy
CalBoy•5mo ago
still cooked for me
Chaika
Chaika•5mo ago
ahh yea KV uncached is still super high errors. D1 looks way better but their errors was transient from the start, still very much recovering, ouch GCP said
All locations except us-central1 have fully recovered. us-central1 is mostly recovered. We do not have an ETA for full recovery in us-central1.
so hopefully not too much longer CF last posted something similarly optimistic on their page
We are starting to see services recover. We still expect to see intermittent errors across the impacted services as systems handle retried and caches are filled.
KV's starting to actually recover now uncached
Luciano
LucianoOP•5mo ago
Is KV data ultimately stored at GCP ?
Chaika
Chaika•5mo ago
I don't believe that is something Cloudflare has stated publicly anywhere They document some of the infra: https://developers.cloudflare.com/kv/concepts/how-kv-works/, namely "two central stores" and caching on their end at every colo, and the rest is untold

Did you find this page helpful?