Hey everyone, is there any way to react to a key expiring in KV? Almost like change data capture so

JJames Eastham Hey everyone, is there any way to react to a key expiring in KV? Almost like cha...

H

Hello, I’m Allie!•8/23/24, 5:15 PM

There is not, no. Though you could trigger some code yourself when you do a write?

HHello, I’m Allie!There is not, no. Though you could trigger some code yourself when you do a writ...

I

Isaac McFadyen•8/23/24, 5:15 PM

I think they specifically want expiry, not write?

J

James EasthamOP•8/23/24, 5:17 PM

Yeah, specifically on expiry is what I was looking for.

H

Hello, I’m Allie!•8/23/24, 5:29 PM

Oh…

JJames Eastham Yeah, specifically on expiry is what I was looking for.

H

Hello, I’m Allie!•8/23/24, 5:30 PM

Don’t add a TTL, but instead use a DO Alarm that also calls the expiry handler?

J

James EasthamOP•8/23/24, 5:37 PM

Oooo, I did not know DO alarms existed, but yes this looks like exactly what I need

J

Jando•8/25/24, 3:59 AM

Hey has anyone gotten the KV's to work for the nuxt app without using nuxthub?

J

Jando•8/25/24, 3:59 AM

https://developers.cloudflare.com/pages/framework-guides/deploy-a-nuxt-site/

Cloudflare Docs

Nuxt | Cloudflare Pages docs

Web framework making Vue.js-based development simple and powerful.

J

Jando•8/25/24, 3:59 AM

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

J

Jando•8/25/24, 4:00 AM

I can list an get but theres nothing in the response I checked the wrangler config etc Im not sure if theirs something extra I need to do for pages

J

Jando•8/25/24, 4:00 AM

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

J

Jando•8/25/24, 4:01 AM

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

J

Jando•8/25/24, 4:01 AM

It seems to be initnalized aswell anyone know what could be going on here?

J

Jando•8/25/24, 4:39 AM

I figured it out by reading throught the plugins docs it these ones should be updated to include you need to process like this

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

J

Jando•8/25/24, 4:39 AM

you cant use the context as listed on the wrangler docs!

J

Jadugar_Jaggu•8/25/24, 7:04 AM

got a KV GET Failed : 500 internal Server error 4 minute ago

C

Corentin•8/25/24, 2:35 PM

Hi there!
When keys are removed due to TTL expiration using the

expirationTtl

expirationTtl

option, do those removals count toward the delete request quota ?
Thanks!

C

clew•8/26/24, 11:02 AM

Hello all!

I'm encountering a very strange issue. When I try to list my keys using

c.env.<binding>.list()

c.env.<binding>.list()

, I can see the keys listed in the terminal as expected. However, when I attempt to list the keys directly from the terminal, the namespace appears completely empty—no keys are returned. I also checked the Cloudflare dashboard, and it's showing the same issue: the namespace is empty.

Has anyone else experienced this? Any idea why this might be happening?

W

Walshy•8/26/24, 11:07 AM

Local vs prod

W

Walshy•8/26/24, 11:07 AM

You're running dev locally so all storage is local, it doesn't exist in prod -- this is so you can safely dev your app without impacting production data

W

Walshy•8/26/24, 11:07 AM

The command (and ofc the dash) show production data not local

WWalshy You're running dev locally so all storage is local, it doesn't exist in prod -- ...

C

clew•8/26/24, 11:09 AM

Ahh that makes sense! Pretty new to cloudflare so did not know that. Thank you! :)

T

thomasgauvin•8/26/24, 1:23 PM

@Arvind you can pass the --local=true parameter to wrangler to access the local values as well! https://developers.cloudflare.com/workers/wrangler/commands/#list-4

Cloudflare Docs

Commands | Cloudflare Workers docs

Create, develop, and deploy your Cloudflare Workers with Wrangler commands.

Tthomasgauvin @Arvind you can pass the --local=true parameter to wrangler to access the local ...

C

clew•8/26/24, 3:12 PM

Oh perfect, thank you!

W

willin•8/30/24, 3:43 AM

kv read operations seeems weird. how to figure it out?

Wwillin kv read operations seeems weird. how to figure it out?

C

Chaika•8/30/24, 11:57 PM

There's not really a tied relation between Worker Requests and KV Requests if that's what you're confused about, KV can be used via the API directly and Workers can do up to 1,000 in-house requests to KV even on free afaik.
As for discovering what specifically is using KV operations, I would guess it's a worker and would go over your workers using KV.
The Cloudflare GraphQL API can you show how many operations are being done per namespace/scope you down to namespace: https://developers.cloudflare.com/analytics/graphql-api/getting-started/authentication/graphql-client-headers/ but not any closer/not to exact worker

W

willin•8/31/24, 2:32 PM

is there an example query schema?

W

willin•8/31/24, 3:50 PM

which one

Wwillin which one

C

Cyb3r-Jak3•8/31/24, 4:10 PM

Neither. I forget the actual name but it is something like kvOperationsAdaptiveGroup

C

Chaika•8/31/24, 6:11 PM

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

something like that to see most requests by namespace

0

0x7d8•9/1/24, 9:16 AM

basically I want to have an integer in d1 be incremented on each request to a specific endpoint, would it be possible to use kv to temporarily store how much needs to be added and then add it on a schedule? if so would that globally work since kv is local on the machine to my knowledge?

Wwillin kv read operations seeems weird. how to figure it out?

A

a4amaan•9/3/24, 9:48 AM

getting same issue

B

birdfly•9/3/24, 10:19 AM

Hello
I frequently encounter code 971 issues while using KV. Could you please clarify what specific limitation this refers to? How can I adjust to reduce the occurrence of this problem?⬤

K

katopz•9/4/24, 7:24 AM

How can I

wrangler kv key get

wrangler kv key get

from local disk? as i recall it has persist flag or something

Kkatopz How can I `wrangler kv key get` from local disk? as i recall it has persist flag...

H

Hello, I’m Allie!•9/4/24, 7:45 AM

—local

—local

?

HHello, I’m Allie!`—local`?

K

katopz•9/4/24, 7:49 AM

10 point for gryffindor! is it undoc? i can't find things

K

katopz•9/4/24, 7:50 AM

https://developers.cloudflare.com/kv/reference/kv-commands/#get

K

katopz•9/4/24, 7:52 AM

but cli seem to have it

Kkatopz https://developers.cloudflare.com/kv/reference/kv-commands/#get

T

thomasgauvin•9/4/24, 3:25 PM

PR incoming! https://github.com/cloudflare/cloudflare-docs/pull/16400

GitHub

[KV] Wrangler-KV Command Update by Oxyjun · Pull Request #16400 · c...

Summary

Continuation of the PR from: #15985
TLDR of this current PR:

Centralising Wrangler-KV commands into partials/workers/wrangler-commands/kv.mdx. This is the single source of truth for Wrang...

Tthomasgauvin PR incoming! https://github.com/cloudflare/cloudflare-docs/pull/16400

K

katopz•9/4/24, 3:32 PM

Thanks, that should save someone an hour

. Actually it should able to auto generate/update from a cli. Maybe we could automate that somehow

K

katopz•9/4/24, 3:34 PM

Oh we can actually use llm to do just that + function call to made a PR, nice idea for next hackathon

Kkatopz Oh we can actually use llm to do just that + function call to made a PR, nice id...

H

Hard@Work•9/4/24, 3:45 PM

AI Hallucinates

--remocal

--remocal

, which tests in local/remote 50% of the time

H

Hard@Work•9/4/24, 3:45 PM

You just have to guess

X

xiaolong01•9/5/24, 5:15 PM

Hi Cloudflare team,

I'm experiencing an issue with KV read operations and would like some clarification. In my project hosted on Cloudflare Pages, we have around 500k total visits, and within those, about 70k subrequests. However, I'm seeing an unexpectedly high number of KV read operations – specifically 13,919,754 reads – despite only storing around 20 items in the KV namespace and querying them by key.

I've checked my code, and it doesn't seem like there are any duplicate KV reads. The number of reads is way higher than what I would expect from our traffic. Could this be related to caching behavior, strong consistency, or something else I'm missing?

Any insights into how KV reads are calculated in this scenario would be greatly appreciated!

Thank you in advance for your help.

Xxiaolong01 Hi Cloudflare team, I'm experiencing an issue with KV read operations and would...

A

a4amaan•9/5/24, 5:59 PM

i got the same issue, and reported... i got answer that it is a small bug under resolution... and this high KV read is not currently impacting billing...
kv

T

thomasgauvin•9/5/24, 6:07 PM

Hi @xiaolong01 and @a4amaan, that is correct, there is currently a bug in the dashboard & GraphQL API that is displaying higher metrics than what is accounted on your KV namespaces. We are working on a fix. This does not affect billing.

Tthomasgauvin Hi @xiaolong01 and @a4amaan, that is correct, there is currently a bug in the da...

C

Chaika•9/5/24, 6:10 PM

Hey Thomas

Just to confirm, this wouldn't impact billing at all, and anyone effected doesn't need to ticket billing to get their bill adjusted or anything like that?

T

thomasgauvin•9/5/24, 6:10 PM

Correct (edited in line)

T

thomasgauvin•9/5/24, 8:05 PM

This has been resolved now!

Z

Zack•9/11/24, 11:52 AM

Hey, trying to write some data to KV with a script I have used previously without issue, now seeing occasional 502 responses through from the API. Is there a current ongoing issue causing this?

Hey everyone, is there any way to react to a key expiring in KV? Almost like change data capture so

Similar Threads