We have quite a lot of users from Asia so the initial hits for those areas are pretty poor

ZZack We have quite a lot of users from Asia so the initial hits for those areas are p...

T

thomasgauvin•8/16/24, 12:42 PM

Got it, thanks for the feedback Zack, we'll make sure to consider this in future plannings but it is not on the roadmap at the moment

A

Andrei Zienko•8/18/24, 2:34 PM

Guys, something eats my money, something does 20 000 reads per minute due to "Account details
>Read operations" is there any way at least understand the name of problematic KV?
ideallly with name of worker?

I

Isaac McFadyen•8/18/24, 3:14 PM

@Andrei Zienko let's move here

I

Isaac McFadyen•8/18/24, 3:15 PM

I don't think KV has stats on which worker is making those reads unfortunately

I

Isaac McFadyen•8/18/24, 3:15 PM

~~I'm not even sure it has per-namespace analytics (I could be wrong)~~ The GraphQL API has per namespace analytics, but not which Worker is making those calls

A

Andrei Zienko•8/18/24, 3:16 PM

at least on per namespace ?

Otherwise, it can be situation that , due to my statistics I have 1000 requests per day
due to your statistics it will be 1 000 000, if it is free it is not a problem, but I already pay for it..

A

Andrei Zienko•8/18/24, 3:18 PM

GraphQL API ?
I will check thanks a lot, if you have information about the right name of metrics
for me name of namespace will be enough, I will just stop workers one buy one

IIsaac McFadyen I don't think KV has stats on which worker is making those reads unfortunately

A

Andrei Zienko•8/18/24, 3:34 PM

Isaac, where to ask about the right GraphQL section query for that?
I see GetWorkersAnalytics example, but if you start search with that keyword of Cloudflare documentation website you will see only this example, where to get the right sections and parameters? GraphQL is language of queries, but where to read about them?

AAndrei Zienko Isaac, where to ask about the right GraphQL section query for that? I see GetWor...

C

Chaika•8/18/24, 5:45 PM

kvOperationsAdaptiveGroups

kvOperationsAdaptiveGroups

You can use clients like GraphiQL to explore the schema, https://developers.cloudflare.com/analytics/graphql-api/getting-started/explore-graphql-schema/, there's also a community ran site mining the schema and displaying it:
https://cfdata.lol/graphql/#AccountKvOperationsAdaptiveGroups

GraphQL - Cloudflare Datamining

Discover Cloudflare's full GraphQL Schema

C

Chaika•8/18/24, 5:47 PM

example query to see request counts since 2024-08-01 per namespace

{
  viewer {
    accounts(filter: {accountTag: "<accountId, right of workers & pages dash>"}) {
     kvOperationsAdaptiveGroups(filter: { date_gt: "2024-08-01"}, limit: 100) {
      dimensions {
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<accountId, right of workers & pages dash>"}) {
     kvOperationsAdaptiveGroups(filter: { date_gt: "2024-08-01"}, limit: 100) {
      dimensions {
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<accountId, right of workers & pages dash>"}) {
     kvOperationsAdaptiveGroups(filter: { date_gt: "2024-08-01"}, limit: 100) {
      dimensions {
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<accountId, right of workers & pages dash>"}) {
     kvOperationsAdaptiveGroups(filter: { date_gt: "2024-08-01"}, limit: 100) {
      dimensions {
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

You'd get a response like

            {
              "dimensions": {
                "namespaceId": "b2a58c72fd564bc884d506f4c6c99fed"
              },
              "sum": {
                "requests": 82018
              }
            },
            {
              "dimensions": {
                "namespaceId": "1213472aad494c65b6b3c330aaae0b14"
              },
              "sum": {
                "requests": 327
              }
            },
            {
              "dimensions": {
                "namespaceId": "c6a6c055efd741ccacee9916533e80da"
              },
              "sum": {
                "requests": 1214719
              }

            {
              "dimensions": {
                "namespaceId": "b2a58c72fd564bc884d506f4c6c99fed"
              },
              "sum": {
                "requests": 82018
              }
            },
            {
              "dimensions": {
                "namespaceId": "1213472aad494c65b6b3c330aaae0b14"
              },
              "sum": {
                "requests": 327
              }
            },
            {
              "dimensions": {
                "namespaceId": "c6a6c055efd741ccacee9916533e80da"
              },
              "sum": {
                "requests": 1214719
              }

            {
              "dimensions": {
                "namespaceId": "b2a58c72fd564bc884d506f4c6c99fed"
              },
              "sum": {
                "requests": 82018
              }
            },
            {
              "dimensions": {
                "namespaceId": "1213472aad494c65b6b3c330aaae0b14"
              },
              "sum": {
                "requests": 327
              }
            },
            {
              "dimensions": {
                "namespaceId": "c6a6c055efd741ccacee9916533e80da"
              },
              "sum": {
                "requests": 1214719
              }

            {
              "dimensions": {
                "namespaceId": "b2a58c72fd564bc884d506f4c6c99fed"
              },
              "sum": {
                "requests": 82018
              }
            },
            {
              "dimensions": {
                "namespaceId": "1213472aad494c65b6b3c330aaae0b14"
              },
              "sum": {
                "requests": 327
              }
            },
            {
              "dimensions": {
                "namespaceId": "c6a6c055efd741ccacee9916533e80da"
              },
              "sum": {
                "requests": 1214719
              }

CChaika `kvOperationsAdaptiveGroups` You can use clients like GraphiQL to explore the sc...

A

Andrei Zienko•8/19/24, 5:55 AM

Thanks, a lot
after the night without sleep I have done this by myself,
please add to documentation that JetBrains' Idea' Graphql client also works and also allow to discover schema, I've spend near 2 hours by searching the right client which will show me the schema

A

Andrei Zienko•8/19/24, 1:08 PM

Good day, yesterday I've posted my request about unusual KV read operations, I've spent this night trying to understand how to use GraphQL API, I've found problematic KV
I've fixed I think all, despite that I still see 8 million requests per 2 hours.
The situation looks crazy, is there any way to detect whi worker write a lot? Does somebody knows what to do?
My worker's statistics show less than thousand reqests per hour, not 8 millions

A

Andrei Zienko•8/19/24, 1:10 PM

Additionally cloudflare dashboard now unavaliable, but I see requests in GraphqlAnalytics API
the number of requests is so high that I am afraid I can not pay for them

A

Andrei Zienko•8/19/24, 1:20 PM

I can not write to support because dashboard does not work, is there any other way?

T

thomasgauvin•8/19/24, 1:30 PM

Hey Andrei! You've found the GraphQL API before we've officially unveiled it, we'll be adding to our docs shortly!

T

thomasgauvin•8/19/24, 1:31 PM

Regarding your ask for how to get the Worker that is making the request to the KV storage, that's not something that we have in terms of information. The recommendation here would be to add logging in your Worker, or perhaps onboard your Worker onto baselime to understand the subrequests being made

A

Andrei Zienko•8/19/24, 1:38 PM

I have all the statistics
I have 1000 requests per hour
due to cloudflare it is more than 8 000 000, I need help
I need to stop somthing, I don't know what...

A

Andrei Zienko•8/19/24, 1:38 PM

due to all my worker's statistics I don't have high traffic at all

T

thomasgauvin•8/19/24, 2:07 PM

The dashboard should be working to create a support ticket. Have you identified which KV namespace is getting the request load?

A

Andrei Zienko•8/19/24, 2:48 PM

yes, identified

A

Andrei Zienko•8/19/24, 2:48 PM

f39497e903f8434186e30c8025391826

A

Andrei Zienko•8/19/24, 2:49 PM

Can not create ticket, it does not work

AAndrei Zienko Can not create ticket, it does not work

I

Isaac McFadyen•8/19/24, 2:52 PM

Can you give the specific error it's giving you when trying to create a ticket?

A

Andrei Zienko•8/19/24, 2:55 PM

A

Andrei Zienko•8/19/24, 2:55 PM

C

Chaika•8/19/24, 2:56 PM

try different browser/clear cache? That happens on any load of the dashboard from any page?

A

Andrei Zienko•8/19/24, 2:57 PM

it is started today in the morning
this happened any load

A

Andrei Zienko•8/19/24, 2:57 PM

My location is Tel Aviv

A

Andrei Zienko•8/19/24, 3:22 PM

Now I've duplicated this KV and moved my workers to use it

A

Andrei Zienko•8/19/24, 3:24 PM

really this crazy counter stopped
I've just duplicated KV, but what was that?

AAndrei Zienko really this crazy counter stopped I've just duplicated KV, but what was that?

M

Matt Silverlock•8/19/24, 5:50 PM

Without seeing your code or more details, we can't provide hard data. Are you reading KV on every request? Once? More than once? Was your site being crawled? Are you interacting with the REST API? etc.

A

Andrei Zienko•8/19/24, 7:05 PM

I read KV from Durable objects in 99%
for now it looks like with the same code, but after duplicating KV and changing binding to new one and deleting old namespace the counter stopped to rise

A

Andrei Zienko•8/19/24, 7:53 PM

Guys, the problem still exists, I've deleted KV, but due to GraphQL Api, the counter continue to increase..
{
"dimensions": {
"namespaceId": "00000000000000000000000000000000"
},
"sum": {
"requests": 19378341
}
}
]

and this 19378341 is higher than it was half an hour ago..

J

James Eastham•8/23/24, 5:03 PM

Hey everyone, is there any way to react to a key expiring in KV? Almost like change data capture so I can run some code on expiry

JJames Eastham Hey everyone, is there any way to react to a key expiring in KV? Almost like cha...

H

Hello, I’m Allie!•8/23/24, 5:15 PM

There is not, no. Though you could trigger some code yourself when you do a write?

HHello, I’m Allie!There is not, no. Though you could trigger some code yourself when you do a writ...

I

Isaac McFadyen•8/23/24, 5:15 PM

I think they specifically want expiry, not write?

J

James Eastham•8/23/24, 5:17 PM

Yeah, specifically on expiry is what I was looking for.

H

Hello, I’m Allie!•8/23/24, 5:29 PM

Oh…

JJames Eastham Yeah, specifically on expiry is what I was looking for.

H

Hello, I’m Allie!•8/23/24, 5:30 PM

Don’t add a TTL, but instead use a DO Alarm that also calls the expiry handler?

J

James Eastham•8/23/24, 5:37 PM

Oooo, I did not know DO alarms existed, but yes this looks like exactly what I need

J

Jando•8/25/24, 3:59 AM

Hey has anyone gotten the KV's to work for the nuxt app without using nuxthub?

J

Jando•8/25/24, 3:59 AM

https://developers.cloudflare.com/pages/framework-guides/deploy-a-nuxt-site/

Cloudflare Docs

Nuxt | Cloudflare Pages docs

Web framework making Vue.js-based development simple and powerful.

J

Jando•8/25/24, 3:59 AM

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

export default defineEventHandler(async ({ context }) => {
    console.log(context)
    console.log(context.cloudflare)
    console.log('-=-==-=-=-=-=-s')
    console.log(context.cloudflare.env)
    console.log("HERE")
    const ARCKV = context.cloudflare.env.ARCKV;

    const kvList = await context.cloudflare.env.ARCKV.list();
    const value = await context.cloudflare.env.ARCKV.get("123");
    const save = await context.cloudflare.env.ARCKV.set('Testing', "5678")

    console.log(save)

    console.log(kvList)
    console.log(value)

    let full_obj = await ARCKV.list()

    console.log(full_obj)

    console.log("BEFORE KV")
    console.log(ARCKV)
  
    return kvList;
  });

J

Jando•8/25/24, 4:00 AM

I can list an get but theres nothing in the response I checked the wrangler config etc Im not sure if theirs something extra I need to do for pages

J

Jando•8/25/24, 4:00 AM

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

import {
  CfProperties,
  Request,
  ExecutionContext,
  KVNamespace,
} from "@cloudflare/workers-types";

declare module "h3" {
  interface H3EventContext {
    cf: CfProperties;
    cloudflare: {
      request: Request;
      env: {
        ARCKV: KVNamespace;
      };
      context: ExecutionContext;
    };
  }
}

J

Jando•8/25/24, 4:01 AM

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

✨ Compiled Worker successfully
Your worker has access to the following bindings:
- KV Namespaces:
  - ARCKV: ---------hidden but there --------
[wrangler:inf] Ready on http://localhost:8788
⎔ Starting local server...
✨ Parsed 0 valid redirect rules.
✨ Parsed 3 valid header rules.
[wrangler:inf] GET / 200 OK (32ms)

J

Jando•8/25/24, 4:01 AM

It seems to be initnalized aswell anyone know what could be going on here?

J

Jando•8/25/24, 4:39 AM

I figured it out by reading throught the plugins docs it these ones should be updated to include you need to process like this

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

export default eventHandler(async (event) => {
const { ARCKV } = event.context.cloudflare.env;

console.log(ARCKV)
let test = await ARCKV.list()
console.log(test)

let ctr = (await ARCKV.get("counter")) || 0;
await ARCKV.put("counter", ++ctr % 100);

return `counter: ${(await ARCKV.get("counter")) || 0}`;
});

J

Jando•8/25/24, 4:39 AM

you cant use the context as listed on the wrangler docs!

We have quite a lot of users from Asia so the initial hits for those areas are pretty poor

Similar Threads