which one

Wwillin which one

C

Cyb3r-Jak3•8/31/24, 4:10 PM

Neither. I forget the actual name but it is something like kvOperationsAdaptiveGroup

C

Chaika•8/31/24, 6:11 PM

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

{
  viewer {
    accounts(filter: {accountTag: "<AccctId>"}) {
     kvOperationsAdaptiveGroups(filter: {date_gt: "2024-08-30", actionType: "read" }, limit: 100, orderBy: [ sum_requests_DESC ]) {
      dimensions {
        actionType
        namespaceId
      }
      sum {
        requests
      }
  
      }
    }
  }
}

something like that to see most requests by namespace

0

0x7d8•9/1/24, 9:16 AM

basically I want to have an integer in d1 be incremented on each request to a specific endpoint, would it be possible to use kv to temporarily store how much needs to be added and then add it on a schedule? if so would that globally work since kv is local on the machine to my knowledge?

Wwillin kv read operations seeems weird. how to figure it out?

A

a4amaan•9/3/24, 9:48 AM

getting same issue

B

birdfly•9/3/24, 10:19 AM

Hello
I frequently encounter code 971 issues while using KV. Could you please clarify what specific limitation this refers to? How can I adjust to reduce the occurrence of this problem?⬤

K

katopz•9/4/24, 7:24 AM

How can I

wrangler kv key get

wrangler kv key get

from local disk? as i recall it has persist flag or something

Kkatopz How can I `wrangler kv key get` from local disk? as i recall it has persist flag...

H

Hello, I’m Allie!•9/4/24, 7:45 AM

—local

—local

?

HHello, I’m Allie!`—local`?

K

katopz•9/4/24, 7:49 AM

10 point for gryffindor! is it undoc? i can't find things

K

katopz•9/4/24, 7:50 AM

https://developers.cloudflare.com/kv/reference/kv-commands/#get

K

katopz•9/4/24, 7:52 AM

but cli seem to have it

Kkatopz https://developers.cloudflare.com/kv/reference/kv-commands/#get

T

thomasgauvin•9/4/24, 3:25 PM

PR incoming! https://github.com/cloudflare/cloudflare-docs/pull/16400

GitHub

[KV] Wrangler-KV Command Update by Oxyjun · Pull Request #16400 · c...

Summary

Continuation of the PR from: #15985
TLDR of this current PR:

Centralising Wrangler-KV commands into partials/workers/wrangler-commands/kv.mdx. This is the single source of truth for Wrang...

Tthomasgauvin PR incoming! https://github.com/cloudflare/cloudflare-docs/pull/16400

K

katopz•9/4/24, 3:32 PM

Thanks, that should save someone an hour

. Actually it should able to auto generate/update from a cli. Maybe we could automate that somehow

K

katopz•9/4/24, 3:34 PM

Oh we can actually use llm to do just that + function call to made a PR, nice idea for next hackathon

Kkatopz Oh we can actually use llm to do just that + function call to made a PR, nice id...

H

Hard@Work•9/4/24, 3:45 PM

AI Hallucinates

--remocal

--remocal

, which tests in local/remote 50% of the time

H

Hard@Work•9/4/24, 3:45 PM

You just have to guess

X

xiaolong01•9/5/24, 5:15 PM

Hi Cloudflare team,

I'm experiencing an issue with KV read operations and would like some clarification. In my project hosted on Cloudflare Pages, we have around 500k total visits, and within those, about 70k subrequests. However, I'm seeing an unexpectedly high number of KV read operations – specifically 13,919,754 reads – despite only storing around 20 items in the KV namespace and querying them by key.

I've checked my code, and it doesn't seem like there are any duplicate KV reads. The number of reads is way higher than what I would expect from our traffic. Could this be related to caching behavior, strong consistency, or something else I'm missing?

Any insights into how KV reads are calculated in this scenario would be greatly appreciated!

Thank you in advance for your help.

Xxiaolong01 Hi Cloudflare team, I'm experiencing an issue with KV read operations and would...

A

a4amaan•9/5/24, 5:59 PM

i got the same issue, and reported... i got answer that it is a small bug under resolution... and this high KV read is not currently impacting billing...
kv

T

thomasgauvin•9/5/24, 6:07 PM

Hi @xiaolong01 and @a4amaan, that is correct, there is currently a bug in the dashboard & GraphQL API that is displaying higher metrics than what is accounted on your KV namespaces. We are working on a fix. This does not affect billing.

Tthomasgauvin Hi @xiaolong01 and @a4amaan, that is correct, there is currently a bug in the da...

C

Chaika•9/5/24, 6:10 PM

Hey Thomas

Just to confirm, this wouldn't impact billing at all, and anyone effected doesn't need to ticket billing to get their bill adjusted or anything like that?

T

thomasgauvin•9/5/24, 6:10 PM

Correct (edited in line)

T

thomasgauvin•9/5/24, 8:05 PM

This has been resolved now!

Z

Zack•9/11/24, 11:52 AM

Hey, trying to write some data to KV with a script I have used previously without issue, now seeing occasional 502 responses through from the API. Is there a current ongoing issue causing this?

N

Noil•9/11/24, 1:40 PM

My application accesses files from the KV-store and have been running into the issue that specifc files cannot be found but they are clearly in the store when checking through the web dashboard.

Specificly it has happened to

/lib/config-DMEbaV5l.js

/lib/config-DMEbaV5l.js

every other files seems to work perfectly fine

M

Mozzy•9/11/24, 5:45 PM

What's the highest cacheTtl allowed for

.get()

.get()

?

M

Mozzy•9/11/24, 6:01 PM

Also, editing KV entries in the dashboard is a horrendous experience. Editing a single KV key seems to refresh the entire view for about 5 seconds, preventing me from editing others during that time.

Looking at the requests, it's refetching every single visible entry once I change one of them

Ssilentdevnull There away to delete all records from a kv database or do I just have to do the...

M

Mozzy•9/12/24, 7:53 PM

Can always delete the database I suppose

MMozzy Also, editing KV entries in the dashboard is a horrendous experience. Editing a ...

T

thomasgauvin•9/12/24, 11:25 PM

Thanks for feedback, noting this down as something to fix

M

Mozzy•9/12/24, 11:26 PM

Awesome

Ssilentdevnull There away to delete all records from a kv database or do I just have to do the...

T

thomasgauvin•9/12/24, 11:26 PM

Like Mozzy said, delete the database or delete them one by one. What’s the context?

D

Denver James Duran•9/13/24, 12:37 PM

Hello team, just a suggestion, maybe if it would be better if we remove the first part cause it somehow causes an error with toml reader... or perhaps its just my vscode extension..

Additional properties are not allowed ('kv_namespaces' was unexpected)Even Better TOML

Additional properties are not allowed ('kv_namespaces' was unexpected)Even Better TOML

# Here.. remove this part vvv
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  

# Here.. remove this part ^^^
# or

[[kv_namespaces]]
binding = "<BINDING_NAME1>"
id = "<NAMESPACE_ID1>"

[[kv_namespaces]]
binding = "<BINDING_NAME2>"
id = "<NAMESPACE_ID2>"

# Here.. remove this part vvv
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  

# Here.. remove this part ^^^
# or

[[kv_namespaces]]
binding = "<BINDING_NAME1>"
id = "<NAMESPACE_ID1>"

[[kv_namespaces]]
binding = "<BINDING_NAME2>"
id = "<NAMESPACE_ID2>"

# Here.. remove this part vvv
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  

# Here.. remove this part ^^^
# or

[[kv_namespaces]]
binding = "<BINDING_NAME1>"
id = "<NAMESPACE_ID1>"

[[kv_namespaces]]
binding = "<BINDING_NAME2>"
id = "<NAMESPACE_ID2>"

# Here.. remove this part vvv
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  

# Here.. remove this part ^^^
# or

[[kv_namespaces]]
binding = "<BINDING_NAME1>"
id = "<NAMESPACE_ID1>"

[[kv_namespaces]]
binding = "<BINDING_NAME2>"
id = "<NAMESPACE_ID2>"

also.. on the default comments. can this be link be added as well so that not only you have resource for pages.. but also for worker and wrangler.toml configuration as well... https://developers.cloudflare.com/workers/wrangler/configuration/#kv-namespaces

Cloudflare Docs

Configuration | Cloudflare Workers docs

Use a

wrangler.toml

wrangler.toml

configuration file to customize the development and deployment setup for your Worker project and other Developer Platform products.

DDenver James Duran Hello team, just a suggestion, maybe if it would be better if we remove the firs...

H

Hard@Work•9/13/24, 12:41 PM

I only see an error if you have both?

HHard@Work I only see an error if you have both?

D

Denver James Duran•9/13/24, 12:58 PM

I get an error when using the kv_namesapces=[...]

could it be because of the extension I am using?

Name: Even Better TOML
Id: tamasfe.even-better-toml
Description: Fully-featured TOML support
Version: 0.19.2
Publisher: tamasfe
VS Marketplace Link: https://marketplace.visualstudio.com/items?itemName=tamasfe.even-better-toml

Even Better TOML - Visual Studio Marketplace

Extension for Visual Studio Code - Fully-featured TOML support

DDenver James Duran I get an error when using the kv_namesapces=[...] could it be because of the ex...

H

Hard@Work•9/13/24, 1:01 PM

I'm using the same, no error with

kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]

kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]

kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]

kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]

D

Denver James Duran•9/13/24, 1:03 PM

hmm.. I wonder what's wrong with mine...

DDenver James Duran hmm.. I wonder what's wrong with mine...

H

Hard@Work•9/13/24, 1:05 PM

Can you post the whole

wrangler.toml

wrangler.toml

?

D

Denver James Duran•9/13/24, 1:09 PM

I dont have nitro... I'll be sending it in parts

D

Denver James Duran•9/13/24, 1:10 PM

#:schema node_modules/wrangler/config-schema.json
name = "demo"
compatibility_date = "2024-09-09"
pages_build_output_dir = ".svelte-kit/cloudflare"

# Automatically place your workloads in an optimal location to minimize latency.
# If you are running back-end logic in a Pages Function, running it closer to your back-end infrastructure
# rather than the end user may result in better performance.
# Docs: https://developers.cloudflare.com/pages/functions/smart-placement/#smart-placement
[placement]
mode = "smart"

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Docs:
# - https://developers.cloudflare.com/pages/functions/bindings/#environment-variables
# Note: Use secrets to store sensitive data.
# - https://developers.cloudflare.com/pages/functions/bindings/#secrets
# [vars]
# MY_VARIABLE = "production_value"

# Bind the Workers AI model catalog. Run machine learning models, powered by serverless GPUs, on Cloudflare’s global network
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#workers-ai
# [ai]
# binding = "AI"

# Bind a D1 database. D1 is Cloudflare’s native serverless SQL database.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#d1-databases
[[d1_databases]]
binding = "DB"
database_name = "demo"
database_id = "xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
preview_database_id="xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
migrations_dir="src/lib/server/databases/d1/migrations"

#:schema node_modules/wrangler/config-schema.json
name = "demo"
compatibility_date = "2024-09-09"
pages_build_output_dir = ".svelte-kit/cloudflare"

# Automatically place your workloads in an optimal location to minimize latency.
# If you are running back-end logic in a Pages Function, running it closer to your back-end infrastructure
# rather than the end user may result in better performance.
# Docs: https://developers.cloudflare.com/pages/functions/smart-placement/#smart-placement
[placement]
mode = "smart"

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Docs:
# - https://developers.cloudflare.com/pages/functions/bindings/#environment-variables
# Note: Use secrets to store sensitive data.
# - https://developers.cloudflare.com/pages/functions/bindings/#secrets
# [vars]
# MY_VARIABLE = "production_value"

# Bind the Workers AI model catalog. Run machine learning models, powered by serverless GPUs, on Cloudflare’s global network
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#workers-ai
# [ai]
# binding = "AI"

# Bind a D1 database. D1 is Cloudflare’s native serverless SQL database.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#d1-databases
[[d1_databases]]
binding = "DB"
database_name = "demo"
database_id = "xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
preview_database_id="xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
migrations_dir="src/lib/server/databases/d1/migrations"

#:schema node_modules/wrangler/config-schema.json
name = "demo"
compatibility_date = "2024-09-09"
pages_build_output_dir = ".svelte-kit/cloudflare"

# Automatically place your workloads in an optimal location to minimize latency.
# If you are running back-end logic in a Pages Function, running it closer to your back-end infrastructure
# rather than the end user may result in better performance.
# Docs: https://developers.cloudflare.com/pages/functions/smart-placement/#smart-placement
[placement]
mode = "smart"

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Docs:
# - https://developers.cloudflare.com/pages/functions/bindings/#environment-variables
# Note: Use secrets to store sensitive data.
# - https://developers.cloudflare.com/pages/functions/bindings/#secrets
# [vars]
# MY_VARIABLE = "production_value"

# Bind the Workers AI model catalog. Run machine learning models, powered by serverless GPUs, on Cloudflare’s global network
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#workers-ai
# [ai]
# binding = "AI"

# Bind a D1 database. D1 is Cloudflare’s native serverless SQL database.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#d1-databases
[[d1_databases]]
binding = "DB"
database_name = "demo"
database_id = "xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
preview_database_id="xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
migrations_dir="src/lib/server/databases/d1/migrations"

#:schema node_modules/wrangler/config-schema.json
name = "demo"
compatibility_date = "2024-09-09"
pages_build_output_dir = ".svelte-kit/cloudflare"

# Automatically place your workloads in an optimal location to minimize latency.
# If you are running back-end logic in a Pages Function, running it closer to your back-end infrastructure
# rather than the end user may result in better performance.
# Docs: https://developers.cloudflare.com/pages/functions/smart-placement/#smart-placement
[placement]
mode = "smart"

# Variable bindings. These are arbitrary, plaintext strings (similar to environment variables)
# Docs:
# - https://developers.cloudflare.com/pages/functions/bindings/#environment-variables
# Note: Use secrets to store sensitive data.
# - https://developers.cloudflare.com/pages/functions/bindings/#secrets
# [vars]
# MY_VARIABLE = "production_value"

# Bind the Workers AI model catalog. Run machine learning models, powered by serverless GPUs, on Cloudflare’s global network
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#workers-ai
# [ai]
# binding = "AI"

# Bind a D1 database. D1 is Cloudflare’s native serverless SQL database.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#d1-databases
[[d1_databases]]
binding = "DB"
database_name = "demo"
database_id = "xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
preview_database_id="xxxxxxx-46f8-41c4-bad3-xxxxxxxxx"
migrations_dir="src/lib/server/databases/d1/migrations"

D

Denver James Duran•9/13/24, 1:10 PM

# Bind a Durable Object. Durable objects are a scale-to-zero compute primitive based on the actor model.
# Durable Objects can live for as long as needed. Use these when you need a long-running "server", such as in realtime apps.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/durable-objects
# [[durable_objects.bindings]]
# name = "MY_DURABLE_OBJECT"
# class_name = "MyDurableObject"
# script_name = 'my-durable-object'

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#kv-namespaces
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  


# Bind a Queue producer. Use this binding to schedule an arbitrary task that may be processed later by a Queue consumer.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#queue-producers
# [[queues.producers]]
# binding = "MY_QUEUE"
# queue = "my-queue"

# Bind a Durable Object. Durable objects are a scale-to-zero compute primitive based on the actor model.
# Durable Objects can live for as long as needed. Use these when you need a long-running "server", such as in realtime apps.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/durable-objects
# [[durable_objects.bindings]]
# name = "MY_DURABLE_OBJECT"
# class_name = "MyDurableObject"
# script_name = 'my-durable-object'

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#kv-namespaces
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  


# Bind a Queue producer. Use this binding to schedule an arbitrary task that may be processed later by a Queue consumer.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#queue-producers
# [[queues.producers]]
# binding = "MY_QUEUE"
# queue = "my-queue"

# Bind a Durable Object. Durable objects are a scale-to-zero compute primitive based on the actor model.
# Durable Objects can live for as long as needed. Use these when you need a long-running "server", such as in realtime apps.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/durable-objects
# [[durable_objects.bindings]]
# name = "MY_DURABLE_OBJECT"
# class_name = "MyDurableObject"
# script_name = 'my-durable-object'

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#kv-namespaces
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  


# Bind a Queue producer. Use this binding to schedule an arbitrary task that may be processed later by a Queue consumer.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#queue-producers
# [[queues.producers]]
# binding = "MY_QUEUE"
# queue = "my-queue"

# Bind a Durable Object. Durable objects are a scale-to-zero compute primitive based on the actor model.
# Durable Objects can live for as long as needed. Use these when you need a long-running "server", such as in realtime apps.
# Docs: https://developers.cloudflare.com/workers/runtime-apis/durable-objects
# [[durable_objects.bindings]]
# name = "MY_DURABLE_OBJECT"
# class_name = "MyDurableObject"
# script_name = 'my-durable-object'

# Bind a KV Namespace. Use KV as persistent storage for small key-value pairs.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#kv-namespaces
kv_namespaces = [
  { binding = "<BINDING_NAME1>", id = "<NAMESPACE_ID1>" },
  { binding = "<BINDING_NAME2>", id = "<NAMESPACE_ID2>" }
]  


# Bind a Queue producer. Use this binding to schedule an arbitrary task that may be processed later by a Queue consumer.
# Docs: https://developers.cloudflare.com/pages/functions/bindings/#queue-producers
# [[queues.producers]]
# binding = "MY_QUEUE"
# queue = "my-queue"

DDenver James Duran ```toml # Bind a Durable Object. Durable objects are a scale-to-zero compute pri...

H

Hard@Work•9/13/24, 1:11 PM

I see the issue

D

Denver James Duran•9/13/24, 1:11 PM

the rest are just literal comments.. so I guess it doesn't matter?

H

Hard@Work•9/13/24, 1:11 PM

kv_namespace

kv_namespace

is under

d1_databases

d1_databases

H

Hard@Work•9/13/24, 1:12 PM

Place it underneath

pages_build_output_dir

pages_build_output_dir

D

Denver James Duran•9/13/24, 1:13 PM

oh wow it did the trick!

Why? so does this mean that on the wrangler toml file the kv namespace should be declared above d1 database?

DDenver James Duran oh wow it did the trick! Why? so does this mean that on the wrangler toml file ...

H

Hard@Work•9/13/24, 1:15 PM

TOML Shenanigans. Basically, when you add a table declaration(

[placement]

[placement]

) or a table array declaration(

[[d1_databases]]

[[d1_databases]]

), everything until the next declaration is assumed to be a part of that table

H

Hard@Work•9/13/24, 1:15 PM

This is why I no longer use

toml

toml

for personal projects

D

Denver James Duran•9/13/24, 1:21 PM

that makes sense! Hmm how do we prevent that?

also, isn't wrangler.toml required in deploying apps in cloudflare?

DDenver James Duran that makes sense! Hmm how do we prevent that? also, isn't wrangler.toml require...

H

Hard@Work•9/13/24, 1:23 PM

I use

wrangler.json

wrangler.json

. It is supported for Workers, but not for Pages

NNoil My application accesses files from the KV-store and have been running into the i...

N

Noil•9/16/24, 12:56 PM

Any possible answer to why files in the KV store can be unfindable? could it be the caching or something else?

NNoil Any possible answer to why files in the KV store can be unfindable? could it be ...

Z

Zack•9/16/24, 1:18 PM

If you make a request for a key that doesn't yet exist, the not found response will be cached for the same TTL as if it were found. Default 60 seconds iirc, but can be overridden

Similar Threads

Similar Threads

Similar Threads