alright, gonna using DO

RRubi alright, gonna using DO

B

bun•4/19/24, 10:12 AM

offtopic but your pfp goes insanely hard

M

mau•4/20/24, 12:30 PM

I am implementing cache purging function but hitting a roadblock

for example

http://localhost:8787/api/addons?where[id][equals]=66221339a9cb9c462a245943 caches data from http://localhost:3000/api/addons?where[id][equals]=66221339a9cb9c462a245943

and i am using cloudflare kv for caching. I am generating the kv key using below hash function

export async function getHashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

export async function getHashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

export async function getHashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

export async function getHashString(input) {
  const encoder = new TextEncoder();
  const data = encoder.encode(input);
  const hashBuffer = await crypto.subtle.digest('SHA-256', data);
  return bufferToHex(hashBuffer);
}

function bufferToHex(buffer) {
  const view = new DataView(buffer);
  let hex = '';
  for (let i = 0; i < view.byteLength; i += 1) {
    const byte = view.getUint8(i).toString(16);
    hex += byte.padStart(2, '0');
  }
  return hex;
}

Can someone suggest a method for clearing the cache in the scenario described? I know how to handle cache invalidation for individual items as it's straightforward, but I'm unsure how to effectively clear the cache for queries that involve collection filtering, such as those with multiple conditions. What strategies could work for this more complex case?

Ggrimpa Is there an easy way to know how many values I have stored in KV (in the dashboa...

M

Matt Silverlock•4/22/24, 5:11 PM

Not yet (in the dash) — we're working on a new metrics dash and more metrics for KV.

But you can query via API: https://developers.cloudflare.com/api/operations/workers-kv-stored-data-analytics-query-stored-data-analytics

    "max": {
      "storedBytes": 32,
      "storedKeys": 4
    },

    "max": {
      "storedBytes": 32,
      "storedKeys": 4
    },

    "max": {
      "storedBytes": 32,
      "storedKeys": 4
    },

    "max": {
      "storedBytes": 32,
      "storedKeys": 4
    },

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

V

Varna•4/25/24, 1:06 PM

any recommendations for auto generated keys for KV? I just want to store two weeks of reports in sequential order (few hundred records tops)

VVarna any recommendations for auto generated keys for KV? I just want to store two wee...

H

Hello, I’m Allie!•4/25/24, 1:09 PM

Date.now()?

HHello, I’m Allie!Date.now()?

V

Varna•4/25/24, 1:11 PM

thought about that too

but maybe it would be better to use smth like

crypto.randomUUID()

crypto.randomUUID()

crypto.randomUUID()

crypto.randomUUID(), or maybe I'm overthinking this

V

Varna•4/25/24, 3:13 PM

I wanted to test if

expirationTtl

expirationTtl

expirationTtl

expirationTtl works by setting it's value to 70 (seconds).
It did set it to

expiration: 1716649322

expiration: 1716649322

expiration: 1716649322

expiration: 1716649322 on

KV.list()

KV.list()

KV.list()

KV.list() response which is 18:02 (8 minutes ago).
Is it purged at batches on some intervals, or do I need to do that manually?
Or is this normal if I had a long

cacheTtl

cacheTtl

cacheTtl

cacheTtl.

V

Varna•4/25/24, 4:40 PM

It started working :catjam:

Oom What is this? Curious 🤔 what are you doing

R

RubiOP•4/27/24, 3:00 PM

it's sveltekit middleware to check if a request to a path group is authorized or not

Oom Device id is just user agent?

R

RubiOP•4/27/24, 3:02 PM

a session id inside a header

Oom D1 with index would be cheaper then D0

R

RubiOP•4/27/24, 3:03 PM

I'm finding DO Alarm are harder to use inside sveltekit, I don't know how, it's need a class and something

Oom D1 with index would be cheaper then D0

R

RubiOP•4/27/24, 3:03 PM

I may gonna stick with KV for the session, and the DB... I just moved it to neon

Oom Do alarm for? Deleting expired session?

R

RubiOP•4/27/24, 3:05 PM

yes

Oom DO needs separate workers to be deployed, apart from pages not inside page

R

RubiOP•4/27/24, 3:06 PM

yeah, I really don't understand, why the way we use it can't be just like D1, or KV

Oom If stored in kv unless you do mapping with database you can't track the session ...

R

RubiOP•4/27/24, 3:11 PM

yes, they key are mapped with database

Oom Use D1 with workers cron

R

RubiOP•4/27/24, 3:12 PM

I think I'm gonna keeping things simple and traditional

Oom With this you don't need mapping or alarms. Just delete it periodically with clo...

R

RubiOP•4/27/24, 3:20 PM

aren't this is bad? because D1 single threaded? so it will execute one by one by one an CRUD action?

I read it from here and it makes me afraid to use D1:

d1-database

Oom Unless you are making 1000 request per second you should not be worried, maybe t...

R

RubiOP•4/27/24, 8:47 PM

the response time for 128rps INSERT is actually fine, interesting...

T

tskuzzy•4/30/24, 9:54 PM

If I'm storing structured data in KV, is it better to stick it into metadata or to (de)serialize it as JSON in the value?

T

tonytheonly•5/3/24, 2:08 AM

Anyone else having issues updating KV?

T

tonytheonly•5/3/24, 2:10 AM

what gets logged in my console:

         await c.env.KV_CAMPAIGN.put(campaign.id, JSON.stringify({
            ...campaign
        }));
        const kv = await c.env.KV_CAMPAIGN.get(campaign.id)
        console.log("UPDATED KV",kv)

         await c.env.KV_CAMPAIGN.put(campaign.id, JSON.stringify({
            ...campaign
        }));
        const kv = await c.env.KV_CAMPAIGN.get(campaign.id)
        console.log("UPDATED KV",kv)

         await c.env.KV_CAMPAIGN.put(campaign.id, JSON.stringify({
            ...campaign
        }));
        const kv = await c.env.KV_CAMPAIGN.get(campaign.id)
        console.log("UPDATED KV",kv)

         await c.env.KV_CAMPAIGN.put(campaign.id, JSON.stringify({
            ...campaign
        }));
        const kv = await c.env.KV_CAMPAIGN.get(campaign.id)
        console.log("UPDATED KV",kv)

T

tonytheonly•5/3/24, 2:10 AM

is not what I see when I refresh / go to the KV store in cloudflare

U

Unsmart•5/3/24, 2:11 AM

KV is eventually consistent

T

tonytheonly•5/3/24, 2:12 AM

eventually?

U

Unsmart•5/3/24, 2:13 AM

yes, it means data is cached and replicated so it may take some time for the data to be updated

C

Chaika•5/3/24, 2:13 AM

https://developers.cloudflare.com/kv/reference/how-kv-works/

V

Varna•5/3/24, 11:10 AM

(new Blob([{ question: "is this correct way to measure if I fit in 1024bytes for KV metadata?" }])).size

(new Blob([{ question: "is this correct way to measure if I fit in 1024bytes for KV metadata?" }])).size

(new Blob([{ question: "is this correct way to measure if I fit in 1024bytes for KV metadata?" }])).size

(new Blob([{ question: "is this correct way to measure if I fit in 1024bytes for KV metadata?" }])).size

C

CalBoy•5/3/24, 11:47 AM

Does anyone know if it's possible to get the TTL of a key with a get? ie I've put an entry into the KV with a TTL i then want to check how much longer on it's TTL it has?

CCalBoy Does anyone know if it's possible to get the TTL of a key with a get? ie I've pu...

B

Beny•5/3/24, 6:18 PM

You can see the expiration time by using

env.KV.list({ prefix: key, limit: 1 })

env.KV.list({ prefix: key, limit: 1 })

env.KV.list({ prefix: key, limit: 1 })

env.KV.list({ prefix: key, limit: 1 })

R

Rich•5/9/24, 11:48 AM

We've been using the Cache API to cache sub-requests for a while and have found that because some of our sites are relatively low traffic, cache entries get evicted all the time so it offers minimal benefit.

We're looking at trying out KV store to cache subrequests instead, but I've read that cold reads can be very slow and I'm concerned even the KV store's colo / regional / central tier caches will get evicted just as aggressively as the Cache API does.

Does anybody know if KV caches are stickier than the Cache API?

RRich We've been using the Cache API to cache sub-requests for a while and have found ...

H

Hello, I’m Allie!•5/9/24, 12:07 PM

KV caching is the Cache API under the hood, iirc

HHello, I’m Allie!KV caching is the Cache API under the hood, iirc

R

Rich•5/9/24, 12:46 PM

I did wonder that but the docs suggest it takes advantage of tiered caching which the Cache API doesn't

Data must be read from the nearest regional tier, followed by a central tier, degrading finally to the central store for a truly cold global read

R

Rich•5/9/24, 12:50 PM

The way the docs describe it, I was hoping the KV Store would act similarly to Tiered Caching and Cache Reserve -- neither of which you get with the Cache API

RRich I did wonder that but the docs suggest it takes advantage of tiered caching whic...

C

Chaika•5/9/24, 1:18 PM

the docs are wrong, they were updated to talk about KV 2.0 (or whatever you want to call it), but that was reverted and pulled back

C

Chaika•5/9/24, 1:21 PM

they pulled the blog post too, this is what KV 2.0 was supposed to be: https://web.archive.org/web/20230701095201/https://blog.cloudflare.com/faster-workers-kv-architecture/

Similar Threads

Similar Threads

Similar Threads