A cache will make things faster but if the data is already cached it cant make things faster than th

SSantosh Interesting that you mentioned Cache API, what use cases would require to use KV...

S

SK•12/7/23, 2:23 AM

I don't have high enough RPS for KV to cache my data and the cold reads are pretty slow

S

SK•12/7/23, 2:23 AM

few people visit my website, and when they do it's slow lol

S

SK•12/7/23, 2:23 AM

https://upstash.com/blog/edgecaching-benchmark

S

SK•12/7/23, 2:24 AM

upstash benchmarked KV and they found the same thing. But I've had a much better time simply using the cache api on-top of KV

S

SK•12/7/23, 2:56 AM

ok I just ran a very quick benchmark

S

SK•12/7/23, 2:56 AM

https://test.blueradar.net/

S

SK•12/7/23, 2:57 AM

there are 2 routes, one fetches the data from KV, and the other tries the cache first and fallbacks to kv

S

SK•12/7/23, 2:57 AM

I ran a simple python script that hit each route 100 times and recorded the latencies to get some summary stats

S

SK•12/7/23, 2:57 AM

UUnsmart A cache will make things faster but if the data is already cached it cant make t...

S

SK•12/7/23, 2:57 AM

it turns out that it does actually make it faster

S

SK•12/7/23, 2:58 AM

sure not by a whole lot but but it does

S

SK•12/7/23, 2:58 AM

the last time I tested this KV was performing much worse (around 50-100ms) so I'm super happy that it's working heaps better now

U

UnsmartOP•12/7/23, 3:02 AM

I mean if you think it helps you can do it sure no one going to stop you

S

SK•12/7/23, 3:03 AM

but yeah, when I refactor this I'll switch to r2 + cache api instead of layering it on kv, that was just placeholder to get it working

SSK <https://test.blueradar.net/>

V

Vikash•12/9/23, 3:46 PM

Code of your test?

Are you using

kv.get(key, { cacheTtl: 60 })

kv.get(key, { cacheTtl: 60 })

kv.get(key, { cacheTtl: 60 })

kv.get(key, { cacheTtl: 60 }) or the cache API?

VVikash Code of your test? Are you using `kv.get(key, { cacheTtl: 60 })` or the cache ...

S

SK•12/10/23, 1:24 AM

https://gist.github.com/Repo-SK/76775be58020c964c17eae45be8b3104

S

SK•12/10/23, 1:25 AM

/kv uses kv.get with a cacheTtl value of an hour (3600) and /kv-cache-api uses the cache api

S

SK•12/10/23, 1:25 AM

for the benchmark simply send requests to both endpoints and extract the latencies from the html returned (I used a python script to send 100 requests to each)

K

kian•12/10/23, 6:18 PM

As in the read takes that long to fulfill, or that long until you see the new value?

Z

zehawk•12/16/23, 3:09 PM

Where does one see how much storage is being used by KV? I can never get an accurate value. I got billed for 1.69GB while the KV page shows 67KB. So what gives?

Mmatt_d @izdi No, this behavior is an inescapable aspect of WorkersKV.

A

Advany•12/17/23, 1:00 PM

is it already as fast as 5 seconds? I though it would take up to 60 seconds to get consistent with the write

Zzehawk Where does one see how much storage is being used by KV? I can never get an accu...

M

Matt Silverlock•12/17/23, 1:03 PM

Please open a Support ticket here.

AAdvany is it already as fast as 5 seconds? I though it would take up to 60 seconds to g...

M

Matt Silverlock•12/17/23, 2:32 PM

60s for values to refresh (eventual consistency). If you read a key, you will implicitly cache the empty/null value. You can read new keys faster than 60s on first read.

A

Advany•12/17/23, 2:33 PM

Awesome! Just wanted to verify. Hopefully one day we will see faster refreshes but good for now!

AAdvany is it already as fast as 5 seconds? I though it would take up to 60 seconds to g...

H

Hello, I’m Allie!•12/17/23, 2:39 PM

This also assumes you haven’t set a higher CacheTTL

HHello, I’m Allie!This also assumes you haven’t set a higher CacheTTL

A

Advany•12/17/23, 3:07 PM

Yeah a while back there was talk about a new version of KV that would refresh faster even with a higher CacheTTL. There where talks of 15 seconds

AAdvany Yeah a while back there was talk about a new version of KV that would refresh fa...

H

Hello, I’m Allie!•12/17/23, 3:28 PM

Yeah, that was v2, but it got rolled back a while ago

B

bonald•12/18/23, 2:55 AM

16ms latency for kv , is this chat real? was looking the test redis vs kv . i guess theres no test to do. is this real?

K

kian•12/18/23, 2:56 AM

For a cached read? Sounds right to me.

Bbonald 16ms latency for kv , is this chat real? was looking the test redis vs kv . i gu...

A

Advany•12/18/23, 8:41 AM

a kv is cached locally using Cache. Thats why second reads on the same location are faster

HHello, I’m Allie!Yeah, that was v2, but it got rolled back a while ago

A

Advany•12/18/23, 8:41 AM

aaaah good to know they are still working on that!

B

Befus•12/20/23, 11:50 AM

How would I store an image inside KV? Not using cloudflare images

BBefus How would I store an image inside KV? Not using cloudflare images

I

Isaac McFadyen•12/20/23, 12:01 PM

You'd probably encode it as an ArrayBuffer. Keep in mind that will buffer the image into the Worker's RAM, but I don't think there's any way to stream directly to/from KV.

I

Isaac McFadyen•12/20/23, 12:01 PM

Oh actually, there is!

I

Isaac McFadyen•12/20/23, 12:01 PM

You can directly write a ReadableStream: https://developers.cloudflare.com/kv/api/write-key-value-pairs/

I

Isaac McFadyen•12/20/23, 12:02 PM

So you'd look at your request, see if it's an image that you want to upload (based on whatever factors you want), then do a

env.KV_BINDING.put("imagename", request.body)

env.KV_BINDING.put("imagename", request.body)

env.KV_BINDING.put("imagename", request.body)

env.KV_BINDING.put("imagename", request.body)

I

Isaac McFadyen•12/20/23, 12:03 PM

And then to read it back you can do a

const image = env.KV_BINDING.get("imagename", { type: "stream" });

const image = env.KV_BINDING.get("imagename", { type: "stream" });

const image = env.KV_BINDING.get("imagename", { type: "stream" });

const image = env.KV_BINDING.get("imagename", { type: "stream" }); (notice the stream part to get back as a stream)

B

Befus•12/20/23, 12:04 PM

Damn I'm going to try this, I will let you know!

I

Isaac McFadyen•12/20/23, 12:05 PM

Good luck!

IIsaac McFadyen Good luck!

B

Befus•12/20/23, 1:35 PM

export async function POST(req: NextRequest) {
  const formData = await req.formData();
  const file = formData.get("file") as File;
  console.log(file);
  console.log(file.type);
  console.log(file.name);
  // check if incoming data is a file and an image extension
  if (!file || !file.type.startsWith("image/")) {
    return new Response(JSON.stringify("error"), {
      headers: {
        "content-type": "application/json",
      },
    });
  }

  // if it is a file, upload the name of it to KV
  const { GALLERY } = process.env;
  const response = await GALLERY.put(file.name, file as unknown as ReadableStream<Uint8Array>);

  return new Response(JSON.stringify(response), {
    headers: {
      "content-type": "application/json",
    },
  });
}

export async function POST(req: NextRequest) {
  const formData = await req.formData();
  const file = formData.get("file") as File;
  console.log(file);
  console.log(file.type);
  console.log(file.name);
  // check if incoming data is a file and an image extension
  if (!file || !file.type.startsWith("image/")) {
    return new Response(JSON.stringify("error"), {
      headers: {
        "content-type": "application/json",
      },
    });
  }

  // if it is a file, upload the name of it to KV
  const { GALLERY } = process.env;
  const response = await GALLERY.put(file.name, file as unknown as ReadableStream<Uint8Array>);

  return new Response(JSON.stringify(response), {
    headers: {
      "content-type": "application/json",
    },
  });
}

export async function POST(req: NextRequest) {
  const formData = await req.formData();
  const file = formData.get("file") as File;
  console.log(file);
  console.log(file.type);
  console.log(file.name);
  // check if incoming data is a file and an image extension
  if (!file || !file.type.startsWith("image/")) {
    return new Response(JSON.stringify("error"), {
      headers: {
        "content-type": "application/json",
      },
    });
  }

  // if it is a file, upload the name of it to KV
  const { GALLERY } = process.env;
  const response = await GALLERY.put(file.name, file as unknown as ReadableStream<Uint8Array>);

  return new Response(JSON.stringify(response), {
    headers: {
      "content-type": "application/json",
    },
  });
}

export async function POST(req: NextRequest) {
  const formData = await req.formData();
  const file = formData.get("file") as File;
  console.log(file);
  console.log(file.type);
  console.log(file.name);
  // check if incoming data is a file and an image extension
  if (!file || !file.type.startsWith("image/")) {
    return new Response(JSON.stringify("error"), {
      headers: {
        "content-type": "application/json",
      },
    });
  }

  // if it is a file, upload the name of it to KV
  const { GALLERY } = process.env;
  const response = await GALLERY.put(file.name, file as unknown as ReadableStream<Uint8Array>);

  return new Response(JSON.stringify(response), {
    headers: {
      "content-type": "application/json",
    },
  });
}

I'm new to using KV, I seem to be getting the type error that GALLERY.put is not a function. But it does exist and I'm pretty sure it would work on production but I am testing locally now using npx cf-bindings-proxy

I

Isaac McFadyen•12/20/23, 1:42 PM

Hmm you're using Next?

I

Isaac McFadyen•12/20/23, 1:43 PM

You might want to ask in #next-on-pages, I haven't used Next at all and don't know how the bindings are supposed to work.

I

Isaac McFadyen•12/20/23, 1:43 PM

Also you shouldn't need to cast using Typescript - if you have the file as a File then it should be insertable by

file.readable

file.readable

file.readable

file.readable I think?

A cache will make things faster but if the data is already cached it cant make things faster than th

Similar Threads

Similar Threads

Similar Threads