Is there an easy way to cache Range Requests? Then I could maybe speed it up a little...

HHello, I’m Allie!Is there an easy way to cache Range Requests? Then I could maybe speed it up a l...

beelzabub•3/10/23, 5:35 PM

I thought range requests are generally cacheable, no? You might need to store the actual asset in cache once but after that cache.match will honor ranges? I forget the details though. CDN behavior is extremely complex and I don't pretend to know it outside of the specific slice of how I'm using it

Bbeelzabub I thought range requests are generally cacheable, no? You might need to store th...

Hello, I’m Allie!OP•3/10/23, 5:38 PM

I don't think so? I tried tailing the Function, and I'm getting

GET https://maps.goalastair.com/planet - Ok @ 3/10/2023, 6:38:19 PM
✘ [ERROR]   TypeError: Cannot cache response to a range request (206 Partial Content).

GET https://maps.goalastair.com/planet - Ok @ 3/10/2023, 6:38:19 PM
✘ [ERROR]   TypeError: Cannot cache response to a range request (206 Partial Content).

kian•3/10/23, 5:44 PM

put

put

will want the full file but you can make ranged reads against

match

match

kian•3/10/23, 5:45 PM

Same-ish behaviour as the normal CDN, except that all happens transparently (it'll pull the full file and serve you the range, then serving other ranged reads from that full file)

Kkian `put` will want the full file but you can make ranged reads against `match`

Hello, I’m Allie!OP•3/10/23, 5:46 PM

Ok, so there goes my idea. No way am I going to be able to

put

put

a 60 GB file in every requested colo…

kian•3/10/23, 5:47 PM

You could probably hack around it, emphasis on hack.

kian•3/10/23, 5:48 PM

put

put

just doesn't like the status code of 206 - but if you store a ranged response w/ a body of

then you'll be matching any ranged read against that unless you store the requested range as apart of the cache key.

kian•3/10/23, 5:48 PM

I don't think you'd gain very much in exchange for a very cursed caching method though

Kkian `put` just doesn't like the status code of 206 - but if you store a ranged respo...

Hello, I’m Allie!OP•3/10/23, 5:49 PM

I’m trying to get their Worker example working, which does the Range requests on the Worker side. Should be a little less of a pain…

Jjondon @beelzabub Yes, that answered my question. Thanks. I’m building an API that cons...

beelzabub•3/10/23, 6:07 PM

Doing 1000 subrequests within the context of 1 request is going to be slow (like ~1.6s to actually make if it's all cache hits) and feels like a lot. Are you sure you're doing 1k or more subrequests within the context of a single incoming request?

Jjondon Yeah. For instance, a flight check with 250 itineraries could involve 1000 IATA ...

beelzabub•3/10/23, 6:28 PM

Instead of storing each IATA code as a separate value, have you considered just storing it as 1 giant bundle and just caching the data on first use? I imagine the data doesn't change and it's probably quite small right?

Bbeelzabub Instead of storing each IATA code as a separate value, have you considered just ...

beelzabub•3/10/23, 6:29 PM

Something like:

let IATA_LOOKUP
export default {
  async fetch(req, env) {
     if (IATA_LOOKUP === undefined) {
       IATA_LOOKUP = await env.KV.get('iata.json', { type: 'json' })
     }
     // process using IATA_LOOKUP
     return new Response(...)
  }
}

let IATA_LOOKUP
export default {
  async fetch(req, env) {
     if (IATA_LOOKUP === undefined) {
       IATA_LOOKUP = await env.KV.get('iata.json', { type: 'json' })
     }
     // process using IATA_LOOKUP
     return new Response(...)
  }
}

Bbeelzabub Something like: ``` let IATA_LOOKUP export default { async fetch(req, env) { ...

beelzabub•3/10/23, 6:31 PM

Whether or not that works depends on the size of the data of course. If the object size is closer to ~100 MiB, you might need to start chunking somehow (e.g.

iata-AtoD.json

iata-AtoD.json

iata-DtoH.json

iata-DtoH.json

, etc)

Jjondon Thank you for the suggestion.This seems like a great solution. It should be well...

beelzabub•3/10/23, 6:36 PM

I figured. I had a IATA lookup table in a recent project I was playing around with and I think the entire website was just over 1 MiB compressed. Would have bundled it directly into my worker to simplify things but I don't know if >1 MiB workers are supported yet

Unsmart•3/10/23, 6:36 PM

5 MiB paid plan

UUnsmart 5 MiB paid plan 🙂

beelzabub•3/10/23, 6:39 PM

Grrrr. Should have just tried it. That's what happens when you rely on information from 2 years ago. I actually helped plan the work needed to raise that limit. I just rolled off to start R2 before that work completed and I did a bad job of following up. Good to hear it's been raised

Kirk Ouimet•3/10/23, 11:58 PM

Hi team - is it possible to do a list operation on a KV and have it stop at a certain character? E.g. I have these entries

1 - key1/keyA
2 - key1/keyA/keyAA
3 - key1/keyA/keyAA/keyAAA

and I just want to list and get 1 and 2 but not 3

James•3/10/23, 11:59 PM

not to my knowledge

Kirk Ouimet•3/11/23, 12:01 AM

yeah kind of tricky trying to get a graph type situation going on using KV alone

beelzabub•3/11/23, 1:35 AM

I do want to get to make list operations more like R2, but I'm not sure we'll be able to do that this year.

beelzabub•3/11/23, 1:35 AM

Strong candidate for 2024 though.

beelzabub•3/11/23, 1:36 AM

I know that's not a great answer though in the short term.

Bbeelzabub I do want to get to make list operations more like R2, but I'm not sure we'll be...

Kirk Ouimet•3/11/23, 4:09 AM

Ah could you give me an example of the syntax that would be used to accomplish my goal? BTW I am building a new company on cloudflare and you guys are going to destroy every cloud provider this decade

KKirk Ouimet Ah could you give me an example of the syntax that would be used to accomplish m...

Sly•3/11/23, 11:37 AM

I’m just waiting for CF Auth and CF Mail

SSly I’m just waiting for CF Auth and CF Mail 😄

Advany•3/11/23, 1:28 PM

Cf mail is mailchannels?

Erisa•3/11/23, 1:48 PM

and #email-routing for the other direction

KKirk Ouimet Ah could you give me an example of the syntax that would be used to accomplish m...

beelzabub•3/12/23, 12:23 AM

There’s no way to do it from your worker today. I would imagine we’d unify it similar with how list works on R2

KKevH I'm looking to perform a list of keys in a namespace using the nodejs sdk. Looki...

Cyb3r-Jak3•3/14/23, 5:35 PM

You are correct. The node library is very out of date. The last commit was a year ago and the last tag two years ago

beelzabub•3/14/23, 6:45 PM

Wow I didn't even realize that was a thing. I'll raise it internally to see what the plans are for that.

KKevH Is it recommended to just use the api directly for now?

Cyb3r-Jak3•3/14/23, 6:54 PM

Yeah. The go api is the most update if you know go

Bbeelzabub Wow I didn't even realize that was a thing. I'll raise it internally to see what...

Cyb3r-Jak3•3/14/23, 6:55 PM

IIRC, there is a plan to auto generate clients once the shift to openapi is done. The node, python, and PHP libraries don’t receive a lot of love otherwise

meyer•3/14/23, 10:04 PM

can bulk KV write operations occur simultaneously? i'm writing around 128K items to a KV store in batches of 2000 over a period of about a minute and i'm noticing that some values aren't getting written.

meyer•3/14/23, 10:04 PM

at the moment i'm doing some further debugging to make sure that it's not me doing something dumb, but i figured i'd check here as well.

Mmeyer can bulk KV write operations occur simultaneously? i'm writing around 128K items...

meyer•3/15/23, 12:14 AM

mystery solved: 429 Too Many Requests

meyer•3/15/23, 12:15 AM

is rate limiting per IP or per API key?

James•3/15/23, 12:21 AM

Account ID in general, I believe

James•3/15/23, 12:22 AM

429s are pretty common when doing bulk stuff with KV

Cyb3r-Jak3•3/15/23, 12:22 AM

Yeah API rate limit is per account

meyer•3/15/23, 12:34 AM

meyer•3/15/23, 12:35 AM

is rate limit info posted anywhere? googling for anything cloudflare-related + 429 gives me a whole lot of useless results

Erisa•3/15/23, 12:36 AM

Theres this which says 1200 req per 5 minutes, but I dont think thats the one youre running into? https://developers.cloudflare.com/fundamentals/api/reference/limits/

EErisa Theres this which says 1200 req per 5 minutes, but I dont think thats the one yo...

meyer•3/15/23, 12:41 AM

yeah i don’t think that’s the one i’m getting

Cyb3r-Jak3•3/15/23, 12:45 AM

I thought it would be. Wrangler just uses the normal API when uploading in bulk

meyer•3/15/23, 12:52 AM

innteresting… maybe it is? i’m definitely not sending 1200 requests in five minutes tho. 64 calls containing 2000 items each.

let IATA_LOOKUP export default { async fetch(req, env) { if (IATA_LOOKUP === undefined) { IATA_LOOKUP = await env.KV.get('iata.json', { type: 'json' }) } // process using IATA_LOOKUP return new Response(...) } }

Is there an easy way to cache Range Requests? Then I could maybe speed it up a little...

Similar Threads

Similar Threads

Similar Threads