(I would make sure to send a handful of requests as well to make sure the connection and everything

(I would make sure to send a handful of requests as well to make sure the connection and everything is warm before looking at the response, REST clients don't make the best benchmarking tools)

CChaika based on that header count it looks like they're both workers, but you're saying...

Dawson•4/26/24, 6:45 PM

Im really just curious how I can get my latency down lower, a endpoint with nearly 0 extra computation ontop of hono takes 3x as long to execute

CChaika (I would make sure to send a handful of requests as well to make sure the connec...

Dawson•4/26/24, 6:46 PM

ah, did not think about that. let me push without a cache and check the numbers

Dawson•4/26/24, 6:46 PM

Semi related, hows the experience with KV / D1 for a db and ratelimiting? Currently using turso and upstash and the latency is pretty high

ChaikaOP•4/26/24, 6:47 PM

KV <- uncached two central stores, cached is still ~20-30ms slower then normal cf cache/workers
D1 -> single location for now, only in Durable Object supported locations as well

For Rate limiting, there is a binding you can use in Workers now to use that colo's/dc's normal ratelimiting

DDawson ah, did not think about that. let me push without a cache and check the numbers

ChaikaOP•4/26/24, 6:49 PM

ah I'm just a bit confused on exactly what you are comparing. If it helps, here's a simple worker with Enterprise routing that returns the url requested: https://quick-test.workers.tylerobrien.dev/, no cache or anything

Dawson•4/26/24, 6:50 PM

30-50ms, seems to be the same as my endpoint without cache headers added

ChaikaOP•4/26/24, 6:51 PM

are you close enough to ORD that 7ms is physically possible or it could just be local cache of whatever utility you are using/something else?
could try pinging their hostname and seeing icmp latency

WebDev0323•4/26/24, 6:51 PM

Hello, How are you? everyone!
I created the worker, do you know how to integrate with my project?

Dawson•4/26/24, 6:51 PM

I am pretty close to a datacenter, not sure if its 7ms close

ChaikaOP•4/26/24, 6:52 PM

what's the endpoint of unkey that you are testing? Curious if I can see the diff at all

Dawson•4/26/24, 6:54 PM

I was testing last night, let me find the url real quick

DDawson 30-50ms, seems to be the same as my endpoint without cache headers added

ChaikaOP•4/26/24, 6:55 PM

oh it may be helpful to explain as well: No matter what cache headers you return from a worker you'll never be able to use edge cache unless you specifically use cache api in the worker (which is of course an invocation even just to get a cached response)

ChaikaOP•4/26/24, 6:55 PM

Workers are a layer in front of cache

CChaika oh it may be helpful to explain as well: No matter what cache headers you return...

Dawson•4/26/24, 6:56 PM

I used the

hono/cache

hono/cache

package inside of my middleware, they covered everything else

Dawson•4/26/24, 6:56 PM

I just specified a cache name and maxage

ChaikaOP•4/26/24, 6:56 PM

ahh ok sounds handy, probably cache api under the hood then

ChaikaOP•4/26/24, 6:57 PM

The Cf-Cache-Status header is an easy way to tell the cache status of an object. If it's missing, didn't even try cache

Dawson•4/26/24, 6:57 PM

curl -XPOST 'https://api.unkey.dev/v1/keys.verifyKey' \
  -H 'Content-Type: application/json' \
  -d '{
    "key": "3ZgvH8KKWrP8W8J25xU1KBeN"
  }'

curl -XPOST 'https://api.unkey.dev/v1/keys.verifyKey' \
  -H 'Content-Type: application/json' \
  -d '{
    "key": "3ZgvH8KKWrP8W8J25xU1KBeN"
  }'

This was what I was using, 150 first hit, then 30-40 after that

Dawson•4/26/24, 6:57 PM

I set a limited use on the key too, I dont mind if people have it

CChaika The Cf-Cache-Status header is an easy way to tell the cache status of an object....

Dawson•4/26/24, 6:58 PM

I do not see this inside of the headers for unkey, im assuming Hoppscotch wouldn't hide it somewhere

CChaika The Cf-Cache-Status header is an easy way to tell the cache status of an object....

Dawson•4/26/24, 7:00 PM

I do not have this header

Dawson•4/26/24, 7:01 PM

"The Cache middleware uses the Web Standard's Cache API. It caches a given response according to the Cache-Control headers." Could this be something with the browser instead of CF?

DDawson I do not have this header

ChaikaOP•4/26/24, 7:01 PM

with the cache api the usual implementation is such that it would be missing if the cache missed, try hitting it a few times?

ChaikaOP•4/26/24, 7:01 PM

it's also possible unkey doesn't use cf cache or uses it indirectly, like with kv

Dawson•4/26/24, 7:01 PM

Yea stil no header, let me see with postman

DDawson ``` curl -XPOST 'https://api.unkey.dev/v1/keys.verifyKey' \ -H 'Content-Type: ...

ChaikaOP•4/26/24, 7:03 PM

fwiw for me (to ORD) that endpoint is slower or comparable to a direct worker

ChaikaOP•4/26/24, 7:03 PM

ex:

Dawson•4/26/24, 7:03 PM

ah, may just be hoppscotch. I am getting more realistic numbers with postman

ChaikaOP•4/26/24, 7:04 PM

ChaikaOP•4/26/24, 7:04 PM

direct worker

Dawson•4/26/24, 7:04 PM

I would assume it wouldn't do something like that due to 60k stars on gh

Dawson•4/26/24, 7:04 PM

but postman is consistent around the 45ms mark

ChaikaOP•4/26/24, 7:04 PM

I mean if you type

ping api.unkey.dev

ping api.unkey.dev

what's the latency you see icmp?

DDawson I would assume it wouldn't do something like that due to 60k stars on gh

ChaikaOP•4/26/24, 7:04 PM

well a more popular worker might be slightly faster because it's already in memory, but it should be within a few ms. Additionally higher plans get more locations/better routing, but you're hitting the same

CChaika I mean if you type `ping api.unkey.dev` what's the latency you see icmp?

Dawson•4/26/24, 7:05 PM

18ms avg, practically the exact same as me

Dawson•4/26/24, 7:05 PM

Possibly they just have some amazing db routing. They advertised 22ms response times somewhere too

DDawson Possibly they just have some amazing db routing. They advertised 22ms response t...

ChaikaOP•4/26/24, 7:08 PM

https://github.com/unkeyed/unkey/blob/main/apps/api/wrangler.toml looksl ike durable objects are involved, ord is a dc supporting DOs

GitHub

unkey/apps/api/wrangler.toml at main · unkeyed/unkey

Open source API management platform. Contribute to unkeyed/unkey development by creating an account on GitHub.

Dawson•4/26/24, 7:09 PM

Okay, ill go look into this a good bit and see what I can do. Thank you for the help

ChaikaOP•4/26/24, 7:10 PM

can see they use cache as well https://github.com/unkeyed/unkey/blob/ae36a6aa5e4d0d55cacc812d14ebc044f6e3ec91/apps/api/src/pkg/keys/service.ts#L171

ChaikaOP•4/26/24, 7:11 PM

and it looks like their DB is just planetscale w/ drizzle
https://github.com/unkeyed/unkey/blob/ae36a6aa5e4d0d55cacc812d14ebc044f6e3ec91/apps/api/src/pkg/db.ts

ChaikaOP•4/26/24, 7:11 PM

they have a readonly db as well so I assume they've just got a bunch of planetscale replicas: https://planetscale.com/docs/concepts/regions

ChaikaOP•4/26/24, 7:12 PM

that only really matters for the first uncached hit, then it's all Cache API and Durable Objects it seems

Dawson•4/26/24, 7:12 PM

ah didn't know ps had replicas, that will be useful.

Dawson•4/26/24, 7:12 PM

Thats the whole reason I used turso haha

Dawson•4/26/24, 7:13 PM

Yea this helps a ton, experience on workers is great compared to hosting on a dedi

ChaikaOP•4/26/24, 7:15 PM

yea shouldn't be too much you couldn't replicate and get close numbers to them, I assume that 7ms was just that tool being drunk or caching somehow, you get ~18ms to the dc

Ggrimpa I have a Worker that searches for a value in KV and returns the response to anot...

ChaikaOP•4/26/24, 7:18 PM

increase cacheTtl to keep things cached locally for longer without hitting the central store if it works for your app
https://developers.cloudflare.com/kv/api/read-key-value-pairs/#cachettl-parameter

Dawson•4/26/24, 8:11 PM

I want to use a .dev.vars for secrets but my

wrangler.toml

wrangler.toml

file when possible (im accessing KV), this this possible?

Dawson•4/26/24, 8:14 PM

I am fine with storing it in my .dev.vars, just not sure how to store a Array in a .env file

(I would make sure to send a handful of requests as well to make sure the connection and everything

Similar Threads

Similar Threads

Similar Threads