whats the best way to figure out where my cpu usage is? I'm suddenly running into cpu limits for que

whats the best way to figure out where my cpu usage is? I'm suddenly running into cpu limits for queues (even with a batch size of 1) and ive made all the code changes i can think of to reduce it and it has made no difference

WWalshy Can you send me a build ID?

tadhglewis•11/14/24, 5:46 AM

Did you get a chance to take a look? It seems I managed to get one Worker to pass but the other one still times out cloning the repo

Iaci•11/14/24, 11:27 AM

Hey guys! Any chance I can make an authenticated request fetching an image (from google drive directly through api with bearer access token in the auth header) (not google cloud!) that I can run through cloudflare images to resize it on the fly? saw in the docs (https://developers.cloudflare.com/images/transform-images/control-origin-access/#authenticated-origin) that it is possible but cant get it working

elpupper•11/14/24, 5:30 PM

hi. I know static assets is in beta

elpupper•11/14/24, 5:30 PM

but im not sure how the technicality of it works

elpupper•11/14/24, 5:30 PM

does it live with the worker globally? or it works like KV where its just stored i n1 location and cached

Eelpupper does it live with the worker globally? or it works like KV where its just stored...

texan•11/14/24, 5:45 PM

It’s stored in KV just like pages stores static assets

Ttexan It’s stored in KV just like pages stores static assets

elpupper•11/14/24, 5:46 PM

man

Walshy•11/14/24, 5:48 PM

sadly we don't have infinite storage on every server haha but trust me, it's very fast regardless.

WWalshy sadly we don't have infinite storage on every server haha but trust me, it's ver...

elpupper•11/14/24, 5:49 PM

yes but having them be paid is more than worthit. im aiming for atleast 50ms to people nearby

elpupper•11/14/24, 5:51 PM

also being able to manually select where you want your replicas to be/stored is also a big +

elpupper•11/14/24, 5:52 PM

so id want to be in ~300 cities storing 1 MB per city that only comes to 300 MB

elpupper•11/14/24, 5:52 PM

now ofcourse im not the only user in the world but having this be part of paid workers/pro/enterprise is just so nice

Walshy•11/14/24, 5:56 PM

we serve assets much faster than 50 ms today

Walshy•11/14/24, 5:56 PM

so i'd say you're good either way

WWalshy we serve assets much faster than 50 ms today

elpupper•11/14/24, 5:58 PM

ehhh from testing it ranged from 10-200ms

elpupper•11/14/24, 5:59 PM

how long does cached data stay for?

Walshy•11/14/24, 5:59 PM

our p95 is less than 50ms haha

Walshy•11/14/24, 5:59 PM

but either way, it stays for as long as it can

Walshy•11/14/24, 6:00 PM

it's lru

elpupper•11/14/24, 6:01 PM

:pepethink:

WWalshy but either way, it stays for as long as it can

elpupper•11/14/24, 6:05 PM

ok i didnt know this information

elpupper•11/14/24, 6:05 PM

good to know

WWalshy our p95 is less than 50ms haha

Peps•11/14/24, 6:22 PM

interesting, because my p90 is consistently about 230ms, while it's all hot reads

Peps•11/14/24, 6:23 PM

unless the Read latencyRead latency graph on the KV dash is only for cold reads(?)

Peps•11/14/24, 6:23 PM

Peps•11/14/24, 6:23 PM

ohwait you were specifically talking assets KV

Peps•11/14/24, 6:23 PM

guess that's different from regular KV

Peps•11/14/24, 6:24 PM

still weird I'm getting those high read latencies when its pretty much all hot reads

PPeps ohwait you were specifically talking assets KV

elpupper•11/14/24, 6:25 PM

i didnt use assets kv i used normal kv

Peps•11/14/24, 6:25 PM

ah hm

Peps•11/14/24, 6:26 PM

@Walshy | Workers/Pages would you happen to know whether that Read latencyRead latency graph is only for cold reads or all? Because if it's also hot reads, then I'm confused as to why the numbers are so high

Walshy•11/14/24, 6:26 PM

should be all yes

Peps•11/14/24, 6:26 PM

:NotLikeThis:

Walshy•11/14/24, 6:26 PM

wonder why your p50 is 85ms, that's higher than our p99 :LuL:

Walshy•11/14/24, 6:27 PM

want to post in #kv and ping Thomas?

Peps•11/14/24, 6:27 PM

elpupper•11/14/24, 6:29 PM

also i found that for me it consistently picks different colos for workers

elpupper•11/14/24, 6:29 PM

not necessarily the closest one to the request

danawoodman•11/14/24, 6:34 PM

how do i troubleshoot builds that just get stuck at

npm install

npm install

? I can't get any of our workers past install, been stuck for days on this with no clue what to do

danawoodman•11/14/24, 7:06 PM

builds timing out at 20min with no errors, just stuck on install, even for a small project with 3 dependencies

D Trombett•11/14/24, 7:39 PM

Maybe there is a dependency that tries to run some install script and it gets stuck?

D Trombett•11/14/24, 7:40 PM

Or maybe you have a prepareprepare command that is automatically run after install?

Original message was deleted

elpupper•11/14/24, 8:06 PM

just by spamming the same worker for requests

Walshy•11/14/24, 8:07 PM

oops yep sorry, misread your message haha

WWalshy oops yep sorry, misread your message haha

elpupper•11/14/24, 8:16 PM

all good

Eugene•11/14/24, 8:40 PM

Hello

Eugene•11/14/24, 8:41 PM

where can I find the wrangler file for the project in the UI?

lucasp•11/14/24, 9:04 PM

I am using Hono with Cloudflare Workers, when I deploy it the first requests work but the following ones remain pending forever, I look at the logs and only the preflight (OPTIONS) arrives and the request does not continue. Does anyone know what it could be?

johtso•11/14/24, 10:41 PM

Is there a way to get a kind of one-to-many queue type setup with cloudflare? say I have a "new order" event, and there are various workers that want to react to that. How can I set things up to trigger multiple workers based on an event?

DD Trombett Maybe there is a dependency that tries to run some install script and it gets st...

danawoodman•11/14/24, 11:26 PM

perhaps.. but the weird thing is these builds have succeeded in the past, its as if something in our account is borked, which already happened before and @Walshy helped with that. I wonder if its a related issue...

whats the best way to figure out where my cpu usage is? I'm suddenly running into cpu limits for que

Similar Threads

Similar Threads

Similar Threads