is there a way to decrease number of requests for workers , as each visit to my website is hitting t

is there a way to decrease number of requests for workers , as each visit to my website is hitting the worker hundreds of time , for each path , and for each request it count 1 request

safah222OP•6/27/24, 1:12 PM

I just want 1 worker request for each ip address nothing more , can i do that

XXiao 🥑Hi I'm to create a simple api with itty-router, but ran into this error, anyone ...

Kevin•6/27/24, 1:24 PM

I’m traveling so I’m a bit late in seeing this, but switch router.handle —> router.fetch should fix your issue. “handle” was finally deprecated fully in v5

When you access router.handle now, it’s trying to register a route on the HANDLE verb instead of processing a request… so it fails to respond.

KKevin I’m traveling so I’m a bit late in seeing this, but switch router.handle —> rout...

Kevin•6/27/24, 1:25 PM

For more help I def recommend jumping on the itty discord - folks there will beat me to answers all the time!

Ssafah222 is there a way to decrease number of requests for workers , as each visit to my ...

Hard@Work•6/27/24, 2:01 PM

You would need to reduce the requests your Website makes. This can be aided with stuff like SSR, though you would probably still have 2/3 requests per page view

Murder Chicken•6/27/24, 2:22 PM

Is it possible to add specific query string parameters to be redacted from Cloudflare's request logs for GET requests?

Tthanhle when I use the Unpdf package to extract the text from the pdf. maybe the CPU tim...

anthony•6/27/24, 3:07 PM

Did you find a way to make this work for (larger) files in the cf ecosystem?

Jjohtso okay, so my PDF parsing code takes >4 seconds to run, are there any tricks to sp...

anthony•6/27/24, 3:07 PM

Did you find a desirable alternative using cf building blocks?

Aanthony Did you find a desirable alternative using cf building blocks?

johtso•6/27/24, 3:10 PM

Nope, it's just slow

johtso•6/27/24, 3:14 PM

@anthony the limits and allowances are pretty generous on the paid plan though, especially if it's a cron trigger or queue consumer (15 minutes)

johtso•6/27/24, 3:15 PM

@anthony are you bumping up against some limits?

Paul•6/27/24, 3:32 PM

I naively thought I could share the logic from my nextjs app with my cloudflare workers but the environment variables is causing quite a bit of issues. Even when polyfilling with

import * as process from 'node:process';

import * as process from 'node:process';

, whenever I use process.env, the nextjs app doesn't understand "node:process". Is it common to simply duplicate the logic for the cloudflare worker? Even my database calls requires a separate env and it's a bit too integrated. Is it common for folks to duplicate their code logic for CF workers or are people commonly able to reuse logic from their app?

Paul•6/27/24, 3:43 PM

Is it common to declare something like globalThis.process = process (imported from node:process) when using cloudflare workers for nextjs and cloudflare worker compatability?

lupin•6/27/24, 4:02 PM

Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker without waiting the response ? The API that I try to contact is just there to receive data and then will do a lot of operations that take some time and I want to close my connection without waiting for the reponse :)

Cheers !

Llupin Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker ...

Chaika•6/27/24, 4:06 PM

ctx.waitUntil is your friend, hand it a promise and it'll let the response return but not kill the execution
ctx.waitUntil(fetch(..))

Chaika•6/27/24, 4:07 PM

https://developers.cloudflare.com/workers/runtime-apis/context/#waituntil

Cloudflare Docs

Context (ctx) · Cloudflare Workers docs

The Context API in Cloudflare Workers, including waitUntil and passThroughOnException.

lupin•6/27/24, 4:11 PM

We've been exploring waitUntil recently. I'll let you know if this is the magicial solution we needed @Chaika :)

Wai #NeyiSevsekKapatılıyor•6/27/24, 5:31 PM

umm what did i do wrong

Code_Megaraptor_Witty_Spanish_2024_June_Thursday_20_30_39.png

Jjohtso Nope, it's just slow 🤷

anthony•6/27/24, 8:23 PM

Pretty similar as to what i've read here. Ingesting PDF's via fetch in context of http request. Want to parse it for the text using unpdf, so i can use it in Workers AI/LLM. Works fine code-wise but explodes in prod because of timeout/memory issues.

Works for small pdf's but reality is i can have some larger ones as well which does not seem possible. Streaming is not an option afaik forthese operations...

johtso•6/27/24, 8:39 PM

Yeah, pdf is a pig of a format. My only recommendations are, if you're hitting timeouts, make the process asynchronous by storing the pdf in R2 and putting a message on a queue. Then you'll have 15 minutes to process it.

If you're hitting memory limits, one possibility could be too find a way to split the pdf into pages without loading the whole thing into memory (I don't know if this is actually possible given the format).. maybe using WASM

johtso•6/27/24, 8:39 PM

@anthony this looks interesting.. https://dev.to/wcchoi/browser-side-pdf-processing-with-go-and-webassembly-13hn

Sstevefrench do you know if there's a way to tell if your worker is exceeding this limit?

Hello, I’m Allie!•6/27/24, 8:45 PM

If a call doesn’t immediately start? It doesn’t throw an error, it just pauses it until a slot frees up

johtso•6/27/24, 8:54 PM

@anthony ooo.. looks like mupdf can handle streams.. https://github.com/ArtifexSoftware/mupdf.js/blob/master/examples/tools/split-pages.js

johtso•6/27/24, 9:02 PM

https://mupdfjs.readthedocs.io/en/latest/how-to-guide/node/document/index.html#extracting-document-text

dave•6/28/24, 2:07 AM

What's the fastest/highest perf way to validate an incoming request for valid JSON?

Ppeshakoo probably just native .parse() or .stringify() with a catch :bibicat:

dave•6/28/24, 3:16 AM

Hmm, that’s gonna require buffering the whole thing in memory first though.

Ppeshakoo Using [dns-over-https](https://developers.cloudflare.com/1.1.1.1/encryption/dns-...

dave•6/28/24, 3:40 AM

I don’t think CF would even notice at that tiny volume.

dave•6/28/24, 3:40 AM

You can do a fetch with zone caching enabled too iirc.

Jjohtso @anthony ooo.. looks like mupdf can handle streams.. <https://github.com/Artifex...

anthony•6/28/24, 4:56 AM

Interesting, going to look into this!

Ddave What's the fastest/highest perf way to validate an incoming request for valid JS...

johtso•6/28/24, 8:39 AM

Maybe check this out? https://github.com/xtao-org/jsonhilo

Jjohtso @anthony ooo.. looks like mupdf can handle streams.. <https://github.com/Artifex...

anthony•6/28/24, 9:29 AM

What range of pdf sizes were you having trouble with btw?

Aanthony What range of pdf sizes were you having trouble with btw?

johtso•6/28/24, 9:35 AM

Only 2MB, so didn't have memory issues, but nearly 200 pages, so took 5 seconds or so.. but fast enough that I could just process it in response to a request

agrajalpha•6/28/24, 11:13 AM

How to download and display images from Workers R2 binding on a page using Javascript?

UUnsmart durable objects is how I would do it (and is how cloudflare is building a workfl...

Supreme Commander ⚡•6/28/24, 1:16 PM

hey @Unsmart | Tech debt @MetalGear is this still work in progress?

Hermes•6/28/24, 1:35 PM

Hello! I was looking at this example https://github.com/cloudflare/js-rpc-and-entrypoints-demo/tree/main/public-admin-api-interfaces about using a dedicated worker for DB interactions using RPC for inter-workers calls.

From my understanding of the docs, RPC calls are usually executed in the same machine.
However, workers with D1 attached are usually executed closer to D1.

In this case what would happen? Will this RPC call happen in the same machine with the trip to D1 location or the RPC call will happen via network?

Example:

worker-db with a D1 attached in EU
worker-front with service bind to worker-db

Then worker-front receives a request from US, which usually happens closer to the user.

What will happen then?

1 - worker-front and worker-db executed closer to user (US) and network trip to D1 db?
2 - worker-front execution in US and RPC call via network with worker-db running closer to DB (EU)?
3 - Both workers executed closer to DB (EU)?
4 - Something else?

GitHub

js-rpc-and-entrypoints-demo/public-admin-api-interfaces at main · c...

Contribute to cloudflare/js-rpc-and-entrypoints-demo development by creating an account on GitHub.

Natan Parmigiano•6/28/24, 4:46 PM

Hey guys!

Might be a dumb question but, is the Cloudflare workers cache API suitable for credential and authorization policy caching?

Would it be secure to store this kinds of sensitive information in a custom cache instance (cache.open)?

Are cache instances guaranteed to be private inside a CF account?

NNatan Parmigiano Hey guys! Might be a dumb question but, is the Cloudflare workers cache API sui...

Hard@Work•6/28/24, 5:28 PM

They are guaranteed to only be accessible within your account. You can even use a fake URL like https://mystore/somepersonhttps://mystore/someperson

Natan Parmigiano•6/28/24, 6:06 PM

that was exactly my main worry, i, currently using something to the lines of https://<tenantid>.policyengine/<role>
i was worried if collisions with other accounts were a risk

Natan Parmigiano•6/28/24, 6:06 PM

thank you for the clarification

Lume•6/28/24, 6:15 PM

Can I call multiple user workers from a dynamic dispatch worker in a single request?

HHard@Work They are guaranteed to only be accessible within your account. You can even use ...

Natan Parmigiano•6/28/24, 6:17 PM

About the cache purge situation, is there really no way to purge a single URL outside the enterprise plan?,,
Thats inviabilizes the idea.. if so i might need to go to KV or Redis instead

I was thinking of using it as a Cedar policy cache, i managed to run the recently open-sourced cedar policy engine (the AWS permissions engine) inside a rust worker, and im trying to build a low cost api gateway alternative with CEDAR policy resource management suport. adding the requirement of one or more kv requests per api call seems a shame while having an amazing cache api, but an authorization service without near instant policies updating seems.. wrong

NNatan Parmigiano About the cache purge situation, is there really no way to purge a single URL ou...

Hard@Work•6/28/24, 6:18 PM

For Zones on Free/Pro/Business plan, you may purge up to 30 URLs in one API call

Hard@Work•6/28/24, 6:19 PM

Though this only applies to caches.defaultcaches.default iirc

HHard@Work Though this only applies to `caches.default` iirc

Natan Parmigiano•6/28/24, 6:19 PM

Oh.. thats.. ok i guess?
Would it be ok to save the cache in the default cache while using a fictional url like we talked about above?

LLume Can I call multiple user workers from a dynamic dispatch worker in a single requ...

Lume•6/28/24, 6:20 PM

And if so, how would that be billed?

NNatan Parmigiano Oh.. thats.. ok i guess? Would it be ok to save the cache in the default cache w...

Hard@Work•6/28/24, 6:20 PM

It should be fine. You could even use a real URL that isn't on your account, like google.comgoogle.com

Natan Parmigiano•6/28/24, 6:21 PM

If that URL never comes to actually exist, and be publically hosted in my CF account, theres no risk of the contents being exposed, is that correct?

is there a way to decrease number of requests for workers , as each visit to my website is hitting t

Similar Threads

Similar Threads

Similar Threads