Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker without waiting the

Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker without waiting the response ? The API that I try to contact is just there to receive data and then will do a lot of operations that take some time and I want to close my connection without waiting for the reponse :)

Cheers !

Llupin Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker ...

Chaika•6/27/24, 4:06 PM

ctx.waitUntil is your friend, hand it a promise and it'll let the response return but not kill the execution
ctx.waitUntil(fetch(..))

Chaika•6/27/24, 4:07 PM

https://developers.cloudflare.com/workers/runtime-apis/context/#waituntil

Cloudflare Docs

Context (ctx) · Cloudflare Workers docs

The Context API in Cloudflare Workers, including waitUntil and passThroughOnException.

lupinOP•6/27/24, 4:11 PM

We've been exploring waitUntil recently. I'll let you know if this is the magicial solution we needed @Chaika :)

Wai #NeyiSevsekKapatılıyor•6/27/24, 5:31 PM

umm what did i do wrong

Code_Megaraptor_Witty_Spanish_2024_June_Thursday_20_30_39.png

Jjohtso Nope, it's just slow 🤷

anthony•6/27/24, 8:23 PM

Pretty similar as to what i've read here. Ingesting PDF's via fetch in context of http request. Want to parse it for the text using unpdf, so i can use it in Workers AI/LLM. Works fine code-wise but explodes in prod because of timeout/memory issues.

Works for small pdf's but reality is i can have some larger ones as well which does not seem possible. Streaming is not an option afaik forthese operations...

johtso•6/27/24, 8:39 PM

Yeah, pdf is a pig of a format. My only recommendations are, if you're hitting timeouts, make the process asynchronous by storing the pdf in R2 and putting a message on a queue. Then you'll have 15 minutes to process it.

If you're hitting memory limits, one possibility could be too find a way to split the pdf into pages without loading the whole thing into memory (I don't know if this is actually possible given the format).. maybe using WASM

johtso•6/27/24, 8:39 PM

@anthony this looks interesting.. https://dev.to/wcchoi/browser-side-pdf-processing-with-go-and-webassembly-13hn

Sstevefrench do you know if there's a way to tell if your worker is exceeding this limit?

Hello, I’m Allie!•6/27/24, 8:45 PM

If a call doesn’t immediately start? It doesn’t throw an error, it just pauses it until a slot frees up

johtso•6/27/24, 8:54 PM

@anthony ooo.. looks like mupdf can handle streams.. https://github.com/ArtifexSoftware/mupdf.js/blob/master/examples/tools/split-pages.js

johtso•6/27/24, 9:02 PM

https://mupdfjs.readthedocs.io/en/latest/how-to-guide/node/document/index.html#extracting-document-text

dave•6/28/24, 2:07 AM

What's the fastest/highest perf way to validate an incoming request for valid JSON?

Ppeshakoo probably just native .parse() or .stringify() with a catch :bibicat:

dave•6/28/24, 3:16 AM

Hmm, that’s gonna require buffering the whole thing in memory first though.

Ppeshakoo Using [dns-over-https](https://developers.cloudflare.com/1.1.1.1/encryption/dns-...

dave•6/28/24, 3:40 AM

I don’t think CF would even notice at that tiny volume.

dave•6/28/24, 3:40 AM

You can do a fetch with zone caching enabled too iirc.

Jjohtso @anthony ooo.. looks like mupdf can handle streams.. <https://github.com/Artifex...

anthony•6/28/24, 4:56 AM

Interesting, going to look into this!

Ddave What's the fastest/highest perf way to validate an incoming request for valid JS...

johtso•6/28/24, 8:39 AM

Maybe check this out? https://github.com/xtao-org/jsonhilo

Jjohtso @anthony ooo.. looks like mupdf can handle streams.. <https://github.com/Artifex...

anthony•6/28/24, 9:29 AM

What range of pdf sizes were you having trouble with btw?

Aanthony What range of pdf sizes were you having trouble with btw?

johtso•6/28/24, 9:35 AM

Only 2MB, so didn't have memory issues, but nearly 200 pages, so took 5 seconds or so.. but fast enough that I could just process it in response to a request

agrajalpha•6/28/24, 11:13 AM

How to download and display images from Workers R2 binding on a page using Javascript?

UUnsmart durable objects is how I would do it (and is how cloudflare is building a workfl...

Supreme Commander ⚡•6/28/24, 1:16 PM

hey @Unsmart | Tech debt @MetalGear is this still work in progress?

Hermes•6/28/24, 1:35 PM

Hello! I was looking at this example https://github.com/cloudflare/js-rpc-and-entrypoints-demo/tree/main/public-admin-api-interfaces about using a dedicated worker for DB interactions using RPC for inter-workers calls.

From my understanding of the docs, RPC calls are usually executed in the same machine.
However, workers with D1 attached are usually executed closer to D1.

In this case what would happen? Will this RPC call happen in the same machine with the trip to D1 location or the RPC call will happen via network?

Example:

worker-db with a D1 attached in EU
worker-front with service bind to worker-db

Then worker-front receives a request from US, which usually happens closer to the user.

What will happen then?

1 - worker-front and worker-db executed closer to user (US) and network trip to D1 db?
2 - worker-front execution in US and RPC call via network with worker-db running closer to DB (EU)?
3 - Both workers executed closer to DB (EU)?
4 - Something else?

GitHub

js-rpc-and-entrypoints-demo/public-admin-api-interfaces at main · c...

Contribute to cloudflare/js-rpc-and-entrypoints-demo development by creating an account on GitHub.

Natan Parmigiano•6/28/24, 4:46 PM

Hey guys!

Might be a dumb question but, is the Cloudflare workers cache API suitable for credential and authorization policy caching?

Would it be secure to store this kinds of sensitive information in a custom cache instance (cache.open)?

Are cache instances guaranteed to be private inside a CF account?

NNatan Parmigiano Hey guys! Might be a dumb question but, is the Cloudflare workers cache API sui...

Hard@Work•6/28/24, 5:28 PM

They are guaranteed to only be accessible within your account. You can even use a fake URL like

https://mystore/someperson

https://mystore/someperson

Natan Parmigiano•6/28/24, 6:06 PM

that was exactly my main worry, i, currently using something to the lines of https://<tenantid>.policyengine/<role>
i was worried if collisions with other accounts were a risk

Natan Parmigiano•6/28/24, 6:06 PM

thank you for the clarification

Lume•6/28/24, 6:15 PM

Can I call multiple user workers from a dynamic dispatch worker in a single request?

HHard@Work They are guaranteed to only be accessible within your account. You can even use ...

Natan Parmigiano•6/28/24, 6:17 PM

About the cache purge situation, is there really no way to purge a single URL outside the enterprise plan?,,
Thats inviabilizes the idea.. if so i might need to go to KV or Redis instead

I was thinking of using it as a Cedar policy cache, i managed to run the recently open-sourced cedar policy engine (the AWS permissions engine) inside a rust worker, and im trying to build a low cost api gateway alternative with CEDAR policy resource management suport. adding the requirement of one or more kv requests per api call seems a shame while having an amazing cache api, but an authorization service without near instant policies updating seems.. wrong

NNatan Parmigiano About the cache purge situation, is there really no way to purge a single URL ou...

Hard@Work•6/28/24, 6:18 PM

For Zones on Free/Pro/Business plan, you may purge up to 30 URLs in one API call

Hard@Work•6/28/24, 6:19 PM

Though this only applies to

caches.default

caches.default

iirc

HHard@Work Though this only applies to `caches.default` iirc

Natan Parmigiano•6/28/24, 6:19 PM

Oh.. thats.. ok i guess?
Would it be ok to save the cache in the default cache while using a fictional url like we talked about above?

LLume Can I call multiple user workers from a dynamic dispatch worker in a single requ...

Lume•6/28/24, 6:20 PM

And if so, how would that be billed?

NNatan Parmigiano Oh.. thats.. ok i guess? Would it be ok to save the cache in the default cache w...

Hard@Work•6/28/24, 6:20 PM

It should be fine. You could even use a real URL that isn't on your account, like

google.com

google.com

Natan Parmigiano•6/28/24, 6:21 PM

If that URL never comes to actually exist, and be publically hosted in my CF account, theres no risk of the contents being exposed, is that correct?

HHard@Work > For Zones on Free/Pro/Business plan, you may purge up to 30 URLs in one API ca...

Natan Parmigiano•6/28/24, 6:22 PM

If thats not too much to ask, would you be able to provide me with a link to the docs for that API call or SDK? On the cache documentation i only found the prefix based cache purge (marked as Enterprise)

NNatan Parmigiano If thats not too much to ask, would you be able to provide me with a link to the...

Hard@Work•6/28/24, 6:22 PM

https://developers.cloudflare.com/api/operations/zone-purge

Cloudflare API Documentation

Interact with Cloudflare's products and services via the Cloudflare API

Natan Parmigiano•6/28/24, 6:23 PM

Thanks!
Ill try it out, if i have good results (and performance) ill probably open source my cedar-policy-on-cf repo

Natan Parmigiano•6/28/24, 6:47 PM

Right now im getting 3ms for policy lookup, parsing and allowed/denied outcome on a 20 entities, 10 principals setup, seems amazingly quick! With added JWT parsing (and maybe caching with TTL equal to token exp) im thinking ican keep it under 25ms total, which blows AWS API Gateway out of the water!

Ppeshakoo Would it be bad to send a non cryptographically secure 8 length long code *JUST*...

Hello, I’m Allie!•6/28/24, 9:49 PM

I’d say no. Some places even just use 6 digits. Though, you could probably go much longer if you made it a link

safah222•6/28/24, 10:34 PM

is there a way to decrease number of requests for workers , as each visit to my website is hitting the worker hundreds of time , for each path , and for each request it count 1 request
?

safah222•6/28/24, 10:46 PM

each visit cost me more than 1000 request worker , I just need the worker to work 1 time for each ip address

Silent•6/28/24, 10:52 PM

the md5 option in r2 bucket#put accepts arraybuffer and string. I input a hexadecimal string however,
the bucket response#checksums#md5 returns an arraybuffer regardless. How do i get it as a string, does cloudflare change it in any way while storing it?

Ssafah222 is there a way to decrease number of requests for workers , as each visit to my ...

Hello, I’m Allie!•6/28/24, 11:04 PM

You have already asked this question

safah222•6/28/24, 11:13 PM

and no one answered me

safah222•6/28/24, 11:13 PM

the answer was not related to my question which was to decrease number of requests

safah222•6/28/24, 11:14 PM

I just want to trigger 1 worker request for each ip address

Hi everyone ! Is there a way to send a fetch request from the Cloudflare worker without waiting the

Similar Threads

Similar Threads

Similar Threads