My main issue at the moment is sometimes I am doing some subrequests with the built in `fetch` libra

My main issue at the moment is sometimes I am doing some subrequests with the built in

fetch

fetch

library and they are failing with 521 status codes. I don't understand why that would be. So I was going to switch to a different http library to see if that would help at all.

Jjason Is it possible to use got (https://www.npmjs.com/package/got) in a worker? I'm t...

Chaika•4/25/24, 10:18 PM

no, looks like that uses node:net/raw sockets

Chaika•4/25/24, 10:18 PM

Workers use V8 Isolates, in a web like environment. Not node,js, although they support some node functions via node compat. They support TCP Sockets through their own interface, but not node networking or raw sockets, nor UDP

Chaika•4/25/24, 10:20 PM

Your options are pretty much:
Use Fetch which sort of goes out through the CDN/normal request path
Use something built on top of custom TCP Sockets API which uses Cloudflare WARP IPs (no list of them). You'd suffer from not being able to keep connections warm/new connection each time and such though

Jjason My main issue at the moment is sometimes I am doing some subrequests with the bu...

Chaika•4/25/24, 10:21 PM

521 is web server down

Error 521 occurs when the origin web server refuses connections from Cloudflare. Security solutions at your origin may block legitimate connections from certain Cloudflare IP addresses

If it's something you control, does it work through a normal proxied record? Are you specifying a non-standard port?

Lucho•4/25/24, 10:32 PM

Hi everyone
I've been having problems using Workers & Pages and D1
With my team we created a D1 database and we want to "connect " it with our web app. We want to connect Backend with Frontend, pulling data from the D1 database and use it on our app (i don't know how to call it)
Could someone help?

LLucho Hi everyone I've been having problems using Workers & Pages and D1 With my team ...

bun•4/25/24, 10:46 PM

help with what

Lucho•4/25/24, 11:00 PM

I have some data in the format on JSONs which i would like to insert in my remote D1 database, which im not being able of doing, and later make querys

Lucho•4/25/24, 11:01 PM

so i would need help on how to insert this data into the DB

keithj5389•4/26/24, 3:00 AM

Does anyone know if there is a worker that will allow me to browse my R2 backup folder of JPGs ? And ideally convert them to thumbnails on the fly & save a copy in a /thumbnails folder too. (I don't want to use the $5pm Images product). I'm happy to write one myself, but I am currently time poor.

onnimonni•4/26/24, 8:54 AM

Can I set cache headers from worker and have the next requests for the same URL skip the worker completely?

Rich•4/26/24, 9:39 AM

I'm finding "Purge Everything" is failing to purge cache entries written using the Cache API and I've got a suspicion it's related to the fact we open our own cache rather than use the default, i.e. caches.open('app')caches.open('app') vs caches.defaultcaches.default.

Can anybody confirm this is expected behaviour and if so, is there a way to purge the 'app' cache instead of the default one?

Oonnimonni Can I set cache headers from worker and have the next requests for the same URL ...

Hello, I’m Allie!•4/26/24, 9:44 AM

You cannot, no. All requests to a Worker route result in an invocation

onnimonni•4/26/24, 10:07 AM

A bit tangential but related: how does one protect against major cloud bill if DDOS happens with workers?

Original message was deleted

Rich•4/26/24, 10:37 AM

Does this mean there's no way to purge a custom cache across all data centers?

Rich•4/26/24, 10:40 AM

I can't really find any real documentation on caches.opencaches.open , I wonder what the use cases for it are?

Rich•4/26/24, 10:40 AM

(tbh we used it because we were using Shopify Hydrogen as a reference

)

RRich I can't really find any real documentation on `caches.open` , I wonder what the ...

Hello, I’m Allie!•4/26/24, 10:42 AM

Probably for compat with the CacheStorageCacheStorage WebAPI?

MDN Web Docs

CacheStorage: open() method - Web APIs | MDN

The open() method of the
CacheStorage interface returns a Promise that resolves to
the Cache object matching the cacheName.

Hello, I’m Allie!•4/26/24, 10:42 AM

Though caches.defaultcaches.default isn't actually a thing there...

HHello, I’m Allie!Probably for compat with the [`CacheStorage`](https://developer.mozilla.org/en-U...

Rich•4/26/24, 10:48 AM

yeah I saw that, but it doesn't really help with the practical differences regarding CF's cache impl. + purging

Rich•4/26/24, 10:49 AM

Might be worth updating the docs here https://developers.cloudflare.com/workers/reference/how-the-cache-works/#purge-assets-stored-with-the-cache-api to mention some of that applies to cache.opencache.open

Cloudflare Docs

How the Cache works · Cloudflare Workers docs

How Workers interacts with the Cloudflare cache.

RRich yeah I saw that, but it doesn't really help with the practical differences regar...

Hello, I’m Allie!•4/26/24, 10:49 AM

If it makes a difference, the Cache API doesn't validate that the domains of the URLs you pass in exist. So you could just make up a fake domain to create different cache spaces

Rich•4/26/24, 10:51 AM

ha interesting. It's a really funny API to work with tbh. Kinda dancing around http even though a lot of use cases would be simpler by just passing a string as the cache key.

Rich•4/26/24, 10:52 AM

out of interest, are cache entries written via the Cache API considered part of the zone the worker is running on or is it the zone of the url being cached?

Rich•4/26/24, 10:52 AM

e.g.. worker on foo.com caches something under bar.com

RRich out of interest, are cache entries written via the Cache API considered part of ...

Hello, I’m Allie!•4/26/24, 10:52 AM

The zone of the Worker. You can cache a cloudflare.comcloudflare.com request, but it won't affect the actual cache for cloudflare.comcloudflare.com

Hello, I’m Allie!•4/26/24, 10:53 AM

Would be very bad if you could mess with other people's caches that way...

Rich•4/26/24, 10:53 AM

Yeah that's what I was thinking, although this flow chart had me worried https://developers.cloudflare.com/workers/reference/how-the-cache-works/#single-file-purge--assets-cached-by-a-worker

Cloudflare Docs

How the Cache works · Cloudflare Workers docs

How Workers interacts with the Cloudflare cache.

Rich•4/26/24, 10:54 AM

(we're caching API calls to shopify which I know is also on CF)

Rich•4/26/24, 10:55 AM

but I guess that's actually specific to the ability to single-file purge, i.e. because shopify is on CF then we can't single file purge, as they own that... but maybe we should just change it to be cached under https://{uuid}.comhttps://{uuid}.com or https://domain-we-own.comhttps://domain-we-own.com and then we can single file purge?

Rich•4/26/24, 11:07 AM

Although still worrying to think the owner (shopify) can purge our cache entries "Sorry, you can not purge the asset. Only the owner of notexample.com can purge it"

RRich Although still worrying to think the owner (shopify) can purge our cache entries...

Hello, I’m Allie!•4/26/24, 11:10 AM

You could also use https://shopify.com.richa.rd/somePathhttps://shopify.com.richa.rd/somePath as the URL?

Rich•4/26/24, 11:11 AM

but what if .rd.rd became a TLD and somebody bought it and put CF in front of it, woudl they be able to suddenly purge my cache entries?

RRich but what if `.rd` became a TLD and somebody bought it and put CF in front of it,...

Hello, I’m Allie!•4/26/24, 11:12 AM

No, I meant put it on a non-existent subdomain of your domain

Hello, I’m Allie!•4/26/24, 11:12 AM

Since you own it, then only you could break it

Hello, I’m Allie!•4/26/24, 11:12 AM

I was just using richa.rdricha.rd as an example, I don't know what your actual domain is

Rich•4/26/24, 11:12 AM

ah right, got you. Yes I think that sounds like the safest bet

Rich•4/26/24, 11:15 AM

Also, even if I switched it out for our domain, I'd still need to use caches.defaultcaches.default to ensure we can purge it globally (i.e. with "Purge Everything")

Lucho•4/26/24, 2:08 PM

Hi everyone

Lucho•4/26/24, 2:10 PM

Im trying to make Inserts in my D1 Database and i would like to recieve de surrogated key of each insert i make, but it looks like line 42 does not return this new ID

Lucho•4/26/24, 2:10 PM

does someone know how to fix this?

Dawson•4/26/24, 6:30 PM

does CF Cache just use KV?

Dawson•4/26/24, 6:30 PM

curios as to how it’s so fast

Dawson•4/26/24, 6:31 PM

does it use the priority latency that you get when you pay for workers instead of the free plan?

DDawson does CF Cache just use KV?

Chaika•4/26/24, 6:33 PM

Which cache? The Cache API? The Cache API is entirely colo/datacenter local, evicting assets based on access frequency

DDawson does it use the priority latency that you get when you pay for workers instead o...

Chaika•4/26/24, 6:34 PM

plan shouldn't matter

Dawson•4/26/24, 6:34 PM

just saw a “always lowest latency” or something along those lines. the cache has a 8ms time where as my hono api with a hello world json at the base route takes 30

Dawson•4/26/24, 6:34 PM

just curious as to what makes such a difference

CChaika Which cache? The Cache API? The Cache API is entirely colo/datacenter local, evi...

Dawson•4/26/24, 6:35 PM

i believe so, the one that caches based upon headers which requires a custom domain

DDawson i believe so, the one that caches based upon headers which requires a custom dom...

Chaika•4/26/24, 6:35 PM

sounds like you're talking about the normal cf cache (not in front of a worker/in a worker, in front of a normal origin), vs workers executing?

Dawson•4/26/24, 6:36 PM

yea that sounds right. Sorry, not familiar with the workers side of cf

My main issue at the moment is sometimes I am doing some subrequests with the built in `fetch` libra

Similar Threads

Similar Threads

Similar Threads