Hello, is it possible to modify HTML of react site using cloudflare workers with HTMLRewriter? If m

Hello, is it possible to modify HTML of react site using cloudflare workers with HTMLRewriter?
If my understanding is correct cloudflare workers modify HTTP responses.
But on react site there is not a new HTTP request when page is loaded because react works by changing DOM content.
Any help and explanations would be greatly appreciated!

Vvakno Hello, is it possible to modify HTML of react site using cloudflare workers with...

Hello, I’m Allie!•4/3/24, 8:51 AM

HTMLRewriter can only modify HTML that exists Server-Side. Generally, React uses a single div, that is then populated on the client side. So unless you can get React to do some of the work on the server, then no

dave•4/3/24, 11:55 AM

✘ [ERROR]   Error: Request closed due to connection limit

✘ [ERROR]   Error: Request closed due to connection limit

dave•4/3/24, 11:55 AM

wat, I thought more than 5 subrequest connections would just queue up?

Ddave ``` ✘ [ERROR] Error: Request closed due to connection limit ```

Hello, I’m Allie!•4/3/24, 12:08 PM

Maybe you are hitting this?

HHello, I’m Allie!Maybe you are hitting this?

dave•4/3/24, 12:10 PM

na, I am not doing anywhere near 1000 requests

Ddave na, I am not doing anywhere near 1000 requests

Hello, I’m Allie!•4/3/24, 12:10 PM

How about 50?

HHello, I’m Allie!How about 50?

dave•4/3/24, 12:12 PM

nope. I'm doing:

5 subrequests to R2 through the bindings.
5 subrequests to the Cache API
2 subrequests to Backblaze B2

If I await between the R2 put's and the Cache API put's, the error goes away.

Ddave nope. I'm doing: 5 subrequests to R2 through the bindings. 5 subrequests to the...

Hello, I’m Allie!•4/3/24, 12:14 PM

Might be this?

If the system detects that a Worker is deadlocked on open connections — for example, if the Worker has pending connection attempts but has no in-progress reads or writes on the connections that it already has open — then the least-recently-used open connection will be canceled to unblock the Worker.

If the Worker later attempts to use a canceled connection, an exception will be thrown. These exceptions should rarely occur in practice, though, since it is uncommon for a Worker to open a connection that it does not have an immediate use for.

Otherwise, not sure what it could be

HHello, I’m Allie!*Might* be this? > If the system detects that a Worker is deadlocked on open con...

dave•4/3/24, 12:14 PM

I wonder if there's an undocumented limit still for internal subrequests

Ddave I wonder if there's an undocumented limit still for internal subrequests

Hello, I’m Allie!•4/3/24, 12:15 PM

I don't think so? Pretty sure I've run 20+ concurrently before

HHello, I’m Allie!*Might* be this? > If the system detects that a Worker is deadlocked on open con...

dave•4/3/24, 12:15 PM

wouldn't that be an exception, not a "Too many subrequests"?

Ddave wouldn't that be an exception, not a "Too many subrequests"?

Hello, I’m Allie!•4/3/24, 12:16 PM

HHello, I’m Allie!I don't think so? Pretty sure I've run 20+ concurrently before

dave•4/3/24, 12:16 PM

to the cache api?

Hello, I’m Allie!•4/3/24, 12:16 PM

I would assume not, but can't be sure just from the dash

Ddave to the cache api?

Hello, I’m Allie!•4/3/24, 12:16 PM

The Cache API, DOs, KV. 20+ each

Hello, I’m Allie!•4/3/24, 12:16 PM

I can try passing it up to see, but otherwise, might be worth a ticket

HHello, I’m Allie!The Cache API, DOs, KV. 20+ each

dave•4/3/24, 12:25 PM

huh, weird.

HHello, I’m Allie!The Cache API, DOs, KV. 20+ each

dave•4/3/24, 12:27 PM

with the same ReadableStream source?

dave•4/3/24, 12:30 PM

for context, what I'm doing, is shoving the same data into five R2 buckets in each region, and also pushing it into the Cache API (so I avoid a Class B completely in even more situations).

Ddave with the same ReadableStream source?

Hello, I’m Allie!•4/3/24, 12:52 PM

No, they were different. Just got a response though, so looks like what you were doing(awaiting them halfway through) is what you are supposed to do

HHello, I’m Allie!No, they were different. Just got a response though, so looks like what you were...

dave•4/3/24, 12:52 PM

oh, why is that? I thought this would cause buffering and be bad.

Ddave oh, why is that? I thought this would cause buffering and be bad.

Hello, I’m Allie!•4/3/24, 1:02 PM

cache.putcache.put doesn't actually return anything, just an empty promise. R2 does return an R2ObjectR2Object, but that doesn't actually include the body. For the two requests to Backblaze, you can call response.body.cancel()response.body.cancel() to ensure they are closed

HHello, I’m Allie!`cache.put` doesn't actually return anything, just an empty promise. R2 does ret...

dave•4/3/24, 1:03 PM

I mean buffering of the input

Ddave I mean buffering of the input 🙂

Hello, I’m Allie!•4/3/24, 1:04 PM

Well, they wouldn't be processed entirely in parallel anyway, since it would only be running half of them at once

Hello, I’m Allie!•4/3/24, 1:04 PM

So it would already be buffering it somewhere

HHello, I’m Allie!Well, they wouldn't be processed entirely in parallel anyway, since it would onl...

dave•4/3/24, 1:05 PM

hm, good point. I guess it'll probably be fine, since I only take in files <100MB

Ddave hm, good point. I guess it'll probably be fine, since I only take in files <100M...

Hello, I’m Allie!•4/3/24, 1:06 PM

Otherwise, you can put it to R2, then pull it back out into Cache. Might be convoluted, but

HHello, I’m Allie!Otherwise, you can put it to R2, then pull it back out into Cache. Might be conv...

dave•4/3/24, 1:07 PM

oh I was just optimizing so I never technically have to pull from R2

TravisFrank•4/3/24, 2:07 PM

Is there a way to publish a JSON environment variable via the dashboard? Docs show how to do this in Wrangler but not the dash (https://developers.cloudflare.com/workers/configuration/environment-variables/)

Cloudflare Docs

Environment variables · Cloudflare Workers docs

Attach text strings and JSON values as environment variables to your Worker.

dave•4/3/24, 4:25 PM

stupid question, how does a Queue decide on it's location?

Frederik•4/3/24, 4:38 PM

in which repo should i raise an issue with @cloudflare/worker-types@cloudflare/worker-types? is it workers-sdkworkers-sdk or

workerd

workerd

kian•4/3/24, 5:04 PM

workerd

safah222•4/3/24, 7:12 PM

Hello guys , I am using cloudflare worker to detect vpn , and I am using

safah222•4/3/24, 7:12 PM

if (request.cf.botManagement.verifiedBot) {
// Logic for handling verified bots
// You can choose to bypass certain operations or handle them differently
return fetch(request);
}
to detect the good bots (( using bots managment system )) how ever its not working , and its not detecting the bots , there are some traffic which got detected by WAF known bots , how ever its not detected by worker , can you help me please

kian•4/3/24, 7:15 PM

You need to be on an Enterprise plan with the Bot Management add-on to use that

safah222•4/3/24, 7:16 PM

what is the other option , I want to detect the known bots by the worker , known bots can be used even in free plan

Walshy•4/3/24, 7:16 PM

Also verifiedBot means like a search engine crawler and things. Services we know are good bots

WWalshy Also verifiedBot means like a search engine crawler and things. Services we know...

safah222•4/3/24, 7:17 PM

Correct, and this is what I want , simply to find a way that can detect the known bots (( or verified bots )) by the worker

Walshy•4/3/24, 7:20 PM

You mentioned VPN though?

Walshy•4/3/24, 7:20 PM

That doesn't detect VPNs

Ssafah222 what is the other option , I want to detect the known bots by the worker , known...

Walshy•4/3/24, 7:22 PM

The property is faked for those without BM, reason being was to not break workers using them before it was properly gated

Walshy•4/3/24, 7:22 PM

IIRC it always returns false for those without

safah222•4/3/24, 7:24 PM

forget about VPN

safah222•4/3/24, 7:25 PM

I just want a way to detect if the traffic was from known bots (( VERIFIED BOTS )) or not , what is the way that I can use via worker to do that

Ssafah222 I just want a way to detect if the traffic was from known bots (( VERIFIED BOTS ...

Isaac McFadyen•4/3/24, 7:27 PM

You can't, as Walshy has said above - without Bot Management which requires an Enterprise contract that property will always return

false

false

kian•4/3/24, 7:27 PM

You can use verified bot category

kian•4/3/24, 7:27 PM

All plans get that

kian•4/3/24, 7:27 PM

It's like req.cf.verifiedBotCategoryreq.cf.verifiedBotCategory or something

Walshy•4/3/24, 7:28 PM

Is that meant to be available to all? :p

Hello, is it possible to modify HTML of react site using cloudflare workers with HTMLRewriter? If m

Similar Threads

Similar Threads

Similar Threads