Email obfuscated when using HTMLRewriter

Hi, I'm using HTMLRewriter to parse some html data, when deployed I see parsed text has email obfuscated but on my laptop the email shows just fine. I couldn't find this behavior documented anywhere, is it possible to disable this? This is using workers.dev domain. The exact text is [email protected]
S
squareclamp16d ago
This is fetching data from 3rd party website.. I tried disabling scrape shield but still not luck. It seems like the fetch is being proxied through cloudflare cache
C
Cyb3r-Jak316d ago
If the 3rd party site is using Cloudflare then you can’t override their scrape shield setting on your fetch.
S
squareclamp16d ago
They are not using cloudflare judging from the response headers and I can see the email in plain text when running locally
C
Cyb3r-Jak316d ago
The difference between local and deployed is likely due to the IP address being used. When local, it uses your local IP address which is less likely to flagged as automated as Cloudflare’s. If you run with —remote then you’ll probably see the email address as protected because the request will come from Cloudflare. I’d imagine there are other service that protect email addresses from scraping which they could be using.
S
squareclamp16d ago
interesting, I didn't expect that.. I tried using colab too and it grabs the email.
Want results from more Discord servers?
Add your server
More Posts
"No deployment available" when deploying from Github ActionsMy setup is pretty straightforward. I have a Remix app with a simple build step (`remix vite:build`)Pages deployments failing (wrangler deploy)I'm attempting to deploy to an existing Remix (vite with cf) to Pages. Everything has been smooth unworkers-rs repo RA feature detectionDoes anyone else have the problem that rust-analyzer doesn't properly detect the enabled features inDynamically import incompatible packages for dev onlyI am currently dynamically importing a package that is incompatible in workers just during developmeDeploy by pushHello is it possible to deploy changes with git push like it's on vercel for my worker? or i have maAre the api docs for updating worker settings wrong?Specifically looking at this request: https://developers.cloudflare.com/api/operations/worker-scriptHow to access worker queue producer bindings in local development?At boot I see this message: ``` wrangler.toml changed... Using vars defined in .dev.vars Your workeNeed some help on collecting coverage in workers.I know that the coverage via V8 is not possible, but via istanbul it does not collect coverage as weHey there! I'm having some trouble with an SSL free certificate on my website. CloudFlare is active.So I've been trying for days now but I can't get the certification of the SSL.Identity theft reportHow can I contact Cloudflare support to remove from their platform a page that is impersonating a paZero Trust - How to filter Web Socket trafficHi, I'm using an app (iray server) that uses the same port (9090) for the web UI dashboard and WebSoCan you forward certain requests from a Cloudflare Pages site to a different domain?Hello! I'm looking to see if I could deploy a site using PayloadCMS with Cloudflare Pages. They haveHi! I want to pwd-protect my Page. How to do it with Functions?I have a static page set up, live, working. I want to add password protection to the page. I found aSet different domain for public domain and fucntions APII have a site on cloudflare pages using pages functions. the functions also acts like an rest Api vaCloudfare - Pterodactyl Name-Servershow can i connect cloudflare to pterodactyl? because when i put the cloudfare name-servers the nodeerrorIdk why i cant use warp on pc When i installed the app then it said my pc missed something to instalCloudflare HTML Email FormHello. I've created a custom website for a small business (more like customized as I used a templateDoes .me domain not work in Cloudflare pagesI am using the same configurations for Cloudflare Pages with a .com domain. However, when I tried to