I'm building a webperf tester (e.g. say
I'm building a webperf tester (e.g. say similar to PageSpeed Insights) but on top of CF Puppeteer. I saw turnstile/bot challenges on some Cloudflare zones, but I'm surprised that Cloudflare's Radar itself also does get challenged.
I guess this is bot traffic so it makes sense. Would the expected behavior be that any domains who aggressively block bots should allow explicitly (via custom header or user-agent)? Or if you hit enough traffic (+1k requests/day) apply to be a verified bot?
I guess this is bot traffic so it makes sense. Would the expected behavior be that any domains who aggressively block bots should allow explicitly (via custom header or user-agent)? Or if you hit enough traffic (+1k requests/day) apply to be a verified bot?
