19 replies

Is Cloudflare blocking my site?

If I use curl, with its default headers, I get a response saying that my site is unavailable (with a 404 response code). If I use curl, but change its headers to ones that match my normal browser, I get the response I expect.

$> # the following command returns 404 and references cloudflare's IP addresses in the response headers
$> curl -v https://beakpointinsights.com
$> # the following command works correctly and doesn't refer to cloudflare in the response headers
$> curl -v https://beakpointinsights.com/ -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Edg/127.0.0.0"

$> # the following command returns 404 and references cloudflare's IP addresses in the response headers
$> curl -v https://beakpointinsights.com
$> # the following command works correctly and doesn't refer to cloudflare in the response headers
$> curl -v https://beakpointinsights.com/ -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Edg/127.0.0.0"

I am on the free Cloudflare plan. My DNS settings are shown in the attachment. I have no custom WAF settings. Bot Fight Mode and Block AI Scrapers and Crawlers are both disabled.

Cloudflare Developers•2y ago•

19 replies

Alan

Is Cloudflare blocking my site?

$> # the following command returns 404 and references cloudflare's IP addresses in the response headers
$> curl -v https://beakpointinsights.com
$> # the following command works correctly and doesn't refer to cloudflare in the response headers
$> curl -v https://beakpointinsights.com/ -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Edg/127.0.0.0"

$> # the following command returns 404 and references cloudflare's IP addresses in the response headers
$> curl -v https://beakpointinsights.com
$> # the following command works correctly and doesn't refer to cloudflare in the response headers
$> curl -v https://beakpointinsights.com/ -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Edg/127.0.0.0"

I am on the free Cloudflare plan. My DNS settings are shown in the attachment. I have no custom WAF settings. Bot Fight Mode and Block AI Scrapers and Crawlers are both disabled.

Is Cloudflare blocking my site?

Similar Threads

Is Cloudflare blocking my site?

Similar Threads

Similar Threads

Similar Threads