Headless does not pass httpsbot.sannysoft.com
Code to reproduce:
import { launchPlaywright, utils } from 'crawlee';
const url = 'https://bot.sannysoft.com/';
// Start a browser
const browser = await launchPlaywright({
launchOptions: {
headless: true,
},
});
// Open new tab in the browser
const page = await browser.newPage();
// Navigate to the URL
await page.goto(url);
await new Promise(r => setTimeout(r, 3000));
// Capture the screenshot
await utils.puppeteer.saveSnapshot(page, { key: 'my-key', saveHtml: false });
await browser.close();

1 Reply
rival-black•3y ago
And headful passes well? I'm not sure if non-crawler usage uses fingerprints, can you test with crawler?