Headless does not pass httpsbot.sannysoft.com

Code to reproduce: import { launchPlaywright, utils } from 'crawlee'; const url = 'https://bot.sannysoft.com/'; // Start a browser const browser = await launchPlaywright({ launchOptions: { headless: true, }, }); // Open new tab in the browser const page = await browser.newPage(); // Navigate to the URL await page.goto(url); await new Promise(r => setTimeout(r, 3000)); // Capture the screenshot await utils.puppeteer.saveSnapshot(page, { key: 'my-key', saveHtml: false }); await browser.close();
No description
1 Reply
rival-black
rival-black3y ago
And headful passes well? I'm not sure if non-crawler usage uses fingerprints, can you test with crawler?

Did you find this page helpful?