Browerless + Crawlee

Hello, Is there any way to run Crawlee on Browserless?

5 Replies

Hall•5w ago

Someone will reply to you shortly. In the meantime, this might help:

MEE6•5w ago

@Martin just advanced to level 1! Thanks for your contributions! 🎉

I don't think so. Why would you want to do so? On their site they mention that they support Playwright, Puppeteer & Cheerio.

stormy-goldOP•5w ago

To offload web scraping for my service so it doesn't kill my vps. I'm trying to do it liek that but there's no such option:

      launchOptions: {
        wsEndpoint: "BROWSERLESS ENDPOINT",

Jon•4d ago

Reviewing the source: https://github.com/apify/crawlee/blob/master/packages/puppeteer-crawler/src/internals/puppeteer-launcher.ts export async function launchPuppeteer( launchContext?: PuppeteerLaunchContext, config = Configuration.getGlobalConfig(), ): Promise<Browser> { const puppeteerLauncher = new PuppeteerLauncher(launchContext, config); return puppeteerLauncher.launch(); } It looks like crawlee uses "launch" not "connect" const browser = await puppeteer.connect({ browserWSEndpoint: 'ws://localhost:3000', }); https://github.com/browserless/browserless?tab=readme-ov-file#puppeteer I am interested in using browserless as well, but not seeing how to do it.

GitHub

Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses. - browserless/browserless