ERR_CONNECTION_REFUSED on a headful scraper

Sample Code:

async with async_playwright() as playwright:
    browser = await playwright.chromium.launch(headless=False)
    context = await browser.new_context(
        user_agent=user_agent_strings[random.randint(0, 3)],
        viewport={"width": 1920, "height": 1080},
    )
    page = await context.new_page()
    try:
        await page.goto("https://ca.indeed.com/")
    // playwright._impl._api_types.Error: net::ERR_CONNECTION_REFUSED at https://ca.indeed.com

async with async_playwright() as playwright:
    browser = await playwright.chromium.launch(headless=False)
    context = await browser.new_context(
        user_agent=user_agent_strings[random.randint(0, 3)],
        viewport={"width": 1920, "height": 1080},
    )
    page = await context.new_page()
    try:
        await page.goto("https://ca.indeed.com/")
    // playwright._impl._api_types.Error: net::ERR_CONNECTION_REFUSED at https://ca.indeed.com

Do I have to use a paid proxy? This runs fine locally btw

6 Replies

wise-white•2y ago

Hi @YiMing, could you please share with me the run? If you don't want to share it publicly, you can send it to me in a private message.

fascinating-indigoOP•2y ago

run id 6b7Z2BcPGjRRwbyPi

Pepa J•2y ago

Hi @YiMing , as I understand it you are currently not using any proxies at all, therefore some AWS datacenter IP adress is used. I just tried access the website based on your example, with a another datacenter proxy (Apify Proxy group AUTO) and the website was working fine, but I had to get through additional Captcha detection.

memo23•16mo ago

hey @Pepa J, I am having same issues with one of my actors which use puppeteer crawler, any idea what I can do?

Pepa J•16mo ago

Hi @memo23 Do you have a run on the platform, can you send me a link so we may investigate?

memo23•16mo ago

@Pepa J can I dm you, and yes, I have hey @Pepa J this is my pricate actor: memo23/apify-indeed, all runs that I run failed, can you investigate please? hey @Pepa J @Lukas Krivka @vojtechmaslan can you help please

Gaming

Programming

ERR_CONNECTION_REFUSED on a headful scraper

Did you find this page helpful?