Crawlee & Apify•3mo ago

Using BrightData's socks5h proxies

BrightData's datacenter proxies can be used with socks5 but only with remote dns resolution, thus the protocol should be given like socks5h://... Testing it with curl works, but using it in crawlee it doesn't work. Just keeps hanging.

    proxyConfiguration: new ProxyConfiguration({
      newUrlFunction: () => {
        return 'socks5h://brd-customer-...-zone-...:[email protected]:22228';
      },
    })

    proxyConfiguration: new ProxyConfiguration({
      newUrlFunction: () => {
        return 'socks5h://brd-customer-...-zone-...:[email protected]:22228';
      },
    })

Any idea how it should work? Edit: since I use CamouFox, I tried:

        firefoxUserPrefs: {
          'network.proxy.socks_remote_dns': true,  // Enable remote DNS resolution
        },

        firefoxUserPrefs: {
          'network.proxy.socks_remote_dns': true,  // Enable remote DNS resolution
        },

But it still just hangs.

3 Replies

Hall•3mo ago

Someone will reply to you shortly. In the meantime, this might help:

quickest-silverOP•3mo ago

Ended up using proxyChain. Local http proxy to BrightData socks5h.

Pepa J•3mo ago

Hi @Jeno Yes, unfortunately as far as I know the socks5 is not supported by crawlee yet. There is an Issue about it on GitHub where people discuss workaround using proxy-chain just as you mentioned https://github.com/apify/crawlee/issues/389

Gaming

Programming

Using BrightData's socks5h proxies

Did you find this page helpful?