Unable to use proxy/proxy not working
My ISP imposed internet censorship, so I need a proxy to access certain websites (e.g., Google, YouTube, Bloomberg, etc.). However, my proxy settings for Chrome just won't work. Any help would be appreciated.
I deployed Shadowsocks-RUST-client as a proxy client, with HTTP schema enabled so that it can handle HTTP proxy.
All my other dockers are using it to bypass censorship. For my other dockers, usually an environment variable such as
I have my Shadowsocks-RUST running in a separate docker network
Here are some logs:
Please help!
I deployed Shadowsocks-RUST-client as a proxy client, with HTTP schema enabled so that it can handle HTTP proxy.
All my other dockers are using it to bypass censorship. For my other dockers, usually an environment variable such as
HTTP_PROXY=172.21.0.1:1080HTTP_PROXY=172.21.0.1:1080 chrome:
image: gcr.io/zenika-hub/alpine-chrome:123
container_name: Hoarder-CHROME
restart: unless-stopped
command:
- --no-sandbox
- --disable-gpu
- --disable-dev-shm-usage
- --remote-debugging-address=0.0.0.0
- --remote-debugging-port=9222
- --hide-scrollbars
- --proxy-server='https=172.21.0.1:1080' chrome:
image: gcr.io/zenika-hub/alpine-chrome:123
container_name: Hoarder-CHROME
restart: unless-stopped
command:
- --no-sandbox
- --disable-gpu
- --disable-dev-shm-usage
- --remote-debugging-address=0.0.0.0
- --remote-debugging-port=9222
- --hide-scrollbars
- --proxy-server='https=172.21.0.1:1080'I have my Shadowsocks-RUST running in a separate docker network
172.21.0.1172.21.0.1Here are some logs:
info: [Crawler][3389] Will crawl "https://www.youtube.com" for link with id "ab35k06ojykaag4l8qgzsgqt"
2025-05-14T11:08:43.361Z info: [Crawler][3389] Attempting to determine the content-type for the url https://www.youtube.com
2025-05-14T11:08:48.365Z error: [Crawler][3389] Failed to determine the content-type for the url https://www.youtube.com: AbortError: The operation was aborted.
2025-05-14T11:08:51.695Z info: [Crawler][3389] Successfully navigated to "https://www.youtube.com". Waiting for the page to load ...
2025-05-14T11:08:56.697Z info: [Crawler][3389] Finished waiting for the page to load.
2025-05-14T11:08:56.757Z info: [Crawler][3389] Successfully fetched the page content.
2025-05-14T11:08:57.264Z info: [Crawler][3389] Finished capturing page content and a screenshot. FullPageScreenshot: true
2025-05-14T11:08:57.282Z info: [Crawler][3389] Will attempt to extract metadata from page ...
2025-05-14T11:09:01.137Z info: [Crawler][3389] Will attempt to extract readable content ...
2025-05-14T11:09:03.899Z info: [Crawler][3389] Done extracting readable content.
2025-05-14T11:09:04.644Z info: [Crawler][3389] Stored the screenshot as assetId: 8c777957-9488-41b8-a434-e6854bf4d39d
⨯ Error: ENOENT: no such file or directory, open '/data/assets/uutwl3rjowf2fezaspgd2ca7/bb180a59-c728-402a-8eeb-faaae39055f6/metadata.json'
at async open (node:internal/fs/promises:633:25)
at async w (/app/apps/web/.next/server/chunks/6815.js:1:1914)
at async Object.readFile (node:internal/fs/promises:1237:14)
at async Promise.all (index 0)
at async q (/app/apps/web/.next/server/app/api/assets/[assetId]/route.js:1:2329)
at async /app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:38411
at async e_.execute (/app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:27880)
at async e_.handle (/app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:39943)
at async doRender (/app/node_modules/next/dist/server/base-server.js:1366:42)
at async cacheEntry.responseCache.get.routeKind (/app/node_modules/next/dist/server/base-server.js:1588:28) {
�
errno: -2,
code: 'ENOENT',
syscall: 'open',
path: '/data/assets/uutwl3rjowf2fezaspgd2ca7/bb180a59-c728-402a-8eeb-faaae39055f6/metadata.json'
}
2025-05-14T11:13:43.063Z info: [Crawler][3389] Will crawl "https://www.youtube.com" for link with id "ab35k06ojykaag4l8qgzsgqt"
2025-05-14T11:13:43.064Z info: [Crawler][3389] Attempting to determine the content-type for the url https://www.youtube.com
Error: Timed-out after 300 secs
2025-05-14T11:13:43.329Z error: [Crawler][3389] Crawling job failed: Error: Timed-out after 300 secs
at Timeout._onTimeout (/app/apps/workers/utils.ts:2:1025)
at listOnTimeout (node:internal/timers:588:17)
at process.processTimers (node:internal/timers:523:7)info: [Crawler][3389] Will crawl "https://www.youtube.com" for link with id "ab35k06ojykaag4l8qgzsgqt"
2025-05-14T11:08:43.361Z info: [Crawler][3389] Attempting to determine the content-type for the url https://www.youtube.com
2025-05-14T11:08:48.365Z error: [Crawler][3389] Failed to determine the content-type for the url https://www.youtube.com: AbortError: The operation was aborted.
2025-05-14T11:08:51.695Z info: [Crawler][3389] Successfully navigated to "https://www.youtube.com". Waiting for the page to load ...
2025-05-14T11:08:56.697Z info: [Crawler][3389] Finished waiting for the page to load.
2025-05-14T11:08:56.757Z info: [Crawler][3389] Successfully fetched the page content.
2025-05-14T11:08:57.264Z info: [Crawler][3389] Finished capturing page content and a screenshot. FullPageScreenshot: true
2025-05-14T11:08:57.282Z info: [Crawler][3389] Will attempt to extract metadata from page ...
2025-05-14T11:09:01.137Z info: [Crawler][3389] Will attempt to extract readable content ...
2025-05-14T11:09:03.899Z info: [Crawler][3389] Done extracting readable content.
2025-05-14T11:09:04.644Z info: [Crawler][3389] Stored the screenshot as assetId: 8c777957-9488-41b8-a434-e6854bf4d39d
⨯ Error: ENOENT: no such file or directory, open '/data/assets/uutwl3rjowf2fezaspgd2ca7/bb180a59-c728-402a-8eeb-faaae39055f6/metadata.json'
at async open (node:internal/fs/promises:633:25)
at async w (/app/apps/web/.next/server/chunks/6815.js:1:1914)
at async Object.readFile (node:internal/fs/promises:1237:14)
at async Promise.all (index 0)
at async q (/app/apps/web/.next/server/app/api/assets/[assetId]/route.js:1:2329)
at async /app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:38411
at async e_.execute (/app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:27880)
at async e_.handle (/app/node_modules/next/dist/compiled/next-server/app-route.runtime.prod.js:6:39943)
at async doRender (/app/node_modules/next/dist/server/base-server.js:1366:42)
at async cacheEntry.responseCache.get.routeKind (/app/node_modules/next/dist/server/base-server.js:1588:28) {
�
errno: -2,
code: 'ENOENT',
syscall: 'open',
path: '/data/assets/uutwl3rjowf2fezaspgd2ca7/bb180a59-c728-402a-8eeb-faaae39055f6/metadata.json'
}
2025-05-14T11:13:43.063Z info: [Crawler][3389] Will crawl "https://www.youtube.com" for link with id "ab35k06ojykaag4l8qgzsgqt"
2025-05-14T11:13:43.064Z info: [Crawler][3389] Attempting to determine the content-type for the url https://www.youtube.com
Error: Timed-out after 300 secs
2025-05-14T11:13:43.329Z error: [Crawler][3389] Crawling job failed: Error: Timed-out after 300 secs
at Timeout._onTimeout (/app/apps/workers/utils.ts:2:1025)
at listOnTimeout (node:internal/timers:588:17)
at process.processTimers (node:internal/timers:523:7)Please help!
