ERR_NAME_NOT_RESOLVED when scraping
I am running Karakeep in Docker on a Raspberry Pi 5. When I check Background Jobs it appears all Crawler Jobs are failing. When I go into the logs I see the same error repeated (for each URL) which seems to suggest a DNS problem. However when I type the exact same url in at the command line (wget or curl) it works as expected (ie no general DNS problems on the RPi it seems). Here is an example:
2025-06-27T15:06:26.351Z info: [Crawler][7994] Will crawl "https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html" for link with id "ug011dknv3i986l1rtk3utct"
2025-06-27T15:06:26.351Z info: [Crawler][7994] Attempting to determine the content-type for the url https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
2025-06-27T15:06:26.689Z info: [Crawler][7994] Content-type for the url https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html is "text/html; charset=utf-8"
2025-06-27T15:06:36.805Z error: [Crawler][7994] Crawling job failed: Error: net::ERR_NAME_NOT_RESOLVED at https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
Error: net::ERR_NAME_NOT_RESOLVED at https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
at navigate (/app/apps/workers/node_modules/.pnpm/puppeteer-core@22.3.0/node_modules/puppeteer-core/src/cdp/Frame.ts:193:13)
at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
...
at async runCrawler (/app/apps/workers/workers/crawlerWorker.ts:845:27)
at async Object.run (/app/apps/workers/utils.ts:6:12)
2025-06-27T15:06:26.351Z info: [Crawler][7994] Will crawl "https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html" for link with id "ug011dknv3i986l1rtk3utct"
2025-06-27T15:06:26.351Z info: [Crawler][7994] Attempting to determine the content-type for the url https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
2025-06-27T15:06:26.689Z info: [Crawler][7994] Content-type for the url https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html is "text/html; charset=utf-8"
2025-06-27T15:06:36.805Z error: [Crawler][7994] Crawling job failed: Error: net::ERR_NAME_NOT_RESOLVED at https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
Error: net::ERR_NAME_NOT_RESOLVED at https://amp.livescience.com/64751-sealab-aquanauts-tragedy.html
at navigate (/app/apps/workers/node_modules/.pnpm/puppeteer-core@22.3.0/node_modules/puppeteer-core/src/cdp/Frame.ts:193:13)
at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
...
at async runCrawler (/app/apps/workers/workers/crawlerWorker.ts:845:27)
at async Object.run (/app/apps/workers/utils.ts:6:12)
