CA
Crawlee & Apify7mo ago
complex-teal

Debug and troubleshooting Crawlee

When there is an error in the response-handler, then it does not show an error, but it will fail unnoticed, and Crawlee will retry 9 more times. To illustrate the following syntax-error: element = await context.page.query_selector('div[id="main"') It should be with a closing bracket after "main": element = await context.page.query_selector('div[id="main"]') However, instead of failing, Crawlee will proceed and keep trying to query the page and it will not show any message on where it failed. Is there any way to troubleshoot these kind of issues?
3 Replies
Hall
Hall7mo ago
Someone will reply to you shortly. In the meantime, we’ve found some posts that could help answer your question.
afraid-scarlet
afraid-scarlet7mo ago
cc @Vlada Dusek Can You check it please 🙏
Mantisus
Mantisus7mo ago
Pay attention to this PR. When it reaches release, a parameter will be added that will allow the run to terminate immediately when an error is received.

Did you find this page helpful?