Crawl Job Failed but Activity Log shows active queue jobs
Hi All,
I just discovered that the dashboard is giving some new useful information about crawl jobs but I have a question:
My crawl job came back as failed but when I look in the activity log I see that there are multiple "Queue jobs active"
What does this mean?
Thank you for the improvements on the dashboard 😄
3 Replies
FYI - I tried to run the job again and it completed but no pages were scraped. This is the status info from the end of the job: {'status': 'completed', 'current': 1, 'current_url': '', 'current_step': 'SCRAPING', 'total': 100, 'data': {'success': False, 'result': {'links': []}, 'error': "Corrupted zip: can't find end of central directory"}, 'partial_data': []}
Hey Janice! Sorry about that. Ccing @rafaelmiller to help
Hi @Janice , it looks like we’re running into that same issue with the zip files as we did with the images before. I’m going to investigate why it’s trying to parse the zip files.