CA
like-gold
exclude start URL
Hey All,
There was nothing here when I searched this phrase. I have a bunch of sites where the Glob format of the links to be scraped is the Start URL plus something like /// - Is there some easy way that I just don't see to exclude the StartURLs from being scraped? They produce junk data, as you can imagine. Thanks!
There was nothing here when I searched this phrase. I have a bunch of sites where the Glob format of the links to be scraped is the Start URL plus something like /// - Is there some easy way that I just don't see to exclude the StartURLs from being scraped? They produce junk data, as you can imagine. Thanks!
2 Replies
@Ken Lyle just advanced to level 1! Thanks for your contributions! 🎉
Please share run, need more details to evaluate your case, first of all from where you want to exclude it?