How can I include extra urls that has other domain?
I see that I can for example exclude some paths that the same domain has. I want to include others domains that are in the page
In this case I want to crawlee
https://pizzeriapopularrn.com/
that in the page https://pizzeriapopularrn.com/carta/
have for example https://www.cucina.link/ords/pedidos/r/pedidos/categorias-digital?t=pizzeria-popular-catamarca
.
As you can see, this last url has other domain, and crawlee doesn't scrap from this one.6 Replies
exotic-emerald•2y ago
Could you please share your code?
absent-sapphireOP•2y ago
I am using the dashboard
Website Content Crawler, am I in the wrong forum?
exotic-emerald•2y ago
I thought you were querying regarding crawlee.
absent-sapphireOP•2y ago
I am usign apify console, it's posible to do that using crawlee??
exotic-emerald•2y ago
Yes, it can be done using crawlee and apify.
@gtry just advanced to level 3! Thanks for your contributions! 🎉