Hello guys,
Hello guys,
I have pupeteerCrawler
in the requestHandler I'm trying to click to the pagination next button and I cannot determine if the content is changed or not.
How can I do it? waitfornetworkidle does not seem to work here. any ideas?

2 Replies
rising-crimson•12mo ago
if url is changing as you change the page i would suggest using all the pagination urls and put it in enque.
multiple-amethyst•12mo ago
@kprocks that what I did eventually, but I was never able to make it work as plannaed initially