Add label to pages via `crawler.addRequests()`?
I am adding a page as the initial crawl target, but would like to add a label to ensure it routes to the correct processor. Is there a way to do this?
It seems I can only add
RequestQueueOperationOptions
with addRequests, not the same EnqueueLinksOptions
that I can use with enqueueLinks()
.2 Replies
Create a Request object and put it into your array .
In the request object you can use label
stormy-gold•2y ago