Getting the parent URL while executing inside the requestHandler for Crawlee
Hey folks,
I'm saving the hierarchy of the crawl tree in my database as part of the crawling process, which means in the requestHandler, I need to save the parent URL that enqueued the link that is currently executing in the requestHandler. Is there an easy way to get that or is it something I need to implement myself?
Thanks!
1 Reply
wise-white•3y ago
add it to
request.userData its common way to provide any kind of additional custom data to requests