CA
xenophobic-harlequin
RequestList
I am crawling a sitemap then pushing all the urls to a requestList, which is not processing the urls.
Code below
let newArray = []
for(let i = 0; i < result.length; i++){
newArray.push({url: result[i] , userData: { label: "DETAIL" }})
}
// console.log(newArray)
await (await Apify.openRequestList(page.url, newArray )).initialize();
1 Reply
foreign-sapphire•3y ago
1. What version are you using? This looks like Apify v2. Prefer upgrading to v3 which uses Crawlee.
2. You don't need to call
.initialize() on already opened request list
3. You are not assigning the list to the Crawler, see the documentation