Crawl and scrape https://developer.apple.com/documentation/realitykit
I've been trying to crawl and scrape that link and to include 3 levels deep. But it only works for one level. Any ideas?
Here are my settings:
Here are my settings:
6 Replies
Hey Dennis. Not sure whats going on here. Taking a look into it as we speak
I think it might be because there aren't any urls deeper than 3 on the realitykit section of the documentation. I could be wrong, can you give me an example of a sub link of the /realitykit that goes 3 levels deep that you're trying to scrape?
https://developer.apple.com/documentation/realitykit/scene/anchorcollection/allsatisfy(_:) (btw is this a 3 level or 4 level? does the root count?)
Apple Developer Documentation
allSatisfy(_:) | Apple Developer Documentation
Returns a Boolean value indicating whether every element of a sequence satisfies a given predicate.
I'm not sure. CCIng @rafaelmiller
@Dennis K A maxDepth of 0 scrapes only the entered URL. A maxDepth of 1 scrapes the entered URL and all pages one level deep. So the /scene/anchorcollection/allsatisfy(_:) page is level 3 depth
@rafaelmiller I can't get this to work at all now. I don't get the scrape results. Can you look into it? Is it something on my side? Im a paid user and so far nothing worked as intended for me.
Hey @Dennis K , I've added special scrape parameters directly to our code for developer.apple.com. This page presents unique scraping challenges, requiring specific parameter settings. You should be able to scrape it later today (once the deployment is complete).