F
Firecrawl11mo ago
tracek

Missing all child pages when crawling

Hi! Any ideas why when scraping e.g. https://www.mt.com/us/en/home/products/Laboratory_Analytics_Browse/Product_Family_Browse_titrators_main.html I don't get any child pages? I run into this problem both in Playground and Python API. When I toggle backward links I get more pages, but that goes back to the top domain - something I'd like to avoid. Page like this https://www.mt.com/us/en/home/products/Laboratory_Analytics_Browse/Product_Family_Browse_titrators_main/karl-fischer-titrators.html seems to be a legit and easy to follow child page. Any tips on what I might be missing? I am on the managed (not self-hosted) plan.
Titration Solutions
METTLER TOLEDO's titration solutions boost lab throughput with automated titrators, Karl Fischer titrators, advanced sensors, software, and essential automation accessories.
Karl Fischer Titrators
METTLER TOLEDO automated KF titrators are easily operated with customizable workflows to increase efficiency and accuracy for water determination.
0 Replies
No replies yetBe the first to reply to this messageJoin

Did you find this page helpful?