How to see why a crawl path was chosen?
Sometimes /crawl doesn't include the base url I set in the set of source urls back.
Ideally the crawler would start at the home page + then some series of urls afterward.
How best to see why it skipped the base url / force it to start there?
Ideally the crawler would start at the home page + then some series of urls afterward.
How best to see why it skipped the base url / force it to start there?
