llms.txt generator - crawl single page instead of full domain
I've tried the llms.txt generator (https://llmstxt.firecrawl.dev/) to convert these docs (https://developer.wordpress.org/block-editor) and subpages to llms.txt but it is crawling the full subdomain https://developer.wordpress.org
Any way to only crawl single pages or subpages of the requested URL?
Any way to only crawl single pages or subpages of the requested URL?
