Iterating over batch result pages (python)
New to the developer world, so excuse me if this is a basic question I should know already.
When you call the batch scrape endpoint (synchronously), I want to be able to make a loop that iterates over each page and creates a structured response of all 'extract' data from each page. Does anyone have advice on the best way to do this?
I use batch scrape with extract format, using prompt instead of schema as the websites I'm scraping don't all share the same page structure.
0 Replies