scraping results only return 1 item from the list of items on the webpage
When I use Firecrawl to scrape a webpage, it's returning only the 1st item in a list. Do I need to tell it to iterate over the list to capture each item in the list as an object? This is what my code looks like: https://gist.github.com/natea/8224320f7cfce8a4d39ed58b300a41bc
6 Replies
I'm having the same issue using the new extract feature in the dashboard. I've tried multiple source URLs but it only ever returns the first item on the page.
Hi Nate! You need to make your schema into an array of objects, not just an object.
cc @Nate Aune @aatx
Thanks! Is there any documentation for how to do this?
If you could also provide documentation on how to do this using the extract feature that would be incredibly helpful, thank you!
@mogery do you have any more insight into this issue or how we can make our schema into an array of objects?
@Nate Aune please let me know if this works for you
https://gist.github.com/jhyang21/85a158326d966aca784fda44ac285433
@aatx I created a quick code snippet that shows Example Usage with Extracting a List with Schema. Please let me know if this helps!
https://gist.github.com/jhyang21/519945263766f600fcfda51ebc105dd6
Gist
firecrawl_extract_list_python_example_documentation
GitHub Gist: instantly share code, notes, and snippets.