Automate the scrapping of pages on my website using Make and Firecrawl
Hello,
I'd like to know how to automate the scrapping of pages on my website using Make and Firecrawl
5 Replies
Specify the URL of the pages you want to scrape.
Define the scraping parameters (e.g., what data to extract like titles, descriptions, images, etc.).
Connect your Firecrawl account to Make by providing the necessary API credentials.
Choose the action you want to perform, such as starting a crawl or retrieving data from a crawl.
Map the data fields you want to extract from Firecrawl to the desired output format.
You can add modules to process the scraped data, such as sending it to Google Sheets, a database, or another application.
Hello, so this would mean that as soon as changes appear in my site, Firecrawl crawls them?
btw, you are not developer? @Romain if you want, I can help for your project
Hey man,
That's right, I'm not a developer.
I'd rather tell you right now that this is a personal training project.
What's more, I'd rather tell you that I don't have any money to spend on paying someone to help me.
So if you want to help me it would be with pleasure, but it would only be for free by continuing to chat here on Discord.
Thank you for your understanding.
Maybe I'll call on you for an official project with one of my future projects
okay