download individual pages as txt
Would it be possible to download each scraped page as a txt file, so that if i have thousands of scraped pages, we can easily use a select all button to say, download all the scraped pages as individual text file, so that in case there is an update on the client website, we just rescrape that particular url and replace the text file. The text file will be great as most times, there is some manual cleaning of the data.
2 Replies
Hey! good question, do you want that functionality in the playground? right now you can download a json but you can't download individual text files
Yes, exactly, i want that functionlity in the playground. I am a chatbot builder, and have got colleagues who would also want same function to download text. Atm if is say 50 pages i can copy each and past in text file, however when is over 50 it becomes overly challenging. Currently have a 4000 paged website and wondering how i can get txt file for each page