CA
ambitious-aqua

Automatic date update on twitter scraper

Hello, in the twitter scraper is there a way to update the "to_date" field to change every 24 hours automatically?
5 Replies
optimistic-gold
optimistic-gold3y ago
Hi @Ronablu, the twitter scraper supports relative days as well, so you can just set the value to "1 day". Example run: https://console.apify.com/view/runs/gkd1LimeFdCFeRv8Q
Apify
Apify Console
Manage the Apify platform and your account.
ambitious-aqua
ambitious-aquaOP3y ago
Thank you, will give it a try! The relative search isn't working properly at the moment. I couldn't save my task, and when i was able to save there was no difference in the JSON (in the date department). If it worked for you I would love to see the JSON and maybe bypass the user interface. Thank you!
optimistic-gold
optimistic-gold3y ago
The regular editor changes the value because of the field type, but you should still be able to edit the value in the JSON editor and save it from there. Regardless of that, thank you for the feedback! I will share it with the team. The team knows about this issue and it should be properly handled in the next weeks.
ambitious-aqua
ambitious-aquaOP3y ago
It doesn't appear in the JSON editor, so I can't change it. I appreciate you taking the time to contact the team.
optimistic-gold
optimistic-gold3y ago
You can still directly edit the json and add the fields there. Example run: https://console.apify.com/view/runs/gkd1LimeFdCFeRv8Q To make it simpler you can set some dummy date in the editor and then change it to the relative date in the json editor.
Apify
Apify Console
Manage the Apify platform and your account.

Did you find this page helpful?