Andrew
CACrawlee & Apify
•Created by Andrew on 5/12/2025 in #crawlee-python
Scrapping tweets are all mock tweets
logger.info(f"Starting Twitter Scraper actor for users: {info.x_user}")
run = client.actor("kaitoeasyapi/twitter-x-data-tweet-scraper-pay-per-result-cheapest").call(
run_input=run_input)
annos = client.dataset(run["defaultDatasetId"]).iterate_items()
for anno in reversed(list(annos)):
print('anno', anno)
text = anno.get("text")
url = anno.get("url")
created_at = anno.get("createdAt")
14:49:04.972 | INFO | Task run 'get_x_announcements-db2' - Starting Twitter Scraper actor for users: H_O_LO
14:49:13.756 | INFO | Task run 'get_x_announcements-db2' - anno {'type': 'mock_tweet', 'id': -1, 'text': "From KaitoEasyAPI, a reminder:Our API pricing is based on the volume of data returned. However, to ensure we can cover our costs on the Apify platform, we have a minimum charge of $X per API call,even if the response contains no results.Thus, we returned N pieces of mock data. We will monitor and adjust the size of N based on the infrastructure costs incurred by Apify.This helps offset the infrastructure costs we incur for each API request, regardless of the data returned. We want to be upfront about this policy so you understand the pricing structure when using our service.Despite adding mock data when no results are found, we're still barely breaking even. Our prices are already very reasonable, but we're committed to maintaining this service to support the growth of your project.Please let us know if you have any other questions!"}
5 replies