crawlee-js
apify-platform
crawlee-python
💻hire-freelancers
🚀actor-promotion
💫feature-request
💻devs-and-apify
🗣general-chat
🎁giveaways
programming-memes
🌐apify-announcements
🕷crawlee-announcements
👥community
Help limit the number of Columns Extracted on "Instagram Profile Scraper Task"
Great day everyone. I'm not a programmer or developer and just using Apify to scrape Instagram Profiles. Whenever, I use Instagram Profile Scraper, it returns with 2000 columns of data which I don't really need. I only need it to scrape and only return 3-4 Columns (username, externalUrl, fullName). Can anyone please teach me how to set it up? It would be such a great help and I would greatly appreciate any assistance on this. Tried to chat with their support but been waiting now for hours to get...
classcentral.com
Hello, is there anyone who can help me to scrape 1-depth level of this website? https://classcentral.com
Thanks in advance...
Return data to API call
Hello,
I'm trying to return the data from an Apify actor via the same REST API call that initiated the actor.
Is this possible?...
Instagram Post Scraper - Alt text
Hi!
I'm working on an academic project regarding alt text on Instagram but the posts I scraped came back with no alt texts (except for some child posts). I watched Apify's YouTube introduction to this particular Scraper and it seemed like the posts returned with alt text. Am I missing something?
Does it only return manually added alt text and cannot pull the automatic alternative text that Instagram uses otherwise?...
Need Help Update Paid Actor Pricing (no response from chat)
Hi Apify team, can anyone help me make the following adjustment to paid actors?
removed. already taken care of. thanks so much!I tried the chat but it hasn't been very responsive. Would you also let me know the chat service level so I can set my expectations correctly? Thanks!...
Error: Cannot use import statement outside a module
Hello - I'm trying to use Apify to download a file.
I am following the tutorial here:
https://docs.apify.com/academy/puppeteer-playwright/common-use-cases/downloading-files...
Puppeteer url input
I created a new actor with the Puppeteer template and wanted to try it out. I add a URL under the input tab but the scraper seems to just scrape Apify and nothing else. Is it because of this line in
const startUrls = ['https://apify.com']; in main.js?Zillow Scraper
Hi, I'm new to Apify. I'm trying to scrape Zillow data for a school project. I found an actor created by maxcopell. I found the API python code to pull some basic info (https://apify.com/maxcopell/zillow-api-scraper/api#search). When I ran this code, I didn't get the school info. Under the ReadMe I found a reference to how to store the school data (see below). I'm unsure how to use this code. Any help would be appreciated.
async ({ item, data }) => {
if (!data.schools || !data.schools.length) {
return null; // omit output...
Can someone tell me what this error means? It says browser closed unexpectedly but not as to why.
```2023-02-28T14:33:25.456Z ACTOR: Pulling Docker image from repository.
2023-02-28T14:33:26.293Z ACTOR: Creating Docker container.
2023-02-28T14:33:26.614Z ACTOR: Starting Docker container.
2023-02-28T14:34:04.313Z Traceback (most recent call last):
2023-02-28T14:34:04.314Z File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main...
Decrypt secret input values in apify v 2.x
hi, I'm trying to use secret input values. And noticed that Actor.getInput() will decrypt the values for me in apify v3. I'm unable to upgrade from 2.0 to 3.0 due to a myriad of issues which I've posted about earlier. So I'm wondering if there's a way to decrypt secret values inside the Actor in apify package v 2.x?
apify-google-auth for Apify package 3.1?
Hi - I'm upgrading my actors from apify package 2.x to 3.x and running into an error where apify-google-auth is using the function Apify.openKeyValueStore which is no longer available. There is no apify-google-auth version to upgrade to so wondering what options I might have here?
Monitor failed runs
I have a paid actor and I have set up a scheduled task to daily check if it works for my customers. Will I automatically get an email if the run fails?
How to ignore already scraped tweets?
When scraping Twitter. Is there a way to configure Apify such that already scraped Tweets are ignored when a scheduled task runs again?
Can I pass metadata onto a request that I can retrieve when getting the dataset from a webhook?
I'd like to pass some metadata (say, id=1234) onto a request so when the webhook event happens, I'll have access to the metadata when requesting the actor run's dataset.
Dataset comparison
Hi, I am looking for a way how to compare two datasets produced by two distinct runs and notify me via email if they differ. To be more concrete, I want to set me scraper actor to check some products on a site periodically (each day), compare its output with the output from previous run and if the sets of products (for example their IDs) differ, notify me via email. It should work in similar manner as Jakub's Content Checker (https://console.apify.com/actors/ctMjXHGFjGPwBzCrq). I believe that I...
Scrapping Menu's
Hello, I'm trying to find a way to be able to scrap restaurant's Menu's and there ingredients. Is there a function or action that is available that could help scrap these subjects at a efficient rate?
Cant request monetization on my actor
Hello there 😉 , When I click on Request Monetization in order to publish the action, nothing happens.
Actor_id: BHzefUZlZRKWxkTck
Someone to help please ?...
Do I need different docker images to run playwright with firefox and chrome?
As I know playwright support several browsers. Is there a way suing Apify (the old version, 2.3 I think) to run on one job playwright chrome and playwright firefox?
tiktok
Helloo
I was scrapping tiktok hashtags using an existing actor, however starting yesterday my runs are getting back no more than 16 results for some reason. Log says that there are no more video to be scrapped, however if I search it manually I find thousands of videos under the scrapped hashtags.
I did not change any settings....