Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

wise-white

3/27/2025

I have made scraper to get the data from Linkedin, Glassdoor, indeed and Ziprecruiter.

But the apify api sometimes didn't work correctly, I mean sometimes the result is zero. what is the reason, I just guess the reason is rate limitation, I am not sure...

Louis Deconinck

3/27/2025

Playwright Browser Launch Failure: Deprecated Headless Mode in Chrome

Anyone know how to fix this error? Works perfectly locally, but not on the Apify platform. See file attached with full error log. Code snippet: ```TypeScript import { PlaywrightCrawler, Dataset } from 'crawlee';...

message.txt

correct-apricot

3/26/2025

Cannot Update Existing Tasks with new inputs

Hey guys! I have this problem where when I add a new input field to an actor, the tasks associated with that actor don't get updated with that field. So does that mean I have to recreate the tasks again from scratch?? :((...

generous-apricot

3/26/2025

Run Actor Response

Im using the Run Actor API, and im using webhooks in the actor run, and i get this eventType ACTOR.RUN.SUCCEEDED and this is okay, but i wanted to know how the reponse will be if the eventType is ACTOR.RUN.FAILED, can someone help me with this ?

afraid-scarlet

3/23/2025

Chrome Path

Hello, can you let me know what the path for Chrome is?

apparent-cyan

3/23/2025

failed to parse module map error

React JS WARNING in ./node_modules/apify-client/dist/resource_clients/user.js Module Warning (from ./node_modules/source-map-loader/dist/cjs.js): Failed to parse source map from '/Users/apple/Desktop/insta_downloader/insta_downloader/node_modules/apify-client/src/resource_clients/user.ts' file: Error: ENOENT: no such file or directory, open '/Users/apple/Desktop/insta_downloader/insta_downloader/node_modules/apify-client/src/resource_clients/user.ts'...

correct-apricot

3/20/2025

puppeteer runs often stopping due to `ProtocolError ` after `Memory is critically overloaded.`

During my Apify scraping runs with Crawlee / puppeteer, 32GB RAM per run, my jobs stop showing There was an uncaught exception during the run of the Actor and it was not handled. And the logs you see in the screenshot at the end. This often happens for runs that are running for 30+ minutes. Under 30 minutes is less likely to have this error. I've tried "Increase the 'protocolTimeout' setting ", but observed that the error still happens, just after a longer wait. Tried different concurrency settings, even leaving to default, but consistently have seen this error....

eastern-cyan

3/19/2025

PPE Actors Misclassified as Paid Users & Need for Detailed Analytics

Using our own developed PPE actors causes us to appear as paid users on the analytics dashboard. However, using our own PPR and rented actors does not reflect as a paying user. This issue with PPE actors can be confusing for developers, and since there is no actual profit/cost change, it may appear as if the actor has issues with charging. Additionally, having more detailed indicators for PPE actors in the analytics dashboard would be very beneficial. For example, it would be great to see how much each event is charged per execution for each actor....

correct-apricot

3/19/2025

Trying to subscribe and the billing is denied

Hi, we are trying to upgrade to a paid solution and we can't get the payment through. We checked the billing details and contacted the card company, and there was no issues from their end. They said that there was no payment attempt from Apify. Can you please assist with this issue?

like-gold

3/19/2025

Actor run result is just {'demo': true}

I am runnign a twitter scraper actor v2 on apify, and I see that my run succeeded and says 100 resutls, but when I got to the details page, it is just an array of 100 items of {'demo': true} how can I get proper details?...

azzouzana

3/19/2025

Frequent migrations causing trouble for paid actors' users...

❗ Guys, was something recently released or changed at Apify related to actors resources, etc.? I have an actor that has been running fine for a while, but in the past few days, migrations have become frequent, causing issues for some of my paid actor users. ⚠️

!!!Joefree!!! 👑

3/18/2025

BUG 2024/03/19: INPUT_SCHEMA.JSON

Parameter name containing a dot (.) with editor stringList doesn't work on web console. Example INPUT_SCHEMA.JSON ``` {...

foreign-sapphire

3/18/2025

LinkedIn geo location id issue

I want an apify actor that scrapes and returns LinkedIn geolocation ID as output from the input location name. Is there any such actor available in the apify store or any platform in general?

fascinating-indigo

3/15/2025

Having difficulty in scraping particular source. Please help

I am trying to scrape particular website but it seems to have cloudfare or some advanced firewall preventing any bot or automated script. Please guide me with a strategy that will work against such advanced methods....

eastern-cyan

3/14/2025

Issue Setting up docker image and connecting both VNC and Remote Debugging

Hey everyone! 👋 I'm running into some trouble getting VNC to connect to my Docker container. Using apify/actor-node-playwright-chrome and running it as-is, but no luck in headful mode. The chrome_test.js and main.js run perfectly but VNC and Remote Debugging is not working. I'm on windows 11, using vscode, wsl2, docker-desktop.I tried pulling the image from docker repo but then, I built the image on Ubuntu distro via WSL2 and Doker-Desktop with WSL integration enabled....

complex-teal

3/13/2025

Uncaught exception during the run of the Actor

While running my code on Apify IDE I'm getting this error. The build was successful. here's the log...

message.txt

wee-brown

3/13/2025

Actor Runs more that the limit

Hi! This is my url: https://api.apify.com/v2/acts/crypto-scraper~dexscreener-tokens-scraper/run-sync-get-dataset-items?token=<my-token> Body: { "chainName": "solana",...

like-gold

3/12/2025

Not able to use PPE in my actor

I have this in my .actor/pay_per_event.json and my calling this in my main.py. And i do get this warning in my terminal 2025-03-08T14:09:14.994Z [apify] WARN Ignored attempt to charge for an event - the Actor does not use the pay-per-event pricing If i use await Actor.charge('actor-start-gb '), will be correctly using PPE. Please let me know. thank you in advance `{...

complex-teal

3/12/2025

Apify Run is not working properly

I'm having one issue when I'm using the apify run it's doing Python -m src whereas to run my project I need to run python3.10 -m src...

like-gold

3/9/2025

Error running actor FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/lib/python3.

I'm trying to run my actor & it's giving this log: ``` 2025-03-09T00:13:41.538Z ACTOR: Pulling Docker image of build 20IgkKFk3QAzeFbk9 from repository. 2025-03-09T00:13:42.170Z ACTOR: Creating Docker container. 2025-03-09T00:13:42.237Z ACTOR: Starting Docker container....

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.