Crawlee & Apify

CA

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

TimCoulter
TimCoulter
View on Discord
5/10/2025

Errors while attempting to use Apify Proxy

I have created a very simple actor that uses the gotScraping library to retrieve the HTML from a set of YouTube video pages. The page URLs are passed as an input array. ```typescript await Actor.init(); ...
No description
Labh
Labh
View on Discord
5/8/2025

Actors are not being seen in my account

getting this in all the store actor also my previous runs are also not there I tried opening in another account, still getting same error message tried in my mobile too getting same ...
No description
IrshaiD'
IrshaiD'
View on Discord
5/7/2025

How do we handle authenticated scrapers on apify cli locally

Iam using playwright crawlee + TS template , should i handle login , save session and session injection by myself? or is there any apify tool that can help with that ?
SJ(Jena)
SJ(Jena)
View on Discord
5/4/2025

Pricing clarification!

Hello, everyone. I recently joined and started using Scrapper. I have a quick question: I have already paid $39 for the "strater" subscription. I haven't used it fully yet as i am still exploring the scrapper , learning etc , could you please let me know if I may cancel my starter (delete my credit card recurring payment). Will I still be able to use my remaining credits? Or will it be cancelled, preventing me from using it as planned? Can somebody help me with that, how does it works?
deep-jade
deep-jade
View on Discord
5/1/2025

How to get the run workflow via API?

Suppose I run an actor that calls another actors (via integrations). I want to get successive runs of that run.
rival-black
rival-black
View on Discord
4/30/2025

Strange charges for PPE Actor from free users

My run log is here: https://console.apify.com/view/runs/YCxijRf9sbnekzyoO This was from a free user at the time, and the "maximum cost per run" was capped at under 5 usd. There was nothing expensive in the run itself, yet on my analytics dashboard it shows up as having a negative profit of 5.70usd! Why? Any way to debug this further? This run should have cost under 50 cents at most....
like-gold
like-gold
View on Discord
4/24/2025

Not Sure if Country VPN works properly

Hello All, I'm trying to build a scraper which will login in to netflix of particular country and scrap top10 movies and tv shows list. When I run this scraper even though I mentioned to login from Singapore (netflix.com/sg/login), the netflix page redirects to US page (netflix.com/login). Hence, either I might be doing something wrong or VPN is not functioning properly....
Louis Deconinck
Louis Deconinck
View on Discord
4/19/2025

MemoryMbytes

In actor.json you can set: ```json { "minMemoryMbytes": 128, "maxMemoryMbytes": 256,...
parallel-tan
parallel-tan
View on Discord
4/18/2025

What is up with these error messages? Successfully failed?

Succeeded.   Finished! Total 1 requests: 0 succeeded, 1 failed.
Succeeded.   Finished! Total 1 requests: 0 succeeded, 1 failed.
If I got 403'd and failed the run, it should say failed....
No description
!!!Joefree!!! 👑
!!!Joefree!!! 👑
View on Discord
4/18/2025

BUG: Links on README.MD render incorrectly

View from console.apify.com (google chrome) This links doesn't render correctly : 
⚡️ Feel free to [reach out](https://console.apify.com/actors/4KGEKf1EUjmYW76dd/issues) to the developer for any issues or suggestions for improvement.
⚡️ Feel free to [reach out](https://console.apify.com/actors/4KGEKf1EUjmYW76dd/issues) to the developer for any issues or suggestions for improvement.
...
national-gold
national-gold
View on Discord
4/17/2025

apify says I use it too much, I just literally send 2 bulk messages (with 5 users in it)

I just paid for the subscription, used it for 1 min and it says that I am using it too much? is that normal? Any help is appreciated...
No description
noble-gold
noble-gold
View on Discord
4/16/2025

I need to scrap a city to get some restaurants with a lot of categories

Currently, I'm scraping entire cities by selecting one category at a time, parsing the results, and inserting the data into our system. I came across this thread, where someone suggests scraping smaller areas with multiple categories instead to reduce duplicates and cost. Does this approach scale better in practice?...
rival-black
rival-black
View on Discord
4/16/2025

How to fetch the JSON input for a given run-id?

I ran several tasks on apify using the python-API but I had some mistake in the code that downloaded the tasks. I need to be able to get the JSON input for a given list of run-ids to make sure that I can save them properly to my filesystem.
other-emerald
other-emerald
View on Discord
4/14/2025

Help

I have created my first account to try the platform Then I wanted to use it for business and created an account with my Business email but now when I try to use it to add to my make.com account, it says my account has been deactivated by your monitoring system. I understand this may seem suspicious but I just usually test platforms with my personal email and then sign up with my business if I wanna use it long-term. help?...
other-emerald
other-emerald
View on Discord
4/14/2025

Rate limit over $300

Hi can't i buy more than $300/month for Apify..? it's kicking in too fast.
No description
fascinating-indigo
fascinating-indigo
View on Discord
4/13/2025

Proxy Support

Is this the right away to add proxy support to an Actor? I'm guessing this is using the datacenter proxies included in my plan? Would users would be able to buy their own proxies and it would work? Or does the groups need to somehow get the proxy group name they purchased? ```python proxy_configuration = await Actor.create_proxy_configuration(...
exotic-emerald
exotic-emerald
View on Discord
4/12/2025

Why is the "usageTotalUsd" Field Missing Sometimes?

The usageTotalUsd field of an ActorRun is sometimes defined and sometimes missing. I can't tell the rhyme or reason for when this happens. For example, ```js const actorRun = await actorClient.call()...
adverse-sapphire
adverse-sapphire
View on Discord
4/7/2025

Help me Out, Brothers and Sisters

When using Linkedin Jobs scraper., Can I handle multiple queries simultaneously at the same time? If not, How can I do that? Maybe I can guess queue method....
correct-apricot
correct-apricot
View on Discord
4/5/2025

Actor Inquiry

My team and I saw online that if we load our scraper as an actor to Apify’s platform we could get a Apify hoodie. Is that true?
fair-rose
fair-rose
View on Discord
3/31/2025

Changes to pricing - Google Maps Scraper by Compass

Hi, I recently signed up to Apify for the data I required and it was brilliant last week. I have the $39 package and I was able to scrape all 65,000 locations I needed, in a shot period of time and with all the info required. But due to the new pricing policy, this same data will cost me over $800! I understand an increasing and I'm all for that, but this is huge!! Is there no middles ground? I'm happy to wait for the data to scrape, I don't need it in seconds or even minutes. It took overnight...
Next