Crawlee & Apify

CA

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

Apify HElp

Today is April 3rd, and I haven’t received my March income yet.

Free Trial Extension / Enterprise Free Trial?

I am part of a team that does web scraping to find home improvement contractors. We are considering using APIfys Google Maps crawler to replace our current homemade Google Maps crawler. To adequately compare the cost and results of these crawlers we want to scrape the city of Denver, but the $5 free trial doesn't give us enough to really compare. If anyone on the APIfy team can help in any way please send me a message. Thank you.

Hey guys, trying to use the platform but receiving this error don't know how to drop a password for

Hey guys, trying to use the platform but receiving this error don't know how to drop a password for a company cuz it's not working org name is: Porada...
No description

too-many-names-same Error using JS Client

We use the Apify JS client and started seeing some strange errors when programmatically creating new actor tasks. Here is the code we use to create a task ``` const task = await apifyClient.tasks().create({ actId: "apify/website-content-crawler",...
No description

Google Maps Scraper - same term different results

Google Maps returns varying results for a search term with the same query. Does anyone have a good strategy by which you can get as many unique results as possible if you were to reuse the scraper for the same search term? Or is it not possible?

Bug Report 2024-03-31: Can`t clear secret input

When I want to empty secret input, error show up Error: Expected value to be of type string but received type "null"...
No description

Cannot get a ad-hoc webhook attached to a run of a js client actor

hi apifyers, i can't get ad-hoc webhooks connected to the "website-content-crawler" actor via js apify client. i am building a array of objects like this and base64 encode it as a string and give it via webhooks param to the actor input config. ...

apify push fails with 502 Bad Gateway

Hello, I can't push my actor anymore, as apify push returns the following error: ```shell
apify push...

Is something wrong with Scheduled jobs right now?

I'm not getting any support from the chat bot right now. Here are the issues: 1. When I click on an existing schedule to edit it, a blank / white page is shown where you'd expect to see the config of the scheduled job. 2. As scheduled jobs run, the data only shows up sporadically in the Storage area....

How to setup pay per results

Hello boys and girls, I'm thinking of switching an actor to pay per results, i didn't find any explicit exemple using the SDK, I setup the dataset unit name to my-actor-results will this be enough using python ?...

I am facing 403 error in actor

Even i have residential proxies @ApifyBot

API Timingout

Trying to fetch some tweets via Apify API. Worked fine until this morning, suddenly giving timeout errors. Don't believe it is an actor issue since actor is working fine via web UI. Curious if anyone else faced the same issue? Error message:...

Difference between trial and paid users in rental model

Hello, is there any way to find out if user is trail user?

Updating Monitization not possible

Good day! When I try to update the monetization on my actor, I get the error in the screenshot. I can't modify the "startedAt" value (I guess "effective from" - greyed out)
No description

Suggestion: Adding Batch Execution to the Run API

Currenly the Apify API doesn't support Array as input. When we request run API with ARRAY input eg: requests.post('https://api.apify.com/v2/acts/actorId/run-sync?token=********', json=[{'location': 'indonesia'}]) ...

Pass userData to request in Apify platform v3.1

Hi guys I want to pass data to the requestQueue , how can I do it in Apify platform v3.1 ? I were searching and saw this instruction: https://docs.apify.com/academy/node-js/request-labels-in-apify-actors. However Apify.openRequestQueue is deprecated in Apify v3.1 You can find my code in attachment Please help . Thank you...
No description

requestQueue write costs

Hi there, was there a change how much it costs to write to the requestQueue? Now running cost of the actor is determined predominantly by writing to the request queue and not how much CU it takes....
No description

Problem actor Instagram Scraper

I use Zapier with this Actor and the data sent to Zapier is not the correct ones for example for post hashtags

cheerio works on local but RequestError: Proxy responded with 400 Bad Request: 30 bytes on platform

Hi there, I have problem running cheeriocrawler with the apify czech proxies on the platform because I get this error. Crawler with the same proxies works on local, what could be the reason?