Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

foreign-sapphire

4/1/2024

Hey guys, trying to use the platform but receiving this error don't know how to drop a password for

Hey guys, trying to use the platform but receiving this error don't know how to drop a password for a company cuz it's not working org name is: Porada...

sensitive-blue

3/31/2024

too-many-names-same Error using JS Client

We use the Apify JS client and started seeing some strange errors when programmatically creating new actor tasks. Here is the code we use to create a task ``` const task = await apifyClient.tasks().create({ actId: "apify/website-content-crawler",...

afraid-scarlet

3/31/2024

Google Maps Scraper - same term different results

Google Maps returns varying results for a search term with the same query. Does anyone have a good strategy by which you can get as many unique results as possible if you were to reuse the scraper for the same search term? Or is it not possible?

!!!Joefree!!! 👑

3/30/2024

Bug Report 2024-03-31: Can`t clear secret input

When I want to empty secret input, error show up Error: Expected value to be of type string but received type "null"...

deep-jade

3/29/2024

Cannot get a ad-hoc webhook attached to a run of a js client actor

hi apifyers, i can't get ad-hoc webhooks connected to the "website-content-crawler" actor via js apify client. i am building a array of objects like this and base64 encode it as a string and give it via webhooks param to the actor input config. ...

wise-white

3/28/2024

apify push fails with 502 Bad Gateway

Hello, I can't push my actor anymore, as apify push returns the following error: ```shell

apify push...

other-emerald

3/28/2024

Is something wrong with Scheduled jobs right now?

I'm not getting any support from the chat bot right now. Here are the issues: 1. When I click on an existing schedule to edit it, a blank / white page is shown where you'd expect to see the config of the scheduled job. 2. As scheduled jobs run, the data only shows up sporadically in the Storage area....

deep-jade

3/27/2024

How to setup pay per results

Hello boys and girls, I'm thinking of switching an actor to pay per results, i didn't find any explicit exemple using the SDK, I setup the dataset unit name to my-actor-results will this be enough using python ?...

ambitious-aqua

3/27/2024

I am facing 403 error in actor

Even i have residential proxies @ApifyBot

optimistic-gold

3/25/2024

API Timingout

Trying to fetch some tweets via Apify API. Worked fine until this morning, suddenly giving timeout errors. Don't believe it is an actor issue since actor is working fine via web UI. Curious if anyone else faced the same issue? Error message:...

flat-fuchsia

3/25/2024

Difference between trial and paid users in rental model

Hello, is there any way to find out if user is trail user?

unwilling-turquoise

3/24/2024

Updating Monitization not possible

Good day! When I try to update the monetization on my actor, I get the error in the screenshot. I can't modify the "startedAt" value (I guess "effective from" - greyed out)

!!!Joefree!!! 👑

3/23/2024

Suggestion: Adding Batch Execution to the Run API

Currenly the Apify API doesn't support Array as input. When we request run API with ARRAY input eg: requests.post('https://api.apify.com/v2/acts/actorId/run-sync?token=********', json=[{'location': 'indonesia'}]) ...

eastern-cyan

3/23/2024

Pass userData to request in Apify platform v3.1

Hi guys I want to pass data to the requestQueue , how can I do it in Apify platform v3.1 ? I were searching and saw this instruction: https://docs.apify.com/academy/node-js/request-labels-in-apify-actors. However Apify.openRequestQueue is deprecated in Apify v3.1 You can find my code in attachment Please help . Thank you...

complex-teal

3/22/2024

Guys! What is the meaning of sourceFiles is invalid ? Can we please be more descriptive about what's

HonzaS

3/22/2024

requestQueue write costs

Hi there, was there a change how much it costs to write to the requestQueue? Now running cost of the actor is determined predominantly by writing to the request queue and not how much CU it takes....

generous-apricot

3/22/2024

Problem actor Instagram Scraper

I use Zapier with this Actor and the data sent to Zapier is not the correct ones for example for post hashtags

HonzaS

3/21/2024

cheerio works on local but RequestError: Proxy responded with 400 Bad Request: 30 bytes on platform

Hi there, I have problem running cheeriocrawler with the apify czech proxies on the platform because I get this error. Crawler with the same proxies works on local, what could be the reason?

eager-peach

3/21/2024

8bg vs 16gb RAM use - cost ?

A real novice question here but was wondering how the pricing differers here for an identical scrape between the two RAM sizes. Will using 16gb save me half the time but cost twice as much so ultimately even out or is there a noticeable difference in cost between the two ? FWIW i'm not in a rush to complete the scrape.....

genetic-orange

3/19/2024

Expected property `properties` to be of type `object` but received type `undefined` in object

So I setup my INPUT_SCHEMA.json under the .actor folder ```Json { "title": "....",...

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.