Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

rare-sapphire

5/15/2024

[Bug] JS Apify Client not updating tasks correctly

I am using the Apify JS client to update a task's inputs and options and am finding that it is not correctly honoring the API documentation https://docs.apify.com/api/v2#/reference/actor-tasks/task-collection/update-task In this doc, it says "If the object does not define a specific property, its value is not updated." However, in my testing, I have found that this is not the case. Rather, it will fail if any required variables are missing from the update patch. Even worse, options that aren't specified are removed entirely....

fair-rose

5/14/2024

Bug Report: Unexpected end of JSON input when scheduling actor

Hi, I am a public developer and my users are experiencing an issue when they schedule my actor. This is reproducible: 1. Create schedule for actor 2. Click Edit 3. Regular and JSON input is missing and error Unexpected end of JSON input (see screenshot) 4. This results in actor not getting any input during the scheduled run and failing...

afraid-scarlet

5/13/2024

Web Page Finder

New to Apify. Need advice on best Actor to complete desired outcome. Goal: Find all websites using a set of specific root urls.
Use case: A known company supplies it clients with dedicated webpages using a root url that doesn't itself display information. To get to a page with information, you need to have a complete url which always follows this format: http://company-url.com/client-identifier...

crude-lavender

5/13/2024

The actor can't start

Can someone help to looking to my actor? I got this error while start. My running log: runs/4wHMj7J2uLkrqVGM5#log...

metropolitan-bronze

5/9/2024

Scrape not writing data to dataset

I am a noob with JS and creating a scraper. I am not sure this is the correct place to post a question but it wasn't getting answered from the issue section of the scrapper itself. I am using Puppeteer Scraper made by Apify and can print to screen the scrapped data but I can't get it to write to the dataset. I have tried multiple different methods but no success. Any help would be appreciated or a point in the correct direction would be appreciated. I know this is something simple and am going to kick myself when it is figured out! lol...

fanuc_puppeteer_scra...

subsequent-cyan

5/5/2024

Selenium WebDriverWait() not available?

Hello, I'm running a python Actor on a page that has some dynamic content that loads slowly. I'm using WebDriverWait() in my code that works outside of apify. But when I run this code in apify I see this error message: ```...

multiple-amethyst

5/3/2024

why select schema not working?

``` "platform ": { "title": "Search engine", "type": "string", "description": "Select the search engine you want your websites from.",...

sensitive-blue

5/3/2024

Actor Failures

Hi Guys, any ideas on how to get more insights about the failures of my actor for all my users?

like-gold

5/3/2024

Javascript API SDK: How to call multiple actors simultaneously?

I have this code which works fine to call my custom actor a single time: const run = await client.actor("xyz").call(input); But I want to run multiple Actors simultaneously, like this: ```for (let input of inputs) {...

adverse-sapphire

5/1/2024

input schema timeout run options

Hi, I’d like to know how to set the timeout value in my actor or input_schema JSON file, so that the timeout run option appears as shown in the appended picture on Apify. Thanks in advance for your help....

ambitious-aqua

4/30/2024

User was not found or authentication token is not valid

Im getting this issue when trying to use one of the services

like-gold

4/29/2024

Actor broken

I'm trying to use this actor for a few days now - https://console.apify.com/actors/JaKpkI1ExstGUrO8o/console However, it's not working anymore. I've used it sucessfully before. Can you please check? This is very urgent!...

sunny-green

4/26/2024

String input schema => TypeScript editor

Is it possible to have a TypeScript editor for the string input field?

exotic-emerald

4/23/2024

I need help to retrieve an actor's input schema

I can retrieve the list of public actors available, and the information of a specific actor as well. The problem that I have is that I need to now (and retrieve) a specific public actors input schema before running it right? How can I do that?...

Mantisus

4/22/2024

Creator Plan and Open Source Actors

Creator Plan prohibits the use of any Actors that are not owned by the developer. But this restriction seems a bit strange for Actors whose source code is open source, since I can simply copy the source code and create a duplicate Actor as my own. In the end it doesn't restrict usage in any way, it just adds to the inconvenience. A simple example is https://apify.com/lukaskrivka/csv-file-to-dataset...

modern-teal

4/21/2024

I want to get only Tweets (not retweets)

Hello! If I scrap a profile, I get tweets+retweets, there is no such thing where I can get only 'tweets'. I have tried setting ''retweeted: false" but it's not not working, can you please tell me how can I only get tweets...

modern-teal

4/21/2024

How can I get the latest LinkedIn posts with the given public actor

https://console.apify.com/actors/kfiWbq3boy I am scrapping posts by a person and I want to get latest date or having a date range, how can I put it in the input params...

grumpy-cyan

4/21/2024

Setting my personal proxy for paid actors

Hi folks! I'm publishing a scraper that needs a really good proxy in order to work. When using it without proxy it fails and in order to make it user friendly I thought of injecting my own proxy and adding this to my revenue margins. Is this a really bad practice or something common people are doing here when scraping websites with lots of security layers?...

optimistic-gold

4/18/2024

Error: Dataset with id: [ACTOR_DEFAULT_DATASET_ID] does not exist.

Hello everyone, I'm trying to use apify actor:push-data inside an actor. The command is inside a dockerized shell script [1] and as simple as this: ``` curl http://httpbin.org/ip | apify actor:push-data...

typical-coral

4/17/2024

Actors didn't appear on main profile

My actors don't appear on my profile after creating an organization. If I visit the actor with a route like this : https://apify.com/aweworkz/html-web-media-scraper Works fine but if I visit the profile which https://apify.com/aweworkz ...

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.