Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

optimistic-gold

11/17/2023

Can the TikTok actors scrape the For You

Can the TikTok actors scrape the For You page? If cookies for login is provided even?

frail-apricot

11/14/2023

Help me, please. I don't understand why

Help me, please. I don't understand why if I set up 5000 requests I get a maximum of 906, I'm using an actor Facebook Groups Scraper...

flat-fuchsia

11/14/2023

is there any template to scrape tweeter

is there any template to scrape tweeter twetts date wise.

fascinating-indigo

11/13/2023

Hi, would it be possible to change

Hi, would it be possible to change dataset export xls format to automatically convert columns that are urls to be clickable links? Meaning that customers could just click and not copy paste it to the browser if they want to visit the url.

!!!Joefree!!! 👑

11/13/2023

Good day @Apify#7385 team 👋🏻 . new

Good day @Apify team 👋🏻 . new suggestion of the day: enable actor console to receive file upload as input. The input could be stored in default key-value store as octet/stream name INPUT_FILE.

stormy-gold

9/28/2023

The instructions around setting up

The instructions around setting up Github Actions, whilst very valuable, has some errors / is outdated on a version. Working on getting you guys consolidated feedback with all the suggestions, just need to get it working first. If you have some time, please see https://discord.com/channels/801163717915574323/1156897596011446312 (And thank you)

sensitive-blue

9/16/2023

why does my tiktok scraper stop early

why does my tiktok scraper stop early all the time? run time is 1200 seconds & it keeps stopping at 1-2mins why cant i chat to support? the links are broken...

optimistic-gold

9/12/2023

Hi I am using the Instagram Hashtag

Hi, I am using the Instagram Hashtag Scraper actor and was wondering why Apify does not collect the location tag from posts? I do not see this location in the available metadata after using Apify, was wondering if there was a way to collect it...

!!!Joefree!!! 👑

8/17/2023

Hi team Any plan to add SQL type dataset

Hi team! Any plan to add SQL type dataset storage to apify platform ?

like-gold

8/16/2023

Hi Apify team will make my scraper

Hi Apify team. will make my scraper faster if subscribe to a paid plan? My task is the playwriter crawler to make a simple request. But it takes 1 minute in most cases and rarely takes around 20 seconds.

yelping-magenta

8/11/2023

Plans and pricing · Apify

Hi Apify team. I had a quick question about how upgrade plans affects the data retention period. By default, the free plan provides a data retention period of 7 days for actor runs, unnamed storage, etc. The documentation online states that upgrading plans can increase the retention limit but I don't see any information about retention periods for each of the respective pricing plans on the pricing page. Can someone please tell me what the periods are for each of the plans beyond free? Thanks! https://apify.com/pricing...

deep-jade

8/8/2023

Google Dataset Items Translator · Apify

Hi Apify team, just a quick comment. I noticed you changed how the Actors are listed and sorted, in a way that I frankly do not quite understand... The way you are sorting the Actors "by relevance" doesn't make to much sense (maybe only to me?) I will explain with an example (Actors chosen randomly): How can this Actor: https://apify.com/hamza.alwan/google-dataset-items-translator (Modified 17 days ago, 1 user, 27 runs, listed on page 3 as I am writing this) be more "relevant" than this one: https://apify.com/epctex/realtor-scraper (Modified 19 hours ago, 458 users, 16.5k runs, listed on page 6). Again, the two actors selected are just random examples, the list goes on... botom line is: Can you enlighten us and explain what "relevance" means for apify? is there a known way to become more relevant? Thanks for your feedback in advance....

flat-fuchsia

8/7/2023

Dear Apify Team

Dear Apify Team, I hope this message finds you well. I wanted to bring up a feature request that could enhance the user experience on the Apify platform. Currently, when interacting with issue comments, there isn't an option to edit or delete comments once they're posted. This can be a bit inconvenient, especially in cases where a mistake is made or additional information needs to be added after the fact....

fair-rose

7/28/2023

hi there Does APIfy have have a swagger

hi there. Does APIfy have have a swagger or open api spec to generate api clients?

equal-jade

7/9/2023

this has been deleted but is linked as

this has been deleted but is linked as the source code for the instagram scraper. same goes for google

provincial-silver

7/8/2023

Actually it looks like all of the links

Actually, it looks like all of the links under 'How to analyze the error' except for 'named dataset' in item #3 are broken.

provincial-silver

7/7/2023

Source types | Apify Documentation

The documentation for source-types is using a link that doesn't go anywhere–https://docs.apify.com/platform/actors/development/deployment/source-types Discovered by trying to learn more about CI via Github workflow. From my actor's Source -> Code I clicked Github integration in To automatically rebuild your actor on every git push, see GitHub integration. That leads to the link I shared above. On that page, the info about setting up an integration for automatic rebuilds on every commit includes a Github integration link that just links to the current page....

optimistic-gold

5/16/2023

Hello I am using facebook profile

Hello, I am using facebook profile scrapper actor( Facebook Pages Scraper) via api gateway and lambda. The time taken is from 30 secs to 2mins. Api gateway timeout is 29 secs only. Im using free account. Is it the normal time taken or something can be fine tuned. Please help.

unwilling-turquoise

5/15/2023

Just about done with my Twitter scraper

Just about done with my Twitter scraper. The experience was alright, but I ended up building 680 times in the process of completing it 😅 . The main problem I faced was the ide was difficult to work with without linting etc, and I didn't want to run it locally since I thought it would behave differently without the input setup etc. Maybe you can do it all locally, but I just found the experience with the ide very frustrating without linting. I think it could be a great feature to add.

conscious-sapphire

5/9/2023

hallo i am using apify facebook comments

hallo, i am using apify/facebook-comments-scraper . but i can not get replies of a comment ? i want to get pageOwner infomation who is active ?

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.