Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

fair-rose

1/5/2025

Apify - IG Data Extractor

How can I export the data acquired from the Instagram Profile Scraper (Apify) on autopilot back into google sheets everytime an actor runs whilst only importing specific data (such as Full Name, Biography). I just started my journy in coding and its incredible! thank you so much in advance

optimistic-gold

1/5/2025

Best way to deal with multiple datasets ?

What is the best way to compile all the datasets into a single dataset from multiple agents running and their individual tasks, each tasks has its own set of runs producing multiple datasets. Found this to be very confusing, zapier etc don't really process data like its needed - needs additional transformation. Thought the platform would have an option as there is an option under storage to create your own dataset but found interesting that there is not way to internally link any existing datasets to it ... possible to explain and advice? Thanks...

azzouzana

1/3/2025

Bank transfers fees has to be revisited

Hello 👋 Apify already takes 20% of the revenue earned, so it doesn’t make much sense for a developer to bear 100% of the bank transfer fees. These fees should be split between Apify and the developer (SHA/BEN/OUR) if not entirely by Apify, given they already take a 20% cut. FYI: This is how several other platforms operate to incentive developers....

like-gold

1/3/2025

ETIMEOUT

When running apify create and installing a template, got the following error: Error: connect ETIMEDOUT 20.205.243.166:443...

adverse-sapphire

12/31/2024

instagram

hi how to connect APIFY with Firebase and Instagram to extract events info from Instagram photo posts with OCR and publish them automatically into my Website in firwbase?

optimistic-gold

12/29/2024

Wiil webhooks retry?

Just a quick question- I'm using Apify webhooks to run a process when an actor is finished running. If for some reason my server fails to respond to Apify, will they automatically retry again? If so, how often?

conscious-sapphire

12/28/2024

Error: Operation failed! (You currently don’t have the necessary permissions to publish an Actor. Th

Please assist on this issue. I am trying to monetise/ publish my first actor but keep getting this error. my apify id is jackhax1

fair-rose

12/25/2024

Changed the actor's URL, but the URL on the profile page remains unchanged.

I just launched my first actor. However, I thought its URL was not appropriate, so I changed it. After that, I went to my profile page, clicked on the actor, and it still pointed to the old URL. As a result, it couldn't find my actor and redirected me to Apify's homepage. So how can I fix this? The actor URL cannot be changed after it is made public? This is my profile: https://apify.com/ecomscrape, my actor still remains the old url: https://apify.com/ecomscrape/lazada-product-crawler And my new actor url: https://apify.com/ecomscrape/lazada-product-scraper...

metropolitan-bronze

12/22/2024

Actor Store Search Data

As an actor developer, it would be super helpful to see what terms folks are searching for in the store. It would then let me better understand what to focus on, instead of guessing. Is this something that exists already or should I post it in #💫feature-request ?...

genetic-orange

12/17/2024

Something is off when running from Apify

Hey, So, I developed the NewEgg scraper actor, and I’m having some trouble, particularly because I think NewEgg upped their anti-bot protection during holiday season. However, something weird is happening, when I run the code locally using your residential proxies, it sometimes fails, but generally it doesn’t, specially after I implemented UA Rotation....

eager-peach

12/17/2024

Wont let me enter my address to upgrade

Hi, the platform wont let me enter my street address so i can upgrade. It keeps saying "An exact street name match could not be found" I have tried multiple variations of the address. I live semi-rural.

optimistic-gold

12/15/2024

Dataset schema view

Hey, in the dataset schema view, we can either show all data or apply a transformation like "flatten". Is it possible to do both: extract certain fields that may be more important to their own columns, but still have an object field for the full data (some field are less important and potentially empty)? When I do it at the moment the data is shown as undefined. I'm adding my code and the resulting views as screenshot, hope this helps understanding what I'm describing. Relevant docs I've used for reference: https://docs.apify.com/platform/actors/development/actor-definition/dataset-schema...

provincial-silver

12/13/2024

You can not publish an Actor

Hi! I can't Publish my Actor, Even though I purchased the creator plan

ratty-blush

12/12/2024

Load images in readme

Hello, how to make the images load in store in the actor readme? Currently, they are not showing up despite being present in the repo. https://apify.com/cyberfly/listingmonitor...

secure-lavender

12/11/2024

how to set up cookies?

cookie edit does not work i just wanna know 1) how does he cookie obj looks like + how to get it talking about the no code platform...

genetic-orange

12/11/2024

Actor being flagged as in maintenance

Why is this being flagged as in the maintenance? The output is non empty...

genetic-orange

12/9/2024

Questions regarding trial periods

Hey guys, Quick question, when it says on my actor that it has “3 users” (one being me I suppose). And given my actors have a free trial of 2 hours, if the 3 users stay for more than 2 hours does it mean the 2 have activated the paid version? ...

optimistic-gold

12/5/2024

Youtube Downloader (Premium)

hello guys, i want to ask, i want to scarp (download the video, description, etc) with youtube downloader. but i can't seems so because youtube need to sign in. i already asked the chat (AI) but there's should've not have problem. is there anything wrong with this>

stormy-gold

12/4/2024

Get input data dynamically

Is there a way to dynamically obtain the inputs for the actors through an endpoint without having to review the documentation ? Because I wouldn't be finding it....

stormy-gold

12/4/2024

All actors are broken, can't access

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.