crawlee-js
apify-platform
crawlee-python
💻hire-freelancers
🚀actor-promotion
💫feature-request
💻devs-and-apify
🗣general-chat
🎁giveaways
programming-memes
🌐apify-announcements
🕷crawlee-announcements
👥community
3rd party actor support
Newbie question: What's the best practice of getting support on a 3rd party actor? Have added a record to the issue section of the actor, to no avail, hence my question. thank you!
Instagram posts by location
Hey ! I'm currently using the apify/instagram-scrapper actor and it's working great.
I can gather posts as i need by hashtags or user, but it doesn't seems to work on location.
I always get only one location with a few top posts and a few recent posts.
How can i do to make it return results like it does for a hashtag or a user 🧐 ? ...
Actor Docker pesistent Files
Is it possible for an Actor to have persistent files that always updated, and where should I put the files. For example file based database such SQLite, etc.
Thank You....
Extended GPT Scraper help
anybody had success deploying extended GPT Scraper on Google Apps Script? i keep trying to run it but keep getting this error : 12:09:14 PM Error
TypeError: Cannot read properties of undefined (reading 'method') callApifyApi @ Code.gs:9" in my code. I have a url list of websites and want it to run with my GPT-4 API key. would be great if get some support on this thanks!...
TypeError: Cannot read properties of undefined (reading 'method') callApifyApi @ Code.gs:9" in my code. I have a url list of websites and want it to run with my GPT-4 API key. would be great if get some support on this thanks!...
How to automatically get export results from a schedule run into my custom server that will take the
I'm using Apify and want to schedule a run and process the data on my server without logging into the Apify application.
can i use apify with go?
hi every one, can i do a scrapper with go and apify and how to configure a free proxy
How can I protect my named key value store with a bearer token?
I created a named KV store but am discovering that it's publicly accessible.
I want to have the authentication be based on my apify token via the authentication header. Is that possible?...
Apify actor is too slow
Apify pulls docker image every time I run the actor. Is this the expected behavior and is it possible to fix this in python client?
Update Notion's Image Public URL Hourly
Hi,
I wonder Can I use Apify to update the image link in my blog (using Notion API)? Since every time a page is queried, a new public URL is generated for all files hosted by Notion. The public URL is updated hourly, the previous public URL was only valid for one hour.
Thank you really much!...
How can I provide input to an `apify run` from the CLI?
I have my project checked out locally and am running
apify run but it won't get the input since i didn't initiate the run via the apify console.
I see that i can provide the input as JSON when initiating via the API.
But how can I do so from the CLI?...Apify server in Germany
is there a way for me to select where the apify server is located?
Both the proxies & the website i'm actually crawling have their servers hosted in Germany, so I would love to locate my apify server in Germany as well to reduce request & response times between servers....
Actor run continues after crawler shut down.
Hi guys I'm still kind of a rookie, but I managed to build my own scrapper. The problem is when it finished crawling all the links in the Requestqueue and crawler finished, it continues running forever until I click abort.
Any possible error that could prevent the run from ending , and how do I force run to stop when crawler finished?...
Book covers from Amazon won't load
For some reason book covers and their descriptions and their photos are not downloading. I tried on other categories, for example, household appliances, where everything is displayed normally.
In addition, does not download product descriptions.
I am interested in professional literature on personnel management, unfortunately I can not get descriptions and images....
crawl local html pages
I have some html files stored locally that I want to crawl. any idea how I could use crawlee for that?
How to manage a monorepo of Actors?
Hi, I'm hoping to get help using the https://github.com/apify/actor-monorepo-example and asked the following question a couple of weeks ago https://github.com/apify/actor-monorepo-example/issues/3. If anyone has the time I'd appreciate some help so I can continue working. Thanks a lot!
FB Photos for a Class Reunion
I am planning my HS Reunion's slideshow. How can I scrape FB photos from my classmates FB pages?
Scraping google maps data using restaurant names (1.8k)
For some reason it is taking a long time even for 10 results
Google play reviews scraper
Can anyone look into the code below, I don't know what's wrong but i can't scrape reviews from play.google.com using below code.