crawlee-js
apify-platform
crawlee-python
💻hire-freelancers
🚀actor-promotion
💫feature-request
💻devs-and-apify
🗣general-chat
🎁giveaways
programming-memes
🌐apify-announcements
🕷crawlee-announcements
👥community
I'm using HttpCrawler from Crawlee doing
I'm using HttpCrawler from Crawlee doing a
PUT request. I get the following error: Error: Resource served Content-Type application/octet-stream, but only text/html, text/xml, application/xhtml+xml, application/xml, application/json are allowed. Any possibility of allowing application/octet-stream or are PUT not possible? EDIT: Found it I had set a header to only accept json. Removing that header of the request solved the issue.I use this to check the currently used
I use this to check the currently used dataset:
await (await Actor.openDataset()).getInfo(). However, often times it is not up to date (I feel like some eventually consistent problem is playing). Is it possible of fetching the data when it is consistent? Currently I'm just waiting 3 seconds before fetching, but that feels "hacky".Get featured in Featured Developers section on Store homepage.
Hello @Public actor developer 's 👋
We are looking forward to change featured developers yet again and Actors on out store homepage.
And I am looking for devs and their Actors to feature, I think the first right is for the developers building great Actors, are active in community, and needs growth....
Hey all,
Hey all,
I am trying to publish an actor, but it fails through the automatic tests.
My actor expects a VAT number, and it must be valid. If it is invalid I return the 'Actor.exit()' in my code.
...
I'm disappointed with Apify's proxy. As
I'm disappointed with Apify's proxy. As a paid user, I expect better performance. It works fine on the Apify platform, but it doesn't support HTTPS when used locally. While it's okay for simple GET/POST requests, it fails with browser automation.
Hey all just a follow to my post here
Hey all just a follow to my post here yesterday...
The response to this:
"I was excited to try and recreate my agent team that I already use on Apify, but I keep running into all these problems I haven't had anywhere else and I'm starting to wonder if it's worth putting in the time to continue using Apify. Don't get wrong I think Apify is great for launching simple things like a youtube scraper etc. but for things like deploying a 30 Agent Team as an app I am starting to wonder if the learning curve for using Apify to do this is worth the time?"
...
Hi everyone! 😊
Hi everyone! 😊
We are currently developing a web application targeted at coaches and individuals in network marketing. We’re planning to integrate Apify into our platform to offer automated services to our users.
The idea is to automatically create an Apify account for each new user who registers on our platform and retrieve their API key. Initially, we want to provide each user with $5 worth of Apify services per month in our free plan. Later, for our premium plans, we plan to offer Apify credits that users can purchase and manage directly through our platform....
This is an innocuous warning that your
This is an innocuous warning that your Dockerfile defines this environment argument but doesn't use it. It is actually only useful in monorepos where you have multiple Actors in the same repo and you want to have shared code but know which directory was the Actor started from
apify-sdk-js/packages/apify at master · ...
I'm wondering if anybody ever extended/customized the https://github.com/apify/apify-sdk-js/tree/master/packages/apify ? Why do I wanna do that? I need to run actors on my own servers inside my own platform where tasks are coming from rabbitmq and I aggregate everything about the run including logs of the actors
429
Hello 👋
Does the HTTP crawler use fingerprinting by default when sending requests?
Because I get 429 too many requests from the API I am web scraping, and I suspect that my header values are the cause of it....
Hi everyone! 👋
Hi everyone! 👋
I’m working with Crawlee and was wondering:
Is there a way to enqueue links so that instead of sending a GET request, it sends a POST request with a body (and any other necessary information)?...
If the user pays Apify, it's no longer a
If the user pays Apify, it's no longer a free user and I will be paid for usage no? What are the two lines of code?
Hello how can i check if the user of my
Hello how can i check if the user of my actor is in trial period or not ? Thanks
Trial abusers
@Gustavo Silva
Tooling or a tutorial on how to combat trial abusers who create multiple accounts to avoid paying Apify and community creatorscan you elaborate?...
Year End feedback and Giveaway :tada:
Hey @Public actor developer Year End feedback :alert: @here
First of all I want to say thanks to everyone for being the best developer community out there and for shaping our product into its best form with your feedbacks and participation.
As the year end is approaching, I want to ask each one of you two things:...
using the JS SDK, and the run ID, can I
using the JS SDK, and the run ID, can I fetch the dataset from that run? I'm having a hard time understanding the docs for this task
Guys 👋 for standby mode, is there a
Guys 👋 for standby mode, is there a cost estimation for standby time? And can I stop/start it periodically?
**🚀 Introducing Pay-per-event (PPE)
🚀 Introducing Pay-per-event (PPE) Pricing Model: Alpha Testing Program @Public actor developer :alert:
We’re excited to announce the Pay-per-event (PPE) pricing model, now available for alpha testing!
This new model builds on our Pay-per-result (PPR) model, offering creators greater flexibility and control over how they monetize their Actors....
Is it possible to add conditional inputs
Is it possible to add conditional inputs for actors?
If the user selects
Custom I want to open the fileds for both start_date and end_date....