Crawlee & Apify

CA

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

Do you have some best practices for

Do you have some best practices for developing big actors 🤔 I have done a lot of refactoring but I am missing some guidance on this for my actors

Is it possible to send out a notice to

Is it possible to send out a notice to existing customers about any breaking changes due to changes to the code and implementation of the actor?

everyone We are starting to work on

@everyone We are starting to work on better rating of Actors. At the moment they are mostly ordered by the overall number of users which gives a huge advantage to old Actors no matter the quality. What metrics are in your opinion important for you and your users? Which would you like to show (and which not) and why? We are planning to add some kind of customer rating (github stars/ 1-5 stars/ reviews) as well in the future, but at the moment want to leverage things we already measure anyway. Post in the thread please....

Apify Console

Hello @team. Could we keep a run from disappearing, can we give a "run" a name, so I can include a run as example inside README. example https://console.apify.com/view/runs/GLYwNz2OOdTnTuHK4 A run have nice view about memory and compute unit also dataset sample, But it will gone after couple days.

Hey I m building multiple actors in one

Hey! I'm building multiple actors in one project. They all share a lot of logic. Is there a recommended way to develop and manage multiple actors in the same project? Right now everything seems centered around the config in .actor and it doesn't seem possible to configure this. Basically the following would solve my problem: * Being able to have multiple actor configs in the same project * Being able to specify entrypoint for each config or have multiple scripts in package.json to start a specific one when developing...

Hello everyone

Hello @everyone, As a developer who has created an actor, I'm looking to implement a subscription model. I've noticed the "Users" count below an actor and I'm wondering if this indicates the number of subscribers for that particular actor, or if it signifies something else? Any insights or advice on setting up a subscription model for my actor would be greatly appreciated. Thank you in advance!...

Hi vladdy VaclavRut Petr Pátek 2496

Hi @vladdy @Nardack @petrpatek. If I need to do api(POST request) scraping using crawlee, how do I do it? Thanks...

Actor settings page is not working

Actor settings page is not working

Hi I got some problem when get clipborad

Hi, I got some problem when get clipborad data in browser, it report permission error. How to solve such problem? Is there any example can be refer. The crawl use playwirght. Any idea are welcome。

Refering to screenshot attached Does

(Refering to screenshot attached) Does this field support json path expressions ? For eg, if i want to access field inside array of objects and output array of strings, can use values like field.*.key ? I have object like this: ``` { ...
No description

No What would be the use case You can

No. What would be the use case? You can set it for free forever 🙂

everyone So the Actor as integrations

@everyone So the Actor as integrations are out (with a ton of improvements to be worked on). Docs here: https://docs.apify.com/platform/integrations/actors/integration-ready-actors. IMO it is a great opportunity to let users know about you. It is a bit inconvenient that you cannot have a rental actor as integration at the moment, you can have a price per result (but most integrations dont have results, so it is also not ideal). Anyway I believe it is a big step for Apify and its users, so lettin...

i uploaded a project from github but its

i uploaded a project from github but its giving error There was an uncaught exception during the run of the Actor and it was not handled....

i have an issue i cant seem to get past

i have an issue i cant seem to get past on my code, looking for a quick assistance. Willing to pay for your time shouldnt take long.. its an error about ERROR: .actor/actor.json has invalid format [ { "instancePath": "/actorSpecification", "schemaPath": "#/properties/actorSpecification/type", "keyword": "type",...

Hi all

Hi, all. I am an experienced web designer & developer. If you have a project in mind or if you're just exploring potential enhancements to your website or web application, I'd love to chat with you....

Sorry for responding with an unrelated

Sorry for responding with an unrelated question, but I tried to (unsuccessfully) find out how to get started with the $500/month credit for developing new actors. Where do I find this? How do I sign up for it? I am ready to develop some but I can't find this offer in my account. Thank you!

everyone Heyo I have decided it is time

@everyone Heyo, I have decided it is time to enable you contacting your users 🎉 . So we are designing a way for you to send an email to users of one or more of your Actors. Any features that you would consider a must have in this system? Any (really easy) features you would consider a nice to have? Thread me!

I am unable to push new actors to apify

I am unable to push new actors to apify using apify push command.

Hi Team I have suggestion possibility to

Hi Team. I have suggestion, possibility to update actor README without to have rebuild the actor. for example using upload mechanism just like uploading actor image/icon.

Is it possible to upload a beta image

Is it possible to upload a beta image build so that one of my customers can test new features in my actor to ensure existing functionality does not break for existing customers?