Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Join

crawlee-js

apify-platform

crawlee-python

💻hire-freelancers

🚀actor-promotion

💫feature-request

💻devs-and-apify

🗣general-chat

🎁giveaways

programming-memes

🌐apify-announcements

🕷crawlee-announcements

👥community

foreign-sapphire

3/18/2024

actor marked as maintenance despite success run

I just got an email about Actor has been flagged as under maintenance. I check run which triggered maintenance and it's succesfull. Why this is happening?

rising-crimson

3/18/2024

Interaction between webhook integration and monthly usage limit

I use webhook integrations for all the actors I use. The events I use are run; succeeded, created, failed, timed out, aborted and resurrected. If I hit my monthly apify usage limit, while an actor is running, Will the webhook fire? What event type (if any) occurs upon reaching the usage limit?...

!!!Joefree!!! 👑

3/16/2024

Multiple (hundreds) Checkbox INPUT

What is the best way to replicate this INPUTS into INPUT_SCHEMA.json

!!!Joefree!!! 👑

3/15/2024

Can't find my actor anywhere in the store

May be I should wait for one more day ...🤗

!!!Joefree!!! 👑

3/15/2024

Actor FULL Strength

I have my actor all setup, readme, input schema, output schema. etc. But I am still missing one step to have my Actor in Full Strength .... but I am not sure what is it ?...

stormy-gold

3/14/2024

url not timing out for a reason.

Hello, my scraper goes in an infinite run on some url for a reason even tho I put a timeout time

 request = r.get(url=url, timeout=1.5)

 request = r.get(url=url, timeout=1.5)

. Any ideas why?

correct-apricot

3/14/2024

langchain prompt questions about dom structure

Can apifys integration with langchain be used to ask questions about the actual DOM and not just the text content? For example, prompt to return all element ids that allow user input. Could it handle custom elements like <custom_input>?

memo23

3/14/2024

Docker DNS Mapping Deployment

Hi, so I have a scraping actor that needs to fetch data from 'example.com', but it points to 123.123.123.123 instead, usually I add ip and domain in /etc/hosts file locally, how can I can achieve this via Docker or some other means in my Apify actors(Puppeteer)?

unwilling-turquoise

3/14/2024

Payment failure issues

I'm trying to move to a paid subscription plan but almost all of my cards failed- some with AVS errors, some with insufficient funds error... But the problem is that I triple verified my card details and funds- they all seem fine- they all work well in other websites and apps. Luckily one of my cards went through but got an email saying Central bank of India doesn't allow subscription payments, hence had to pay the invoice. When I tried paying the invoice, my payment failed again. By the way these payment failures are not just for India cards, but I tried two of my US issued visa cards which are failing too. I'm not sure if anyone else is facing this problem, seems to me like a Braintree issue. Other sites with payment processors such as Stripe are accepting my cards just fine....

rising-crimson

3/14/2024

How to access task arguments at runtime using golang

how can I query the input for the current task?

wise-white

3/12/2024

Get user payment status from actor

Hi, I have a PPR actor and want to access the user's payment status so I can prioritize their queries and set some limitations for non-paying users as well. My current actor implementation is in Node js. I understand that there is an endpoint /users/me but how do I get this info via my actor. Below is a skeletal implemention of the actor: ```js...

genetic-orange

3/11/2024

input schema proxy configuration

Hi guys, how to insert proxy configuration on my scraper? INPUT SCHEMA:...

stormy-gold

3/8/2024

Could anyone tell me the type of this schema input?

Hello, I can't find the type of this schema, could anyone tell me?

fair-rose

3/7/2024

hello Please help meI want to pay but I can't

hello Please help me I want to pay but I can't I tryed several credit cards and PayPal but APIFY said there are plobrem with my payment method so I ask credit company ...

foreign-sapphire

3/7/2024

Rental actor - proxy

In case of renting an actor, whose proxy is being used when running with proxy setting on?

!!!Joefree!!! 👑

3/7/2024

BUG Report 007: On dataset view, pagination is not working

On dataset view, pagination is not working

metropolitan-bronze

3/6/2024

websocket error during crawls that don't seem to be related to my Actor

We're getting crashes in our self-developed Actor (Python, playwright) from an apify websocket thing. We don't use websockets on our own. We're not sure what's causing this. ``` ERROR Error in websocket connection Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/websockets/legacy/protocol.py", line 1301, in close_connection...

foreign-sapphire

3/6/2024

My actor is constantly marked as Under maintenance. How can I check why?

Basically as in title.

extended-salmon

3/5/2024

I am not able to log in to Apify console since this morning

I have tried different browses, devices as well as clearing the cookies/site data. Attaching screenshot.

foreign-sapphire

3/5/2024

How can I set q={value} in “accept-language” part when using fingerprint suite?

I am using fingerprint suite to crawl data from Google Search Results, is there a automatic way to generate q={value} when I use fingerprint suite?

Previous Next

Gaming

Programming

Crawlee & Apify

This is the official developer community of Apify and Crawlee.

Crawlee & Apify

This is the official developer community of Apify and Crawlee.