Apify API not working
I'm developing a custom actor for my project and it fully works as I intended it but when I use the apify API to interact with it programmatically the actor doesn't seem to be receiving the inputs as it should be. I send it as JSON properly and everything but it gives me the error:
Not really sure where to go from here, but i'd appreciate any help.
4 Replies
genetic-orangeOP•15mo ago
Just as a follow up it appears to be scraping properly just is having issues processing everything from there
painful-plum•15mo ago
Could you please provide a code snippet or a reproduction of the issue? It's difficult to offer assistance having only the error trace above.
genetic-orangeOP•15mo ago
Hey so im not at my computer rn but I can explain it
When I run apify api from postman or dashboard it scrapes without issue
When I run it from heroku i THINK target site is blocking me
Im using proxies as well on the http reqs
Im solving their antibot and everything
I realize it may be a problem with the server getting blocked but the fact that its still catching me through my proxies idrk what to do
painful-plum•15mo ago
Try to log response from your target site.
Also, here is some article for inspiration:
https://docs.apify.com/academy/node-js/analyzing-pages-and-fixing-errors
Otherwise, still, providing some code snippets / full reproduction, you use, is the best way to go.