Crawlee & Apify•3y ago

Upwork Job Auto Apply · Apify

Greetings, I need this actor re-built (it's currently broken): https://apify.com/big-brain.io/upwork-application Need this done fast. Please message with me timeline and cost to do this.

Apify

Pass a job application URL, Upwork login information, and messaging and automatically apply to a job. Pair with Upwork's RSS feeds to apply within minutes of a job being posted.

29 Replies

quickest-silver•3y ago

It's a community actor, i.e. it's not built by Apify team. Unfortunately - we can't escalate it anyhow - it's up to developer. We don't have any other options to reach him other than the ones as you have (open an issue, ping him on github, etc).

fascinating-indigo•3y ago

Please be aware that automated access is against Upwork ToS and if they detect such activity account will be blocked. Just a friendly advice - don't do it since its nearly impossible to recover blocked UW acc 😉

quickest-silver•3y ago

Side note - I see successful runs too. Could you maybe send me a DM with your account email or run Id - there's a chance there's something wrong with your input.

equal-aqua•3y ago

Run 4VNBBxx7SasGwUhES

quickest-silver•3y ago

See your account. I see that successful runs have start urls ending with apply/#/ while yours ends with apply/ or have some entirely different URLs on input - not sure why it matters, but looks like that could be the reason. Another possible reason is that you're not using proxy at all, try to run it with proxy, please. But otherwise, as mentioned - it's just my guesses, I don't have access to the source code.

equal-aqua•3y ago

Hrm, URL being submitted is https://www.upwork.com/ab/proposals/job/~012d793cdd09298f71/apply/ oh, literally add #? I don't get it. Tested this: 2023-01-06T22:44:36.590Z ACTOR: Pulling Docker image from repository. 2023-01-06T22:46:32.453Z ACTOR: Creating Docker container. 2023-01-06T22:46:32.830Z ACTOR: Starting Docker container. 2023-01-06T22:46:42.042Z Starting X virtual framebuffer using: Xvfb :99 -ac -screen 0 1920x1080x24+32 -nolisten tcp 2023-01-06T22:46:42.043Z Executing main command 2023-01-06T22:46:43.908Z INFO System info {"apifyVersion":"1.3.4","apifyClientVersion":"1.4.2","osType":"Linux","nodeVersion":"v16.18.1"} 2023-01-06T22:46:44.019Z ERROR 2023-01-06T22:46:44.020Z TypeError: Cannot read properties of undefined (reading 'match') 2023-01-06T22:46:44.021Z at /home/myuser/src/tools.js:15:18 2023-01-06T22:46:44.022Z at Array.forEach (<anonymous>) 2023-01-06T22:46:44.023Z at exports.validateStartUrls (/home/myuser/src/tools.js:14:10) 2023-01-06T22:46:44.024Z at /home/myuser/main.js:19:5 2023-01-06T22:46:44.025Z at processTicksAndRejections (node:internal/process/task_queues:96:5) 2023-01-06T22:46:44.026Z at async run (/home/myuser/node_modules/apify/build/actor.js:182:13) Still same issue. Any idea? run XIAipR38S0qb1SMoy

quickest-silver•3y ago

what about proxies? did you try to use it with proxies? ah, I see - you did I think I know what's wrong. Why are you trying to add a link to the remote file? Your raw input looks like that:

"startUrls": [
    {
      "requestsFromUrl": "https://www.upwork.com/ab/proposals/job/~012d793cdd09298f71/apply/"
    }
  ],

"startUrls": [
    {
      "requestsFromUrl": "https://www.upwork.com/ab/proposals/job/~012d793cdd09298f71/apply/"
    }
  ],

For actor it means there's a remote file via this link and it tries to pull start URLs from there. Add start URL as a normal URL (just click on add button, paste the URL there, and remove the first row. Check it in raw input (switch to JSON editor button) to make sure it looks like this:

"startUrls": [
        {
            "url": "https://www.upwork.com/ab/proposals/job/~012d793cdd09298f71/apply/#/"
        }
    ]

"startUrls": [
        {
            "url": "https://www.upwork.com/ab/proposals/job/~012d793cdd09298f71/apply/#/"
        }
    ]

Almost sure it would resolve the issue.

equal-aqua•3y ago

I've tried a few different things. What kind of input are you seeing work for this? Okay, that actually worked.

MEE6•3y ago

@vladislav just advanced to level 1! Thanks for your contributions! 🎉

equal-aqua•3y ago

Thank you!!

quickest-silver•3y ago

Sure thing 👍 Glad that it helped! 👌

equal-aqua•3y ago

Is there a reason when I use JSON editor, it doesn't save but rather reverts to the original data (URL specifically)? I enter a ton of URLs, it just resets to just one. I don't get it. The moment I click save, my inputted content gets replaced Never mind, found the issue. I keep getting Failed There was an uncaught exception during the run of the actor and it was not handled. Any idea how to fix this one? e5UfsXXO4hA6nYQnn

quickest-silver•3y ago

This one - certainly something's off with the logic, there are some timeouts, and my guess would be that the actor throws an error in some catch block or in some error handler, but sadly I would not be able to do anything with it - as this definitely should be fixed in the code... Hmm, or you could actually try to increase actor memory. There's a chance that timeouts are there because there's not enough resources allocated and with higher concurrency the page isn't loaded properly and within specified timeouts. I would give it a try - run it with like 8 or 16GB I've also reported it to the team responsible for the Apify Store contents, not sure if we could somehow push the dev to fix/optimize it. Meanwhile please try to increase the memory. Fingers crossed it would help

equal-aqua•3y ago

Yeah, tried max memory and just tried lower. Same issue. Sigh.

quickest-silver•3y ago

So it turns out we are also trying to reach the guy internally. No response after a week so far :/

equal-aqua•3y ago

Hey Andrey - I received a message from him this morning. I also have a call scheduled with him tomorrow to discuss as well. It sounds like he's very much active, just distracted maybe or something?

quickest-silver•3y ago

That's great, thanks for letting me know, hopefully he'll update the actor to your needs 🤞

equal-aqua•3y ago

Are you able to extend the trial of the Actor since it's not working right still? I just got a notice I'd be getting billed.

quickest-silver•3y ago

@vladislav extended for another week 👍 Hopefully it will be updated during this time.

equal-aqua•3y ago

Thanks!

MEE6•3y ago

@vladislav just advanced to level 2! Thanks for your contributions! 🎉

equal-aqua•3y ago

Hey guys - okay, so the developer just now fixed the Actor with the update. Is there any chance I can get credit for all the lost funds so far that were gone into the broken actor and have the trial renewed accordingly? It is just NOW formally working and you can now see successful runs. It's been broken this whole time.

quickest-silver•3y ago

👍 extended till 23 Jan

equal-aqua•3y ago

Thanks Andrey. I think this is going to be awesome going forward.

quickest-silver•3y ago

Fingers crossed 🙂 Hopefully no more issues from now on 🙂 And great that the dev responded and fixed the problem in the end 👌

equal-aqua•3y ago

Hey Andrey - how do I run with non-US proxies? Do you have any? If we scrape Upwork with a US proxy, I get US-only jobs. So I need non-US proxy, ideally in Canada or UK. How do I set that up?

quickest-silver•3y ago

I guess the easiest option is to use RESIDENTIAL proxy - you could specify pretty much any country there, just keep in mind that they are priced per traffic

equal-aqua•3y ago

Andrey - what is the cost for the traffic? Never mind, just tested - it's pretty cheap.

quickest-silver•3y ago

yeah - if you don't do a lot of scraping, i.e. not opening hundreds/thousands of pages - it's not that noticeable, but generally speaking - it's $12.5/GB

Gaming

Programming

Upwork Job Auto Apply · Apify

Did you find this page helpful?