Proxy example with PlaywrightCrawler

This is probably a simple fix but I cannot find an example of crawlee using a simple proxy link with Playwright. If anyone has a working example or know what is wrong in the code I would really appreciate your help. Here is the code I have been working with: (I wish I could copy and paste of the code here but the post go over the character limit I get the following error from the code: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/jr/Desktop/Pasos_webscraping/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 528, in wrap_api_call raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None playwright._impl._errors.Error: Page.goto: net::ERR_CERT_AUTHORITY_INVALID at https://www.instagram.com/p/DGWPnK1S0K2/ Call log: - navigating to "https://www.instagram.com/p/DGWPnK1S0K2/", waiting until "load" Any help on how to proceed would be greatly appreciated!
cooklikeimbook
Don’t complicate weight loss. Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs INGREDIENTS: - 300g skinless chicken thighs - 30mL Low Sodium Soy sauce - 7-8g Brown sugar - 1 tsp Ginger powder- ginger paste does better than powder - Black pepper - 3-4 cloves Garlic - 15mL Lemon juice ( I only had lime leave me alone) - 180g Whit...
Likes
3478
Instagram
cooklikeimbook
Don’t complicate weight loss. Whole Pan: 740 Calories | 78g Protein | 12g Fat | 67g Carbs INGREDIENTS: - 300g skinless chicken thighs - 30mL Low Sodium Soy sauce - 7-8g Brown sugar - 1 tsp Ginger powder- ginger paste does better than powder - Black pepper - 3-4 cloves Garlic - 15mL Lemon juice ( I only had lime leave me alone) - 180g Whit...
Likes
3478
Instagram
No description
2 Replies
Hall
Hall2mo ago
Someone will reply to you shortly. In the meantime, this might help:
eastern-cyan
eastern-cyan2mo ago
Hey The documentation has examples of using PlaywrightCrawler with proxy - https://crawlee.dev/python/docs/guides/proxy-management#crawler-integration. Try changing the proxies you are using. Judging by your error I think your proxies have some kind of certificate conflict with Instagram

Did you find this page helpful?