Hi there,
Let me share some tips to deal with common scraping challenges.
For your case, specificall,y missing content from JSON:
So, if you are getting back incomplete content, I would recommend setting waitFor=3000.This gives the website some extra time for the content to load before we scrape its content. Also, setting onlyMainContent=false can help if the website has an unconventional structure and we accidentally filtered out the main content.
If you happen to be seeing the ERR_BLOCKED_BY_CLIENT error, this usually means that our built-in functionality to filter out ads from your scraped content was blocked. Setting blockAds=false often solves that.
Finally, if you got a ERR_TUNNEL_CONNECTION_FAILED error, this indicates some sort of temporary issue with the proxy being used. If you've explicitly specified the proxy location in your request, you could try removing the location parameter from your request.
Please give these a try and if you're still running into issues, let me know and I can take a deeper look for you!