F
Firecrawl•3mo ago
supersorted

Getting static response on execution of scrapeUrl

I have integrated firecrawl in nodejs application and I am getting static response on each scrapeUrl call which is 
[Introducing Authenticated ScrapingScrape behind auth walls. Join our waitlist today.](https://www.firecrawl.dev/authenticated-scraping)
[:boom:Get 2 months free with yearly plan](https://www.firecrawl.dev/pricing)
# The fast, reliableFast, reliable  web scraper for LLMs
Power your AI apps with clean data crawled from any website. [It's also open source.](https://github.com/mendableai/firecrawl)

https://example.com
[Introducing Authenticated ScrapingScrape behind auth walls. Join our waitlist today.](https://www.firecrawl.dev/authenticated-scraping)
[:boom:Get 2 months free with yearly plan](https://www.firecrawl.dev/pricing)
# The fast, reliableFast, reliable  web scraper for LLMs
Power your AI apps with clean data crawled from any website. [It's also open source.](https://github.com/mendableai/firecrawl)

https://example.com
cURL with my API Key is working fine. I got the code from playground https://www.firecrawl.dev/playground What could be the issue here?
Firecrawl
Firecrawl
Turn any website into LLM-ready data.
2 Replies
micah.stairs
micah.stairs•3mo ago
Which URL are you scraping? Try setting onlyMainContent to false
supersorted
supersortedOP•3mo ago
I am scraping https://www.foundit.in/job/python-trainer-teacher-hindustan-recruitment-raipur-35466434 This is working fine on firecrawl playground and with cURL. In my nodejs application, doesnt matter what URL i enter, i am getting the above static response
foundit india
Python Trainer/Teacher Job for 5 - 10 Year of Exp In Hindustan Recr...
Job Description For Python Trainer/Teacher Posted by Hindustan Recruitment For Raipur. Require 5 years Experience With Other Qualification. Apply Now To This And Other Similar Jobs !

Did you find this page helpful?