I am running this simple code to scrape a website
from firecrawl import FirecrawlApp
api_key = os.environ["FIRECRAWL_API_KEY"]
app = FirecrawlApp(api_key=api_key)
url = "https://atharvacoe.ac.in/"
scraped_data = app.scrape_url(url)
pprint(scraped_data)
the response i am getting is
PS C:\Users\DHRUV PATEL\Desktop\SCOGO\firecrawl\firecrawl> python test.py
Traceback (most recent call last):
File "C:\Users\DHRUV PATEL\Desktop\SCOGO\firecrawl\firecrawl\test.py", line 32, in <module>
scraped_data = app.scrape_url(url)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\DHRUV PATEL.conda\envs\firecrawl\Lib\site-packages\firecrawl\firecrawl.py", line 91, in scrape_url
self._handle_error(response, 'scrape URL')
File "C:\Users\DHRUV PATEL.conda\envs\firecrawl\Lib\site-packages\firecrawl\firecrawl.py", line 317, in _handle_error
raise requests.exceptions.HTTPError(message, response=response)
requests.exceptions.HTTPError: Payment Required: Failed to scrape URL. Insufficient credits
even though i have 498 credits left
api_key = os.environ["FIRECRAWL_API_KEY"]
app = FirecrawlApp(api_key=api_key)
url = "https://atharvacoe.ac.in/"
scraped_data = app.scrape_url(url)
pprint(scraped_data)
the response i am getting is
PS C:\Users\DHRUV PATEL\Desktop\SCOGO\firecrawl\firecrawl> python test.py
Traceback (most recent call last):
File "C:\Users\DHRUV PATEL\Desktop\SCOGO\firecrawl\firecrawl\test.py", line 32, in <module>
scraped_data = app.scrape_url(url)
^^^^^^^^^^^^^^^^^^^
File "C:\Users\DHRUV PATEL.conda\envs\firecrawl\Lib\site-packages\firecrawl\firecrawl.py", line 91, in scrape_url
self._handle_error(response, 'scrape URL')
File "C:\Users\DHRUV PATEL.conda\envs\firecrawl\Lib\site-packages\firecrawl\firecrawl.py", line 317, in _handle_error
raise requests.exceptions.HTTPError(message, response=response)
requests.exceptions.HTTPError: Payment Required: Failed to scrape URL. Insufficient credits
even though i have 498 credits left
