408 / 502 ERRORs when scraping particular URLs via code/manually
Hello guys, I have developed a simple script that iterates through sitemap and scrapes each URL individually via the scrape endpoint.
However, some particular URLs just return 408 / 502 errors, when scrape endpoint is called, dunno why - but its not the issue in the code it seems, because even when I try to scrape them manually from the Firecrawl dashboard - nothing happens.
These URLs are in case of this particular client:
"https://icuk.cz/pro-region/projekt-storemore",
"https://icuk.cz/pro-region/rur/",
"https://icuk.cz/pro-region/projekt-integrage/",
"https://icuk.cz/pro-region/projekt-coeus/"
However, some particular URLs just return 408 / 502 errors, when scrape endpoint is called, dunno why - but its not the issue in the code it seems, because even when I try to scrape them manually from the Firecrawl dashboard - nothing happens.
These URLs are in case of this particular client:
"https://icuk.cz/pro-region/projekt-storemore",
"https://icuk.cz/pro-region/rur/",
"https://icuk.cz/pro-region/projekt-integrage/",
"https://icuk.cz/pro-region/projekt-coeus/"
