Firecrawl•11mo ago

Instant "Request timed out"

I just signed up, generated a key, tested my query in the playground and it works, but when trying to call via cURL or Postman, I get an instant 408 "Request timed out" response. If I intentionally mangle the post body, then it does return response about the malformed body, or invalid parameters. I've tried from multiple connections (via vpn and without). I also tried with extract: { "prompt": "<same as below>"} but it also returns instant 408. I've also tried simplifying it to just "extract the pricing table", just to ensure it wasn't some messed up escaped character error. Below is the cURL. I'm just trying to extract the pricing chart on Groq.

curl --location 'https://api.firecrawl.dev/v1/scrape' \
--header 'Content-Type: application/json' \
--header 'User-Agent: POSTMAN' \
--header 'Authorization: Bearer fc-XXXXXXX' \
--data '{
  "url": "https://groq.com/pricing/",
  "formats": [
    "extract"
  ],
  "onlyMainContent": true,
  "includeTags": [
    ".pricingtable"
  ],
  "excludeTags": [
    "metadata"
  ],
  "headers": {},
  "waitFor": 123,
  "mobile": true,
  "skipTlsVerification": true,
  "timeout": 123,
  "extract": {
    "schema": {
        "ai_model": "string",
        "current_speed": "integer",
        "input_token_price": "float",
        "input_token_price_tokens_per_dollar": "float",
        "output_token_price": "float",
        "output_token_price_tokens_per_dollar": "float"
    },
    "systemPrompt": "",
    "prompt": "please extract the pricing table for models on groq on the provided url. Please normalize data, removing currency notation, '\''per X` notation such as '\''/$1'\''. So '\''(25M / $1)*'\'' value in input_token_price_tokens_per_dollar should just become 25000000. '\''$0.04'\'' should become '\''0.04'\''. "
  },
  "actions": [],
  "location": {
    "country": "US",
    "languages": [
      "en-US"
    ]
  },
  "removeBase64Images": true
}'

curl --location 'https://api.firecrawl.dev/v1/scrape' \
--header 'Content-Type: application/json' \
--header 'User-Agent: POSTMAN' \
--header 'Authorization: Bearer fc-XXXXXXX' \
--data '{
  "url": "https://groq.com/pricing/",
  "formats": [
    "extract"
  ],
  "onlyMainContent": true,
  "includeTags": [
    ".pricingtable"
  ],
  "excludeTags": [
    "metadata"
  ],
  "headers": {},
  "waitFor": 123,
  "mobile": true,
  "skipTlsVerification": true,
  "timeout": 123,
  "extract": {
    "schema": {
        "ai_model": "string",
        "current_speed": "integer",
        "input_token_price": "float",
        "input_token_price_tokens_per_dollar": "float",
        "output_token_price": "float",
        "output_token_price_tokens_per_dollar": "float"
    },
    "systemPrompt": "",
    "prompt": "please extract the pricing table for models on groq on the provided url. Please normalize data, removing currency notation, '\''per X` notation such as '\''/$1'\''. So '\''(25M / $1)*'\'' value in input_token_price_tokens_per_dollar should just become 25000000. '\''$0.04'\'' should become '\''0.04'\''. "
  },
  "actions": [],
  "location": {
    "country": "US",
    "languages": [
      "en-US"
    ]
  },
  "removeBase64Images": true
}'

2 Replies

mogery•11mo ago

You set timeout to 123 that's in milliseconds

tl_mondoOP•11mo ago

🤦‍♀️ I didn't even notice that field. Must have been what was in the example payload that I copied and modified. That explains it.

Gaming

Programming

Instant "Request timed out"

Did you find this page helpful?