Mohit - I am running firecrawl locally, with sc...

G

Gaurav Chadha•10/29/25, 6:10 PM

Hi @Mohit, change tracking is not currently supported in self-hosted instances because it requires the indexing/caching infrastructure that depends on Supabase.

Can you try setting up these in your env explicitly and then try again?

INDEX_SUPABASE_URL
INDEX_SUPABASE_SERVICE_TOKEN

INDEX_SUPABASE_URL
INDEX_SUPABASE_SERVICE_TOKEN

INDEX_SUPABASE_URL
INDEX_SUPABASE_SERVICE_TOKEN

INDEX_SUPABASE_URL
INDEX_SUPABASE_SERVICE_TOKEN

M

MohitOP•10/30/25, 9:03 AM

it doesn't work

M

MohitOP•10/30/25, 10:15 AM

what about summary for

/scrape

/scrape

/scrape

/scrape endpoint, I have added OPENAI_API_KEY= in env
I have this in my body

{
    "url": "https://example.com",
    "formats": ["markdown", "summary"]
}

{
    "url": "https://example.com",
    "formats": ["markdown", "summary"]
}

{
    "url": "https://example.com",
    "formats": ["markdown", "summary"]
}

{
    "url": "https://example.com",
    "formats": ["markdown", "summary"]
}

but in response I am getting error

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

MMohit what about **summary ** for `/scrape` endpoint, I have added OPENAI_API_KEY= in ...

G

Gaurav Chadha•10/30/25, 11:15 AM

Summary should work, please verify you're OpenAI API key or re-create it.

MMohit it doesn't work

G

Gaurav Chadha•10/30/25, 11:16 AM

changeTracking is only supported in cloud version

GGaurav Chadha changeTracking is only supported in cloud version

M

MohitOP•10/30/25, 11:40 AM

yes I found out through official docs

M

MohitOP•10/30/25, 11:41 AM

we only need

OPENAI_API_KEY

OPENAI_API_KEY

OPENAI_API_KEY

OPENAI_API_KEY key right?

M

MohitOP•10/30/25, 11:42 AM

because I have added it in my .env

OPENAI_API_KEY=sk-proj-...

OPENAI_API_KEY=sk-proj-...

OPENAI_API_KEY=sk-proj-...

OPENAI_API_KEY=sk-proj-...

M

MohitOP•10/30/25, 11:47 AM

I have rebuild the docker using

docker compose build

docker compose build

docker compose build

docker compose build after adding .env and started again

docker compose up

docker compose up

MMohit because I have added it in my .env `OPENAI_API_KEY=sk-proj-...`

G

Gaurav Chadha•10/30/25, 11:53 AM

you need to set

OPENAI_BASE_URL=https://api.openai.com/v1

OPENAI_BASE_URL=https://api.openai.com/v1

OPENAI_BASE_URL=https://api.openai.com/v1

OPENAI_BASE_URL=https://api.openai.com/v1 as well.

G

Gaurav Chadha•10/30/25, 11:57 AM

@Mohit you can try it out and lmk if this resolves, the issue.

M

MohitOP•10/30/25, 12:05 PM

I have base url as well

M

MohitOP•10/30/25, 12:05 PM

but let me rebuild and try again

M

MohitOP•10/30/25, 12:06 PM

we don't need MODEL_NAME right?

MMohit we don't need MODEL_NAME right?

G

Gaurav Chadha•10/30/25, 12:14 PM

it will be required based on the model you've enabled from your OpenAI dashbaord set

MODEL_NAME=gpt-4o-mini

MODEL_NAME=gpt-4o-mini

MODEL_NAME=gpt-4o-mini

MODEL_NAME=gpt-4o-mini

M

MohitOP•10/30/25, 12:16 PM

ok, is it like that

M

MohitOP•10/30/25, 12:16 PM

let confirm and check again

M

MohitOP•10/30/25, 12:31 PM

it's not working

G

Gaurav Chadha•10/30/25, 12:36 PM

What's the error?

M

MohitOP•10/30/25, 12:39 PM

same error

M

MohitOP•10/30/25, 12:39 PM

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

{
    "success": false,
    "code": "UNKNOWN_ERROR",
    "error": "(Internal server error) - Failed to parse URL from /chat/completions"
}

M

MohitOP•10/30/25, 12:41 PM

docker logs

error [:scrapeController]: Error in scrapeController {"method":"scrapeController","jobId":"47964a19-f354-4387-a435-77fbb9a0da24","scrapeId":"47964a19-f354-4387-a435-77fbb9a0da24","teamId":"bypass","team_id":"bypass","version":"v2","error":{"code":"UNKNOWN_ERROR","name":"Error","message":"(Internal server error) - Failed to parse URL from /chat/completions","stack":"TypeError: Failed to parse URL from /chat/completions\n    at node:internal/deps/undici/undici:14900:13\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async postToApi (/app/node_modules/.pnpm/@ai-sdk+provider-utils@2.2.7_zod@3.24.2/node_modules/@ai-sdk/provider-utils/dist/index.js:627:22)"},"trace_id":"f30d7608b5763956f9a6d17fc59d8912","span_id":"3eab148e9ef1b88d","trace_flags":"01"}

error [:scrapeController]: Error in scrapeController {"method":"scrapeController","jobId":"47964a19-f354-4387-a435-77fbb9a0da24","scrapeId":"47964a19-f354-4387-a435-77fbb9a0da24","teamId":"bypass","team_id":"bypass","version":"v2","error":{"code":"UNKNOWN_ERROR","name":"Error","message":"(Internal server error) - Failed to parse URL from /chat/completions","stack":"TypeError: Failed to parse URL from /chat/completions\n    at node:internal/deps/undici/undici:14900:13\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async postToApi (/app/node_modules/.pnpm/@ai-sdk+provider-utils@2.2.7_zod@3.24.2/node_modules/@ai-sdk/provider-utils/dist/index.js:627:22)"},"trace_id":"f30d7608b5763956f9a6d17fc59d8912","span_id":"3eab148e9ef1b88d","trace_flags":"01"}

error [:scrapeController]: Error in scrapeController {"method":"scrapeController","jobId":"47964a19-f354-4387-a435-77fbb9a0da24","scrapeId":"47964a19-f354-4387-a435-77fbb9a0da24","teamId":"bypass","team_id":"bypass","version":"v2","error":{"code":"UNKNOWN_ERROR","name":"Error","message":"(Internal server error) - Failed to parse URL from /chat/completions","stack":"TypeError: Failed to parse URL from /chat/completions\n    at node:internal/deps/undici/undici:14900:13\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async postToApi (/app/node_modules/.pnpm/@ai-sdk+provider-utils@2.2.7_zod@3.24.2/node_modules/@ai-sdk/provider-utils/dist/index.js:627:22)"},"trace_id":"f30d7608b5763956f9a6d17fc59d8912","span_id":"3eab148e9ef1b88d","trace_flags":"01"}

error [:scrapeController]: Error in scrapeController {"method":"scrapeController","jobId":"47964a19-f354-4387-a435-77fbb9a0da24","scrapeId":"47964a19-f354-4387-a435-77fbb9a0da24","teamId":"bypass","team_id":"bypass","version":"v2","error":{"code":"UNKNOWN_ERROR","name":"Error","message":"(Internal server error) - Failed to parse URL from /chat/completions","stack":"TypeError: Failed to parse URL from /chat/completions\n    at node:internal/deps/undici/undici:14900:13\n    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)\n    at async postToApi (/app/node_modules/.pnpm/@ai-sdk+provider-utils@2.2.7_zod@3.24.2/node_modules/@ai-sdk/provider-utils/dist/index.js:627:22)"},"trace_id":"f30d7608b5763956f9a6d17fc59d8912","span_id":"3eab148e9ef1b88d","trace_flags":"01"}

env

OPENAI_API_KEY=sk-proj-
OPENAI_BASE_URL=https://api.openai.com/v1
MODEL_NAME=gpt-4.1

OPENAI_API_KEY=sk-proj-
OPENAI_BASE_URL=https://api.openai.com/v1
MODEL_NAME=gpt-4.1

OPENAI_API_KEY=sk-proj-
OPENAI_BASE_URL=https://api.openai.com/v1
MODEL_NAME=gpt-4.1

OPENAI_API_KEY=sk-proj-
OPENAI_BASE_URL=https://api.openai.com/v1
MODEL_NAME=gpt-4.1

G

Gaurav Chadha•10/30/25, 12:56 PM

Does your Docker Compose also have the correct config?
OPENAI_API_KEY: ${OPENAI_API_KEY}
OPENAI_BASE_URL: ${OPENAI_BASE_URL}
MODEL_NAME: ${MODEL_NAME}

M

MohitOP•10/30/25, 12:57 PM

yes

M

MohitOP•10/30/25, 12:58 PM

but whenever I run

docker compose up

docker compose up

I get this

time="2025-10-30T17:56:55+05:30" level=warning msg="The \"OPENAI_BASE_URL\" variable is not set. Defaulting to a blank string."

time="2025-10-30T17:56:55+05:30" level=warning msg="The \"OPENAI_BASE_URL\" variable is not set. Defaulting to a blank string."

time="2025-10-30T17:56:55+05:30" level=warning msg="The \"OPENAI_BASE_URL\" variable is not set. Defaulting to a blank string."

time="2025-10-30T17:56:55+05:30" level=warning msg="The \"OPENAI_BASE_URL\" variable is not set. Defaulting to a blank string."

even though I have api key in my .env, it is for all the env keys

G

Gaurav Chadha•10/30/25, 1:20 PM

It seems your container is not built successfully after adding the OPENAI_BASE_URL. You need to make sure it's built and that the value is being read from the environment. You can also log the value after rebuilding the container.

M

MohitOP•10/30/25, 1:22 PM

how do I log the value?

G

Gaurav Chadha•11/3/25, 7:24 AM

docker compose exec <service-name> printenv OPENAI_BASE_URL.