Firecrawl•16mo ago

Not showing crawled Title

https://github.com/langgenius/dify/issues/5404 Hello firecrawl dev team. I am pinkbanana from Dify.AI, recently we have integrated this awesome tool in our product. And we noticed that somehow the title is missing in the crawled data. I have also check the logs from the firecrawl.dev activity panel. See the metadata in the logs.

"metadata": {
    "sitemap": {
        "lastmod": "2022-10-04"
    },
    "sourceURL": "some url",
    "pageStatusCode": 200,
    "ogLocaleAlternate": []
}

"metadata": {
    "sitemap": {
        "lastmod": "2022-10-04"
    },
    "sourceURL": "some url",
    "pageStatusCode": 200,
    "ogLocaleAlternate": []
}

GitHub

Not showing crawled Title in datasets · Issue #5404 · langgenius/di...

Self Checks This is only for bug report, if you would like to ask a question, please head to Discussions. I have searched for existing issues search for existing issues, including closed ones. I co...

2 Replies

Adobe.Flash•16mo ago

Hey @pinkbanana🍌 , thanks for letting us know. Looking into it rnow. @pinkbanana🍌 it was indeed something in our end, just pushed a fix and it should be returning all the metadata now including the title. Will let Andy know in the issue. Thanks again for reaching out here!

pinkbanana🍌OP•16mo ago

Thanks for you quick response and quick fix 🙂

Gaming

Programming

Not showing crawled Title

Did you find this page helpful?