Crawl job never stopping

so i am trying out firecrawl sdk for the first time as the playground worked very well. Getting confusing results.

1. this code just hangs and never prints the crawl_results:

print("CRAWLING")
crawl_result = app.crawl_url(
    "https://firecrawl.dev",
    limit=100,
    scrape_options=ScrapeOptions(formats=["markdown"]),
    poll_interval=30,
)

print(crawl_result)

print("CRAWLING")
crawl_result = app.crawl_url(
    "https://firecrawl.dev",
    limit=100,
    scrape_options=ScrapeOptions(formats=["markdown"]),
    poll_interval=30,
)

print(crawl_result)

2.
i can see my credits are getting drained though so it is doing something. i do want to cancel the job as it was just a test but i don't have the job id and i don't see a way to cancel anything in the dashboard, nor do i see results even coming through!

Firecrawl•10mo ago•

17 replies

ekeric13

Crawl job never stopping

so i am trying out firecrawl sdk for the first time as the playground worked very well. Getting confusing results.

1. this code just hangs and never prints the crawl_results:

print("CRAWLING")
crawl_result = app.crawl_url(
    "https://firecrawl.dev",
    limit=100,
    scrape_options=ScrapeOptions(formats=["markdown"]),
    poll_interval=30,
)

print(crawl_result)

print("CRAWLING")
crawl_result = app.crawl_url(
    "https://firecrawl.dev",
    limit=100,
    scrape_options=ScrapeOptions(formats=["markdown"]),
    poll_interval=30,
)

print(crawl_result)

Crawl job never stopping

Similar Threads

Crawl job never stopping

Similar Threads

Similar Threads

Similar Threads