Firecrawl•13mo ago

Javascript doesn't load

Hello, I'm not sure why but when I'm trying to scrape the following URL: https://www.4tharq.com/cart/48712001913165:1,48687198339405:1?checkout[email]=julie@smith.com&checkout[shipping_address][first_name]=Julie&checkout[shipping_address][last_name]=Smith&checkout[shipping_address][address1]=16%20Clare%20Street&checkout[shipping_address][city]=Dublin%202&checkout[shipping_address][zip]=D02TY72&checkout[shipping_address][country]=Ireland&checkout[shipping_address][province]=Dublin It doesn't fill the form and then loads some javascript that should be loaded, could anyone help me please? I'm trying to extract shipping price

10 Replies

YoanGOP•13mo ago

Expected page

YoanGOP•13mo ago

Page scraped with Firecrawl (not all products are loaded either) with 15000 ms of wait time

Adobe.Flash•12mo ago

Hey @YoanG , ccing @thomas here to help you!

YoanGOP•12mo ago

Thanks, feel free to ask if you have any questions about my issue

thomas•12mo ago

hey, will check later today and lyk @YoanG sorry for that, it should work now. Lmk if you face any trouble

YoanGOP•12mo ago

Thanks, I’ll test it in a few minutes I seem to have the results as before, not sure why Here is my current code:

url: str = "https://www.4tharq.com/cart/48712001913165:1,48687198339405:1?checkout[email]=julie@smith.com&checkout[shipping_address][first_name]=Julie&checkout[shipping_address][last_name]=Smith&checkout[shipping_address][address1]=16%20Clare%20Street&checkout[shipping_address][city]=Dublin%202&checkout[shipping_address][zip]=D02TY72&checkout[shipping_address][country]=Ireland&checkout[shipping_address][province]=Dublin"

result = app.scrape_url(
    url=url, 
    params={
        'formats': ['markdown', "html"],
        "actions": [
            {"type": "wait", "milliseconds": 15000},
            {"type": "screenshot"},
        ],
    }
)

url: str = "https://www.4tharq.com/cart/48712001913165:1,48687198339405:1?checkout[email]=julie@smith.com&checkout[shipping_address][first_name]=Julie&checkout[shipping_address][last_name]=Smith&checkout[shipping_address][address1]=16%20Clare%20Street&checkout[shipping_address][city]=Dublin%202&checkout[shipping_address][zip]=D02TY72&checkout[shipping_address][country]=Ireland&checkout[shipping_address][province]=Dublin"

result = app.scrape_url(
    url=url, 
    params={
        'formats': ['markdown', "html"],
        "actions": [
            {"type": "wait", "milliseconds": 15000},
            {"type": "screenshot"},
        ],
    }
)

YoanGOP•12mo ago

Result: https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-a4b3c486-8aca-4b97-8a9a-87b078fda8bd.png

YoanGOP•12mo ago

Have you seen my messages? @thomas

thomas•12mo ago

Hey, yes sorry for the delay. There is some bug with the way we do url parsing, made a ticket, will have it resolved soon sorry for the trouble.

Gaming

Programming

Javascript doesn't load

Did you find this page helpful?