i just spent the day patching playwright-core, in a similar way i saw ya'll had done it to make it w
i just spent the day patching playwright-core, in a similar way i saw ya'll had done it to make it work inside the worker runtime 
Rfor the time being it's not possible. We could in theory allow both scenarios, but from my experience, if the browser is not in the same network, we get lots of latency. For instance, a simple 
newPage call triggers 50 CDP calls, and if each takes 50ms, it's a full second just to open a new page 
Dtrue, but also depends on the customer use case whether 1s is acceptable or not. ie if it's an async job running in the background, then 1s doesn't really matter 
DI'm also interested in this!
@Rui Figueira Would you be interested in supporting this?
https://github.com/cloudflare/playwright/pull/59
cc @dandoen
@Rui Figueira Would you be interested in supporting this?
https://github.com/cloudflare/playwright/pull/59
cc @dandoen
GitHub
This adds support for using any ws CDP based server to connect to, without breaking existing usage of the browser rendering api. Example usage with Browserbase:
import { Browserbase } from &#39...
import { Browserbase } from &#39...
D@Kathy curious if ya'll would be interested to make the @Cloudflare/playwright package work also for customers not using the browser rendering API (yet). by supporting this, you'll help me keep an easy migration path (back) to cloudflare
AHi, I found that using the /content endpoint we can not set the returned HTML type. Others like Crawl4ai allow us to set raw, cleaned HTML and markdown. I think CF should implement it.
HIs browser rendering extremely slow for anyone else to bootup/work?
Hseeing extremely slow times.
Kyou're looking for info to be returned in markdown? we have https://developers.cloudflare.com/browser-rendering/rest-api/markdown-endpoint/
Cloudflare Docs
The /markdown endpoint retrieves a webpage's content and converts it into Markdown format. You can specify a URL and optional parameters to refine the extraction process.
AThank you, but I need the other 2 ones: raw HTML for getting invisible metadata and cleaned HTML for visible content. i think both Firecrawl and Crawl4ai features would inspire Browser Rendering PMs and devs a lot.
Pis Browser Rendering down? Been getting 503 error for the last 10 minutes
Kso our /html endpoint returns raw already today. So what we don't yet have for you is
can you explain what you'd like to do with
cleaned html then.can you explain what you'd like to do with
cleaned that raw doesn't do for you?
Hwe ended up moving away
Hused both playwright/puppeeter, don't think it makes any difference.
SCan we have wrapped functions for rest api in worker bindings?
K
is on the listSDoes failed rest api calls (waitForTimeout exceeds) adds to billable browser hours?
SCan we have browser hours used in the response of rest api?
Kgreat idea. adding to the list
Kit does not
SIs the rest api rate limit sliding window or fixed time period? I’m trying to adjust my backend concurrency settings.
SIs it possible to make the /markdown api return both the original html and the extracted markdown? I'm building something that requires verifying results afterwards, which need a "snapshot" of original html dom (like wayback machine).
Kgreat q - will add to docs too
Rate limits are enforced with a fixed per second fill rate. For example, the workers paid limit of 60 requests per minute translates to 1 request per second. This means you cannot send all 60 requests at once; the API expects them to be spread evenly over the minute.
Rate limits are enforced with a fixed per second fill rate. For example, the workers paid limit of 60 requests per minute translates to 1 request per second. This means you cannot send all 60 requests at once; the API expects them to be spread evenly over the minute.
Kwe have a separate /content endpoint for html https://developers.cloudflare.com/browser-rendering/rest-api/content-endpoint/. any reason that doesn't work for you?
Cloudflare Docs
The /content endpoint instructs the browser to navigate to a website and capture the fully rendered HTML of a page, including the head section, after JavaScript execution. This is ideal for capturing content from JavaScript-heavy or interactive websites.
SI don’t want to make 2 request for a single scrape. I’m thinking that for /json or /markdown endpoint, the original content is already available, could have an option to just return both json/markdown and original content.
GHello, is it allowed to scrap for example Instagram for their OG meta properties or does it break the Cloudflare rules?
Ahow does one monitor the usage of the api? I only see how many requests its making to the api but not how much browser hours that consumed?
AI just saw "Currently, the Cloudflare dashboard displays usage metrics exclusively for the Workers Bindings method. Usage data for the REST API is not yet available in the dashboard. We are actively working on adding REST API usage metrics to the dashboard.". How do I monitor my usage somewhere else?
GCan anyone give me an answer to this question please :/
MHi there! Since I'm not getting an answer in the #workers-help thingy, am I in the right place here to report this bug? Or am I doing something wrong?
workers-and-pages-helpFonts look bad in Browser Rendering screenshots
workers-and-pages-helpFonts look bad in Browser Rendering screenshots
GDoes anyone use this api for retrieving the opengraph meta data of a website? Are there any configurations which I have to consider for best practice? Appreciate any help
KDepends on a site but usually you don't need browser rendering to fetch opengraph. Just do simple http call to fetch html.
GInstagram and Tiktok loads the opengraph dynamically
Khmm might be an unsupported font. let me get a list of fonts we currently support. do you know what font it is?
Kwhen using the rest api you can see the browser time used for every request in the
ah i need to update that in the docs. thanks for reminding
X-Browser-Ms-Usedah i need to update that in the docs. thanks for reminding
MOne example is the google font Poppins
Kgot it, yea looks like it's not a supported font right now. would you be able to use one of the ones here instead? https://kathayl-patch-9.preview.developers.cloudflare.com/browser-rendering/reference/supported-fonts/
Cloudflare Docs
Browser Rendering uses a managed Chromium environment that includes a standard set of fonts. When you generate a screenshot or PDF, text is rendered using the fonts available in this environment.
JHey i was trying to use the Rest API enpoint /content to get client side rendered content from Algolias instantsearch. I tried everything but i didn't get any items.
Kwhat url/what was the request? what response did you get?
GHello, I want to generate url previews with opengraph meta tags but is using the browser rendering api the right approach for dynamic websites?
Dso can I say automate some clicks for online courses
Dsomething simple like everytime it autoplays to the next video I need to manually hit fullscreen
Dor is this more a case for workers?
ZBrowser rendering is for running a browser on the server, and from your question it looks like you more want to control a browser running on your own computer? If so, I'd recommend either looking into making a browser extension, or using selenium or puppeteer
II would recommend Selenium or Puppeteer if you're just getting started. They're easier to use.
Kwe've worked on it a bit for REST API! but not working 100% of time yet (still fixing bugs). are you needing it for REST API or workers bindings?
bc if REST API, it might work for you now
bc if REST API, it might work for you now
DAny insights into time out issue: Page.printToPDF timed out. Increase the 'protocolTimeout' setting in launch/connect calls for a higher timeout if needed.
I've set the protocolTimeout to 0 in my config:
const browser = await puppeteer.launch(env.BROWSER,{
headless: 'new',
keep_alive: 600000,
args: [
"--disable-setuid-sandbox",
"--no-sandbox",
"--single-process",
"--no-zygote",
],
protocolTimeout: 0,
});
Any other suggestions for avoiding timeout.
What my app does - I pass it an HTML string, which it renders via page.setContent(html...) then it converts to PDF using page.pdf({...,timeout: 0})
I've set the protocolTimeout to 0 in my config:
const browser = await puppeteer.launch(env.BROWSER,{
headless: 'new',
keep_alive: 600000,
args: [
"--disable-setuid-sandbox",
"--no-sandbox",
"--single-process",
"--no-zygote",
],
protocolTimeout: 0,
});
Any other suggestions for avoiding timeout.
What my app does - I pass it an HTML string, which it renders via page.setContent(html...) then it converts to PDF using page.pdf({...,timeout: 0})
