https://blog.cloudflare.com/running-serverless-puppeteer-workers-durable-objects/

The Cloudflare Blog

Running Serverless Puppeteer with Workers and Durable Objects

We’ve heard from developers that configuring and maintaining their own serverless browser automation systems can be quite painful. The Workers Browser Rendering API solves this

Ttanushree │ Workers PM https://blog.cloudflare.com/running-serverless-puppeteer-workers-durable-objects...

Advany•9/28/23, 2:20 PM

Cool. Saw that my do was used in the post

Ttanushree │ Workers PM https://blog.cloudflare.com/running-serverless-puppeteer-workers-durable-objects...

Unsmart•9/28/23, 2:45 PM

Is the concurrent session pricing based on the peak concurrency during the month or do you have to pre-pay a set concurrency limit (and can you set a concurrency limit if it’s the first option?)

Mackenly•9/28/23, 5:06 PM

And is that $1 each time you spawn a concurrent session or is that per month based on peak?

Mackenly•9/28/23, 6:08 PM

Wouldn't it be more cost effective to just keep a DO with a session alive perpetually? It costs just over $4 to keep a DO alive all month. If you use browser rendering just twice a day you're at $6/m (60*$0.10) in session costs. Setup a queue to process requests handled by that single DO and you never have to worry about having more than one session for an entrire month, correct?

Advany•9/28/23, 6:37 PM

I also dont get the pricing. Would be great to get insights

Hhannes Same question about 10cent session price.. is this per spawned session? How does...

Unsmart•9/28/23, 6:56 PM

The per session would be every time you call puppeteer.launch()puppeteer.launch(). You can reuse the session as explained with DOs in the blogpost which would make it where you can pay per minute with only the initial request warming up the DO costing or anytime the DO gets reset (should mostly code updates / runtime updates)

Advany•9/28/23, 7:07 PM

So then keeping do alive would be cheaper right?

Unsmart•9/28/23, 7:11 PM

depends on your usage levels

DanTheGoodman•9/29/23, 2:13 PM

Does puppeteer stealth work? (ping plz)

Sam•9/29/23, 3:43 PM

Hello. I'd like to get access to the browser rendering api. Account: 1448756027c02d2cb72a056a23538f40

Sam•9/29/23, 3:43 PM

Thank you

Hhannes It's still weird.. does that mean I only pay 10 cents + DO cost for a day (ca. 4...

Mackenly•9/29/23, 5:40 PM

From my understanding it would just be $0.10 every time the DO and browser session is instantiated as long as it's kept alive, so not even every day, as long as the browser instance gets a command at least every 60 seconds. If this is as it seems the pricing really doesn't make sense. Either there's an undocumented time limit on session time or the session pricing should be much lower to incentivize users to create new sessions rather than keep one open. Paying $0.10 once feels like a loophole.

If the best practice is to leave a session open, that should definitely be communicated in the pricing/docs since without considering using a DO, the pricing seems super high (who could justify $0.10 to take a screenshot when you can do the same thing with puppeteer on GCP functions or AWS for much much less).

Unsmart•9/29/23, 8:21 PM

requests != sessions

Unsmart•9/29/23, 8:23 PM

but also 50 sessions would only be $5

captain•9/30/23, 5:09 PM

hey guy's made the request to get into this a while back...i even run a server using pupperteer as part of a workflow process...would love to start playing with this...been developing in workers for 2 years...any updates now that its in beta in getting access to this?

DanTheGoodman•10/6/23, 4:27 PM

How does the concurrent session pricing work? Do I pay $1 to have the ability to run 2 sessions concurrently per month? (se then I can pay $5 for a concurrency of 6) Or is it $1 instead of $0.1 if there is already a session working? The blog post wasn't clear on that.

Aaron Peters•10/9/23, 11:57 AM

The pricing is confusing to me too.
What do I pay if I have one browser instance running all the time and it's constantly doing work (e.g. take screenshot of a page, one after the other .. all the time)
As I read it, that is one browser instance and one (concurrent) session, so the costs are 0 as the Workers paid subscription includes 500 Sessions and 10 Concurrent Sessions. Is this a correct understanding?

phillip•10/14/23, 4:56 PM

Hello, looking for access to the Browser Rendering API. Thanks

Pphillip Hello, looking for access to the Browser Rendering API. Thanks 🙂

zegevlier•10/14/23, 5:41 PM

Post your account ID in here browser-rendering-apiBrowser Rendering API Beta Access

vassbence•10/15/23, 10:10 AM

Hi! Would love start using this API!

4dc10b1f5e6ded482cc85051fbdf49c9

vassbence•10/15/23, 10:11 AM

And so the recommended way to use this service is to keep browsers alive as much as possible with Durable Objects?

Vvassbence Hi! Would love start using this API! 4dc10b1f5e6ded482cc85051fbdf49c9

zegevlier•10/15/23, 10:11 AM

Look one message above yours

vassbence•10/15/23, 10:12 AM

My bad! Posted in the correct thread. My question still stands

vassbence•10/15/23, 10:13 AM

Also, would love to know how one should handle large amounts of traffic, what would be the easiest way to build a queue

Vvassbence And so the recommended way to use this service is to keep browsers alive as much...

zegevlier•10/15/23, 10:14 AM

AFAIK yes, how the pricing works exactly is still a bit unclear, but it seems like there is little harm in keeping sessions open as long as possible to re-use them.

Vvassbence Also, would love to know how one should handle large amounts of traffic, what wo...

zegevlier•10/15/23, 10:14 AM

Probably #queues-beta

vassbence•10/15/23, 10:14 AM

Let's say I'm generating PDF of tickets, and an event goes live, 10k people purchase a ticket. I put each ticketId in the queue which gets consumed by a worker which is calling this API via a DO

vassbence•10/15/23, 10:14 AM

but that means there is literally 1 consumer for the queue running 1 request / sec (or worse if it takes longer)

vassbence•10/15/23, 10:15 AM

Which would be really bad

vassbence•10/15/23, 10:15 AM

Or I can actually fan out the work to multiple browsers, it's jut that it's going to cost a lot more?

Vvassbence Or I can actually fan out the work to multiple browsers, it's jut that it's goin...

zegevlier•10/15/23, 10:18 AM

You can absolutely do that: Keep in mind that the current limits for the beta only allow 2 concurrent browsers (https://developers.cloudflare.com/browser-rendering/platform/limits/), and the current pricing (from https://blog.cloudflare.com/running-serverless-puppeteer-workers-durable-objects/) means that fanning out will increase the cost by quite a lot.

vassbence•10/15/23, 10:19 AM

Yeah... so to keep using Cloudflare workers i'd need to write logic to fan out to a minimal amount of browsers but keep them 100% working all the time

vassbence•10/15/23, 10:20 AM

AWS Lambda is just a better solution for this currently, at least for my use case, as each lambda can start their own puppeteer, i can easily call 10k lambdas and the pricing is a lot better.

vassbence•10/16/23, 5:04 PM

Is the API supposed to work in localhost?

vassbence•10/16/23, 5:05 PM

Chao•10/16/23, 6:51 PM

how much durable object storage does a browser object take up? Say for a browser without any pages opened?

Tom•10/19/23, 1:16 PM

Hello all - how can I get access to the beta? I'm looking to replace prerender.io in our stack, and would love to use Browser Rendering API. We already love using pages, workers and the new Workers AI too

TTom 👋 Hello all - how can I get access to the beta? I'm looking to replace prerende...

zegevlier•10/19/23, 1:16 PM

Put your account ID here browser-rendering-apiBrowser Rendering API Beta Access

Zzegevlier Put your account ID here https://discord.com/channels/595317990191398933/1112675...

Tom•10/19/23, 1:20 PM

Will do, thanks!

Tom•10/19/23, 2:00 PM

fyi - The docs here (https://developers.cloudflare.com/browser-rendering/platform/wrangler/#bindings) mention

node_compat

node_compat

but in the getting started example (https://developers.cloudflare.com/browser-rendering/get-started/screenshots/#4-configure-wranglertoml) its compatibility_flags = [ "nodejs_compat" ]compatibility_flags = [ "nodejs_compat" ]

Ashley•10/20/23, 11:48 AM

how long does it take to spin up a new browser instance? I am running this code:

    const browser = await puppeteer.launch(env.BROWSER);
    const page = await browser.newPage();

    const [res] = await Promise.all([
        page.waitForResponse(res => res.url().includes('something') && res.request().method().toUpperCase() !== "OPTIONS", {timeout: 10 * 1000}),
        page.goto('https://someurl.com', {waitUntil: "domcontentloaded"}),
    ]);

    const browser = await puppeteer.launch(env.BROWSER);
    const page = await browser.newPage();

    const [res] = await Promise.all([
        page.waitForResponse(res => res.url().includes('something') && res.request().method().toUpperCase() !== "OPTIONS", {timeout: 10 * 1000}),
        page.goto('https://someurl.com', {waitUntil: "domcontentloaded"}),
    ]);

And locally, on my Mac, it takes 2-3 seconds in total. In Cloudflare however, it seems to be taking a lot longer perhaps? I don't really know, but it's getting exceeded resources and the log tail says CPU exceeded. It says for CPU, but again, I can't see how one request like this would use so much CPU... it's listed as using 75ms of CPU time, so I'm just really confused!

Ashley•10/20/23, 12:16 PM

This makes it even more confusing

Varying CPU times, some exceeded, some not

Kuririn•10/20/23, 4:21 PM

How can I check if I have access to the beta?

Kuririn•10/20/23, 4:22 PM

I filled out the form a few weeks ago.

const browser = await puppeteer.launch(env.BROWSER); const page = await browser.newPage(); const [res] = await Promise.all([ page.waitForResponse(res => res.url().includes('something') && res.request().method().toUpperCase() !== "OPTIONS", {timeout: 10 * 1000}), page.goto('https://someurl.com', {waitUntil: "domcontentloaded"}), ]);

https://blog.cloudflare.com/running-serverless-puppeteer-workers-durable-objects/

Similar Threads

Similar Threads

Similar Threads