Could AI workers crawl urls ?

Pretty much the title sums it up.
I am looking to build a small app where I feed it different urls from blog posts and I would like it to summarise them for me. Would that be possible?

Gab•10/12/25, 4:31 AM

Totally,

You can use a puppeteer to crawl the websites data, and cloudflare AI to resume them

Since cloudflare workers runs on isolated v8, you cannot access direct browser, instead, you gonna need to use cloudflare browsers, which provides you a headless browser for you puppeteer

Also, you gonna have to use a custom version of puppeteer,
cloudflare/puppeteer

Heres a example code snippet, that scrapes y combinator hacker news with puppeteer and browser, an resume them to send to email with cloidflare email redirect

-> https://github.com/elizabethsiegle/hackernews-top10-workersai-browserrendering-email/blob/main/src/index.ts

GitHub

hackernews-top10-workersai-browserrendering-email/src/index.ts at m...

This Cloudflare Worker emails me an analysis/summary of the top 10 Hacker News stories every hour using Cloudflare Email, Workers AI, AI Gateway, and Browser Rendering. On this page, you can select...

vshaddixOP•10/15/25, 7:23 AM

thank you!

Could AI workers crawl urls ?

Similar Threads

Similar Threads

Similar Threads