Hi everyone, I'm new to this Discord, so I’m not sure if this is the right place to ask. I’ve built

Hi everyone,
I'm new to this Discord, so I’m not sure if this is the right place to ask.

I’ve built a TypeScript worker that scrapes GPU prices hourly from multiple retailers using cheerio and stores the data for historical tracking. However, it's making too many subrequests—navigating from an index page to each product page is hitting Cloudflare CPU limits.

I tried using queues but I'm unsure how to implement them effectively. Does anyone have advice on managing this more efficiently?

SSCALEXO Hi everyone, I'm new to this Discord, so I’m not sure if this is the right place...

Ashley•3/22/25, 12:22 PM

Queues will work, but I’d personally use Workflows (in beta, as a note): https://developers.cloudflare.com/workflows/

you can presumably have a workflow per retailer or product or w/e and just kick off the Workflows from a Worker Cron or something

Cloudflare Docs

Overview · Cloudflare Workflows docs

Workflows is a durable execution engine built on Cloudflare Workers. Workflows allow you to build multi-step applications that can automatically retry, persist state and run for minutes, hours, days, or weeks. Workflows introduces a programming model that makes it easier to build reliable, long-running tasks, observe as they progress, and progra...

AAshley Queues will work, but I’d personally use Workflows (in beta, as a note): https:/...

SCALEXOOP•3/22/25, 12:24 PM

Thanks, i will look into this!

Miguel•3/22/25, 1:47 PM

Hello, Im working on a minimal astro landing page, however I need to index a second page which needs to install

npm install react-datepicker

npm install react-datepicker

, if my main/landing page is already deployed to cloudflare pages, how might install

react-datapicker

react-datapicker

? is it through command line? any advise is welcome...

ella•3/23/25, 8:50 AM

is there anyway to have a custom install command on cf workers?

rikka0w0•3/23/25, 8:56 AM

When I start a POST request from my local machine to a Cloudflare network, Cloudflare will not send the POST to my backend until it receives the entire POST body. Is there a way to change this behavior? I would like to have my local machine stream to my backend.

SuperHelpflare•3/23/25, 8:58 AM

Please do not post your question in multiple channels/post it multiple times per the rules at #

welcome-and-rules. It creates confusion for people trying to help you and doesn't get your issue or question solved any faster.

jpony•3/23/25, 6:43 PM

One of our links
/scripts has incorrectly been flagged as phishing and I’m not sure how to appeal it? We are loading data from our users stored in cloud flare so I’m not sure what could have triggered it

jpony•3/23/25, 6:44 PM

There’s no warnings on the dashboard itself, but when you click the link there’s a warning

Jjpony There’s no warnings on the dashboard itself, but when you click the link there’s...

Isaac McFadyen•3/23/25, 6:45 PM

Is the warning from a browser (e.g. Chrome) or is it a Cloudflare page?

jpony•3/23/25, 6:45 PM

Cloud flare

jpony•3/23/25, 6:45 PM

It could be that a new worker suddenly got a lot of traffic?

jpony•3/23/25, 6:46 PM

Do I just reply to abusereply@cloudflare.com ?

Jjpony Do I just reply to abusereply@cloudflare.com ?

Isaac McFadyen•3/23/25, 6:46 PM

Did you get an email from them?

Isaac McFadyen•3/23/25, 6:46 PM

If so then yes.

JJin Taejin I'm trying to test a worker with service bindings using vitest for simple integr...

brandonpsmith•3/23/25, 9:30 PM

@Jin Taejin did you figure this out? i'm having the same problem.

brandonpsmith•3/23/25, 9:31 PM

bumping this for some help please ... workers-and-pages-discussions

brandonpsmith•3/23/25, 10:09 PM

context here

if i remove my service bindings and run

wrangler types

wrangler types

the tests run. here's my vitest config

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config";
import { mergeConfig } from "vitest/config";
import { baseConfig } from "./base.js";

export const workerConfig = mergeConfig(
  baseConfig,
  defineWorkersConfig({
    test: {
      poolOptions: {
        workers: {
          wrangler: { configPath: "./wrangler.jsonc" },
        },
      },
    },
  }),
);

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config";
import { mergeConfig } from "vitest/config";
import { baseConfig } from "./base.js";

export const workerConfig = mergeConfig(
  baseConfig,
  defineWorkersConfig({
    test: {
      poolOptions: {
        workers: {
          wrangler: { configPath: "./wrangler.jsonc" },
        },
      },
    },
  }),
);

ceezy•3/24/25, 2:50 AM

Is it possible source map an exception stack trace from a tail worker when the exception is not an unhandled exception? We have use cases where we need to handle exceptions from the perspective of the originating worker (these are batch requests and so we can't fail them), but we log them to a tail worker via a diagnostic channel. I'd love to be able to perform source mapping on those stack traces.

Wang•3/24/25, 2:59 AM

Hello everyone, I recently built a web page generation service using Cloudflare Agents, which supports online editing. I'd like to share it .

project url: https://github.com/mggger/WebCraft

GitHub

GitHub - mggger/WebCraft: Web builder AI-Agent

Web builder AI-Agent . Contribute to mggger/WebCraft development by creating an account on GitHub.

WWang Hello everyone, I recently built a web page generation service using Cloudflare ...

Cyb3r-Jak3•3/24/25, 3:36 AM

You should post this in #what-i-built

Kevin•3/24/25, 6:29 AM

hey wondering if anyone's solved the network connection lost error whenever reading from an server sent event stream on a subrequest. I have a way to reproduce the error, and it is very frustrating because cloudflare doesn't document this behavior anywhere about subrequests workers-and-pages-help"Error: Network connection lost." on SSE subrequest idling for 100 seconds between events

Kevin•3/24/25, 6:30 AM

why does it just time out a sub request if SSE events get sent for 100 seconds?

confused mf•3/24/25, 12:19 PM

Cloudflare with supabase integration is broken, I get a 400 error when I try oauth

21givenchy•3/24/25, 1:16 PM

can someone assist me with the edge runtime do I specify it in everypage on nextjs

21givenchy•3/24/25, 1:24 PM

on existing projects

Rahul gangotri•3/24/25, 6:47 PM

Can someone please help me on this

No one replied till now, i am stuck

workers-and-pages-helpWorker route not working

Silvan•3/24/25, 8:23 PM

uhm is it normal that .dev.vars are inside your server bundle? :AL_yEthinkHmm:

SSilvan uhm is it normal that .dev.vars are inside your server bundle? :AL_yEthinkHmm:

Hard@Work•3/24/25, 8:59 PM

What framework is that?

HHard@Work What framework is that?

Silvan•3/24/25, 9:00 PM

well happened to me on svelte worker assets but same happens with https://github.com/cloudflare/agents-starter
if you add a .dev.vars in the root

GitHub

GitHub - cloudflare/agents-starter: A starter kit for building ai a...

A starter kit for building ai agents on Cloudflare - cloudflare/agents-starter

KKevin why does it just time out a sub request if SSE events get sent for 100 seconds?

Kevin•3/24/25, 10:01 PM

any thoughts on sub request just closign networ connection lost after 100 seconds? it doesn't make sense to time this out for a backend request thats making a long running request

Tobias•3/24/25, 11:34 PM

Is there any way I to get custom domains without a zone on cloudflare working on Workers w/ Static Assets? I've only noticed just now and it's too late to go back - impossible to get the domain on Cloudflare.

wot•3/25/25, 12:54 AM

are worker "frameworks" replacing pages?

KKevin any thoughts on sub request just closign networ connection lost after 100 second...

Chaika•3/25/25, 1:31 AM

The Cloudflare wide Proxy Read Timeout is 100 seconds https://developers.cloudflare.com/fundamentals/reference/connection-limits/, if your backend is that slow you'll need to speed it up, have it use a job style where it returns that it's running and to poll for status, etc. For SSE specifically, I haven't tried it but there's a few posts mentioning it kind of works and that 524's only trigger if nothing is sent within 100s

TTobias Is there any way I to get custom domains without a zone on cloudflare working on...

Chaika•3/25/25, 1:33 AM

Not if you have no zones at all. If you have at least one, even just a throwaway/random ones, can use CF For SaaS: https://developers.cloudflare.com/cloudflare-for-platforms/cloudflare-for-saas/start/advanced-settings/worker-as-origin/ and have your real custom domain CNAME to it, which then would run your worker. More meant for full SaaS cases though. It's the same thing Pages uses under the hood

Wwot are worker "frameworks" replacing pages?

Chaika•3/25/25, 1:35 AM

Frameworks is just their list of guides in the docs, "Workers Static Assets" is the underlying replacement, allowing Workers to support static assets just like Pages. CF has said before they plan on offering more migration steps in the future to Workers Static Assets from Pages, but eventually they will converge

TDat•3/25/25, 3:05 AM

Unable to preview your Worker

matt•3/25/25, 4:00 AM

if a worker connects to a cloudflare tunnel endpoint, and there's a WAF rule to block any non-worker traffic, eg.

BLOCK cf.worker.upstream_zone != "my.domain"

BLOCK cf.worker.upstream_zone != "my.domain"

how much latency should both the WAF rule & cloudflare tunnel be adding?

Chaika•3/25/25, 4:29 AM

waf should be too small to measure, tunnel is more complex. I'd make sure you're connecting to a nearby PoP ( example.com/cdn-cgi/traceexample.com/cdn-cgi/trace on your tunnel hostname) and in your tunnel logs, that your tunnel is connecting to a nearby location as well, not too related to Workers though

masd4•3/25/25, 5:14 AM

if the worker memory limit is 128mb, wouldn't I run into that if I use the kv store .list() operation and retrieve 1280 keyvalue items with a size of 100kb? I mean those string values get loaded into memory if I .get() them all one by one in a for loop? I guess the GC would be able to start running if that's how it works in a loop with a memory limit set.

CChaika Not if you have no zones at all. If you have at least one, even just a throwaway...

Tobias•3/25/25, 10:23 AM

thanks so much! this worked well

lisekilis•3/25/25, 12:04 PM

lil help please?
https://canary.discord.com/channels/595317990191398933/1354022352987619349

Justin Schroeder•3/25/25, 3:53 PM

Cloudflare Team: Does this https://discord.com/channels/595317990191398933/1040420029080018945/1354117859671805964 announcement mean that ctx.waitUntil()ctx.waitUntil() can have a longer execution time too. Its been 30s of wall-clock duration, and I could really use an increase time limit there.

Hi everyone, I'm new to this Discord, so I’m not sure if this is the right place to ask. I’ve built

Similar Threads