you cannot bring up a specific use case and then say "oh actually that doesn't apply because I'm tal

you cannot bring up a specific use case and then say "oh actually that doesn't apply because I'm talking about them in general"

options have to be evaluated for specific use cases...

Avi•2/7/25, 12:53 AM

how can I get a request

Context

Context

inside a

DurableObject

DurableObject

Ssathoro you cannot bring up a specific use case and then say "oh actually that doesn't a...

iLearn•2/7/25, 12:54 AM

agree. my mistake. i did-not put-up my complete use-case and just shared a snippet of the use-case for clarification on DO.

FFlikTeoh Actually KV in DO with SQLite is charged based on sql read pricing, if I underst...

1984 Ford Laser•2/7/25, 4:03 AM

huh I just checked the docs and you're correct. This definitely needs extra clarity

IiLearn All points valid. My Qs come from 2 dimensions .. Business + Tech .. From Tech...

森

森@VerseLink (RW)•2/7/25, 5:19 AM

I beg to differ, OTP based authentication allows more flexibility to users using your service and thus remove friction or add value to your service as a whole, it doesn't generate revenue directly, but adds then in a indirect manner, the question is not "if this generates revenue" but "is the cost to add this feature important enough that justifies it's cost to implement".

I would also argue that the dev time taken to develop or maintain this is probably more expensive then KV or DO charges. Do what's easier to maintain and develop for your team.

AAvi how can I get a request [`Context`](https://developers.cloudflare.com/workers/ru...

森

森@VerseLink (RW)•2/7/25, 5:20 AM

this.ctx

this.ctx

it's part of the DurableObject class

FFlikTeoh Actually KV in DO with SQLite is charged based on sql read pricing, if I underst...

iLearn•2/7/25, 11:10 AM

In the approach of taking "KV in DO with SQLite", limitation of storage of 1GB (as of today) and 10GB (in future, when SQLite becomes GA) will be biggest THREAT-to-SCALE.

While, default KV with DO, has "theoretically" NO LIMIT on storage.

There are multiple dimensions [ COST-to-develop, COST-to-run, COST-to-manage, SCALE-for-PLANET-EARTH (coincidentally, Cloudlare also shares same vision of Planet Earth) ], which a tech-architect-cum-business-leader, need to constantly think.

Basis my preliminary study and information shared by generous insights from tech-leaders in this community, DO has following positioning (my take) :
COST-to-develop : 10/10 (10 ==> Happy Developer and Business)
COST-to-run : 7/10 (Reason to reduce 3 points explained somewhere in above thread, by me) (10==> Happy Business)
COST-to-manage : 10/10 (10 ==> Happy Developer and Business)
SCALE-for-PLANET-EARTH :
02/10 (with SQLite storage "HARD-LIMIT of 10GB in GA")
10/10 (with default KV storage) (10==> Happy Business)

I am extremely bullish for DO capabilities for its "inherent infra" for mananging race condition (though, not verified yet).

My 2 cents. Will update, as i get more insights.

FFlikTeoh > In the approach of taking "KV in DO with SQLite", limitation of storage of 1GB...

iLearn•2/7/25, 11:22 AM

Thanks. Surely will take a look. Keep sharing informative reads.

FFlikTeoh Now we just gotta make sure there's a redundant backup 😅

lambrospetrou•2/7/25, 12:55 PM

You mean backup as in another DO that receives replication updates, or somewhere offline like R2 as actual backup?

Burrito•2/7/25, 2:23 PM

Speaking of backup, is there a reference implementation of dumping a SQLite DO's database in a streaming fashion? The implementations I've come across (albeit I wasn't really looking for it) all keep the dump in memory, which wouldn't work for large databases.

m.muiznieks•2/7/25, 3:30 PM

Hello.

From time to time in the logs I see the error "Error: Durable Object exceeded its CPU time limit and was reset."

I am not using the Durable objects directly but I understand that they are behind most of the services here.

I've noticed this at the Zaraz service "context enrich workers" and this happened at the workflows.

None of the processes are related to "resource-heavy" processes.

The question is - when this error hits - does it mean the related data requests are considered lost or they are "reset" and it's safe to think that they will be processed?

BBurrito Speaking of backup, is there a reference implementation of dumping a SQLite DO's...

Brayden•2/7/25, 3:30 PM

If you're looking for a reference as a DIY maybe this PR could help give some ideas (https://github.com/outerbase/starbasedb/pull/76). I still need to run tests on this myself but worth sharing if you're looking at how a solution might work.

Burrito•2/7/25, 3:32 PM

Ah nice, didn't know there's a PR for it already, will take a look thanks.

iLearn•2/7/25, 6:06 PM

Any thing similar to D1 "Export an existing D1 database" (https://developers.cloudflare.com/d1/best-practices/import-export-data/#export-an-existing-d1-database) for DO (ONLY Data, NOT Class/Function) with SQLite storage, where .sql file can be dumped per DO to R2/S3 (whenever required) ?

Cloudflare Docs

Import and export data · Cloudflare D1 docs

D1 allows you to import existing SQLite tables and their data directly, enabling you to migrate existing data into D1 quickly and easily. This can be useful when migrating applications to use Workers and D1, or when you want to prototype a schema locally before importing it to your D1 database(s).

Fernando Barroso•2/7/25, 7:33 PM

hey all! I am having issues with durable objects tests using vitest. They work fine locally, but once we run them using GitHub actions we are running into the following problem:

packages/platform-core test: Failed to pop isolated storage stack frame in tests/do/do.test.ts's test "should append events to new stream".
packages/platform-core test: This usually means your Worker tried to access storage outside of a test, or failed to cleanup storage passed across an RPC boundary.
packages/platform-core test: In particular, we were unable to pop Durable Objects storage.
packages/platform-core test: Ensure you `await` all `Promise`s that read or write to these services, and make sure you use the `using` keyword when passing data across JSRPC. See https://developers.cloudflare.com/workers/runtime-apis/rpc/lifecycle#explicit-resource-management for more details.

packages/platform-core test: Failed to pop isolated storage stack frame in tests/do/do.test.ts's test "should append events to new stream".
packages/platform-core test: This usually means your Worker tried to access storage outside of a test, or failed to cleanup storage passed across an RPC boundary.
packages/platform-core test: In particular, we were unable to pop Durable Objects storage.
packages/platform-core test: Ensure you `await` all `Promise`s that read or write to these services, and make sure you use the `using` keyword when passing data across JSRPC. See https://developers.cloudflare.com/workers/runtime-apis/rpc/lifecycle#explicit-resource-management for more details.

has anyone run into this before? I have literally tried every single combination for concurrency and isolation model and I am still running into this.

ᴀ

ᴀkqj•2/7/25, 10:19 PM

Hey team

, I am having issues with DO

Error: Durable Object is overloaded. Requests queued for too long.

Error: Durable Object is overloaded. Requests queued for too long.

.The document says

An individual Object has a soft limit of 1,000 requests per second.

An individual Object has a soft limit of 1,000 requests per second.

is there a setting or configuration which can be set to increase this limit?

ᴀᴀkqj Hey team 👋 , I am having issues with DO `Error: Durable Object is overloaded. ...

Isaac McFadyen•2/7/25, 10:24 PM

No, it's a limitation of the Durable Object infrastructure and is only ever increased on internal Cloudflare applications if extremely needed. The recommended fix is to just use more than 1 Durable Object (which is the use-case DOs are designed for really)

Isaac McFadyen•2/7/25, 10:25 PM

The reason it's "soft" is that it'll heavily depend on how much computation you're doing in a single DO.

Avi•2/7/25, 11:42 PM

is there really no way to catch errors like this in cloudflare?

setTimeout(() => throw new Error("test"), 1000);

setTimeout(() => throw new Error("test"), 1000);

AAvi is there really no way to catch errors like this in cloudflare? ```js setTimeou...

Isaac McFadyen•2/7/25, 11:53 PM

Depends what you want to do with the catch. If you put a try-catch within the timeout itself it'll catch it but because it's in a timeout you can't reply to the client at that point.

IIsaac McFadyen Depends what you want to *do* with the catch. If you put a try-catch within the ...

Avi•2/8/25, 2:05 AM

I mean catching via some sort of global handler, like node has

uncaughtException

uncaughtException

Avi•2/8/25, 2:06 AM

if this happens in the codebase and someone forget to explicitly try-catch it, there is afaik zero way to observe or react to that

Avi•2/8/25, 2:06 AM

especially since it might not be in the context of a request as in a DO

AAvi if this happens in the codebase and someone forget to explicitly try-catch it, t...

Isaac McFadyen•2/8/25, 2:06 AM

You can use a Tail Worker: https://developers.cloudflare.com/workers/observability/logs/tail-workers/

Isaac McFadyen•2/8/25, 2:07 AM

A Tail Worker receives information about the execution of other Workers (known as producer Workers), such as HTTP statuses, data passed to console.log() or uncaught exceptions

Isaac McFadyen•2/8/25, 2:07 AM

I believe you can actually have it be the same worker

Isaac McFadyen•2/8/25, 2:07 AM

Just add a

tail

tail

handler and in the wrangler.json/wrangler.toml, point the Worker to itself.

IIsaac McFadyen You can use a Tail Worker: https://developers.cloudflare.com/workers/observabili...

Avi•2/8/25, 2:08 AM

its a very poor solution for DOs, because tail worker only process on requests, and the HTTP req/response lifecycle often does not map cleanly onto DOs (that's the whole point of DOs!)

Isaac McFadyen•2/8/25, 2:08 AM

Ah I see

Isaac McFadyen•2/8/25, 2:08 AM

Not sure then.

Avi•2/8/25, 2:09 AM

seems like the "right" solutions would be for CF to either:
- implement

addEventListener('uncaughtexception', ...)

addEventListener('uncaughtexception', ...)

like node does
or
- enable tailworkers to operate more granularly on the stream of events from a worker (e.g. console.log events in real time)

Rahul gangotri•2/8/25, 2:57 PM

Actually i was building a websocket product on durable objects for a pub sub based models

With channels like public, private, presence, cache

I create user apps where each user can create multiple apps and each app is a separate DO

I just want to have a quick chat with you to know that can i make this a saas model with just having 1 namespace and sell to users?

Is that technically possible? I know storage with be a limit, but i just need to store channel and its connected clients and not the messages

Rahul gangotri•2/8/25, 6:22 PM

anyone? From cloudflare?

Please reply

IiLearn Any thing similar to D1 "Export an existing D1 database" (https://developers.cl...

iLearn•2/8/25, 6:40 PM

bumping on top for response

DanTheGoodman•2/8/25, 10:14 PM

What's the current best way to handle shipping logs from durable objects to a custom destination? Specifically I'd like to just use a custom logger i have and ship the logs after responding to an RPC without holding the response to the invoking worker (plz ping me)

DanTheGoodman•2/8/25, 10:14 PM

Maybe tail workers? I'm not sure if they respond to RPCs to DOs as an exclusive event

RRahul gangotri anyone? From cloudflare? Please reply

1984 Ford Laser•2/8/25, 10:33 PM

Cloudflare employees aren't here to validate your business solutions for free, this is a community effort.

Hhannes nothing official, though I'm sure somewhere on Github someone wrote utility func...

iLearn•2/8/25, 11:32 PM

Thanks for pointers. Something better than Nothing

DDanTheGoodman What's the current best way to handle shipping logs from durable objects to a cu...

pandalambda2•2/9/25, 12:23 AM

Interesting in patterns around this as well. I want to ship to axiom.co. Shame they acquired and broke Baselime (just flat out doesn't work), but their analytics engine I think is the replacement, and similarly based on clickhouse, I'd be curious if that became the central sink and from there you could have forwarders push, or pull somehow

Ppandalambda2 Interesting in patterns around this as well. I want to ship to axiom.co. Shame t...

James•2/9/25, 1:53 AM

I flush logs to axiom at the end of each request. Since the DO persists until it’s done processing regardless of inbound RPC calls, just run the flush async without the await.

pandalambda2•2/9/25, 4:49 AM

I really would love to lift this out of app code though, it seems like a proper hack

Llambrospetrou First of all `await setAnotherAlarm()` does not set a new alarm, it overrides th...

peachneo•2/9/25, 6:46 AM

Hey Lambros, was wondering if the team got back to you on this

Regarding the behavior of setting an alarm and throwing right after, I will check with the team and get back to you.

Providing a more fleshed out example to better-communicate what I'm asking - hopefully it makes sense

export class MyDurableObject {
    constructor(state, env) {
        this.state = state;
        this.env = env;
    }

    async alarm() {
        console.log("Alarm triggered");

        // Will this alarm be set? or would it be "overriden" by the retry of the original alarm
        await this.state.storage.setAlarm(Date.now() + 150000);

        // Call a method that fails
        await this.failingMethod(); // failure
    }

    async fetch(request) {
        const url = new URL(request.url);

        if (url.pathname === "/start") {
            console.log("Starting recursive alarm loop...");
            await this.state.storage.setAlarm(Date.now() + 5000);
            return new Response("Alarm scheduled.");
        }

        return new Response("Unknown command", { status: 400 });
    }

    async failingMethod() {
        throw new Error("Intentional failure to demonstrate failure handling");
    }
}

export class MyDurableObject {
    constructor(state, env) {
        this.state = state;
        this.env = env;
    }

    async alarm() {
        console.log("Alarm triggered");

        // Will this alarm be set? or would it be "overriden" by the retry of the original alarm
        await this.state.storage.setAlarm(Date.now() + 150000);

        // Call a method that fails
        await this.failingMethod(); // failure
    }

    async fetch(request) {
        const url = new URL(request.url);

        if (url.pathname === "/start") {
            console.log("Starting recursive alarm loop...");
            await this.state.storage.setAlarm(Date.now() + 5000);
            return new Response("Alarm scheduled.");
        }

        return new Response("Unknown command", { status: 400 });
    }

    async failingMethod() {
        throw new Error("Intentional failure to demonstrate failure handling");
    }
}

packages/platform-core test: Failed to pop isolated storage stack frame in tests/do/do.test.ts's test "should append events to new stream". packages/platform-core test: This usually means your Worker tried to access storage outside of a test, or failed to cleanup storage passed across an RPC boundary. packages/platform-core test: In particular, we were unable to pop Durable Objects storage. packages/platform-core test: Ensure you `await` all `Promise`s that read or write to these services, and make sure you use the `using` keyword when passing data across JSRPC. See https://developers.cloudflare.com/workers/runtime-apis/rpc/lifecycle#explicit-resource-management for more details.

export class MyDurableObject { constructor(state, env) { this.state = state; this.env = env; } async alarm() { console.log("Alarm triggered"); // Will this alarm be set? or would it be "overriden" by the retry of the original alarm await this.state.storage.setAlarm(Date.now() + 150000); // Call a method that fails await this.failingMethod(); // failure } async fetch(request) { const url = new URL(request.url); if (url.pathname === "/start") { console.log("Starting recursive alarm loop..."); await this.state.storage.setAlarm(Date.now() + 5000); return new Response("Alarm scheduled."); } return new Response("Unknown command", { status: 400 }); } async failingMethod() { throw new Error("Intentional failure to demonstrate failure handling"); } }

you cannot bring up a specific use case and then say "oh actually that doesn't apply because I'm tal

Similar Threads

Similar Threads

Similar Threads