- Cloudflare Developers

Cloudflare Developers•16mo ago

Avi

AviOP•9/5/24, 2:21 PM

is this a cloudflare error? never seen it before

AviOP•9/5/24, 2:21 PM

we’re using DurableObjects

AAvi Click to see attachment

Hard@Work•9/5/24, 2:22 PM

That sounds like a JS error when you call too many setTimeout()setTimeout() without them resolving

HHard@Work That sounds like a JS error when you call too many `setTimeout()` without them r...

AviOP•9/5/24, 2:23 PM

hmm yeah that was my thought too…. are we expected to be manually calling clearTimeout?

johtso•9/5/24, 2:23 PM

how do you specify what account to deploy to when you have multiple accounts authenticated?

johtso•9/5/24, 2:26 PM

can I put an account id in a default config in the top level of my monorepo?

AAvi hmm yeah that was my thought too…. are we expected to be manually calling clearT...

Hard@Work•9/5/24, 2:27 PM

If you are generating a lot of them, then don't need them all, I would do so, yeah

Jjohtso can I put an account id in a default config in the top level of my monorepo?

Hard@Work•9/5/24, 2:27 PM

No, but you can put the account ID in your wranglerwrangler config

HHard@Work If you are generating a lot of them, then don't need them all, I would do so, ye...

AviOP•9/5/24, 2:28 PM

we probably shouldn’t be generating too many… 10K simultaneous sounds like a bug of some kind for sure. we probably only spin up several hundred DOs in a 10 minute period

HHard@Work No, but you can put the account ID in your `wrangler` config

johtso•9/5/24, 2:40 PM

that's not ideal as it's my work account and I don't want it to affect my personal account

johtso•9/5/24, 2:41 PM

so I really want it to be global but just for the project/directory/monorepo

Jjohtso that's not ideal as it's my work account and I don't want it to affect my person...

Hard@Work•9/5/24, 2:45 PM

Not sure I understand? If you put the ID in your config, then it only applies to that one Worker/Pages Project

HHard@Work Not sure I understand? If you put the ID in your config, then it only applies to...

johtso•9/5/24, 2:52 PM

oh, I think I misunderstood what you meant by "your" config.. do you just mean the project config? there are many workers in my monorepo, wanted to avoid hardcoding the account id into all of them

Jjohtso oh, I think I misunderstood what you meant by "your" config.. do you just mean t...

Hard@Work•9/5/24, 2:52 PM

Yeah, that's what I meant. There isn't currently a way to make them inherit an account ID from somewhere else

Hard@Work•9/5/24, 2:53 PM

Unless you want to add an Environment Variable that you can somehow scope to just that directory

johtso•9/5/24, 2:55 PM

ohh, that could work

lifeiscontent•9/5/24, 6:13 PM

why is pages recommend over worker sites? It seems like Worker Sites is more powerful

Llifeiscontent why is pages recommend over worker sites? It seems like Worker Sites is more pow...

Chaika•9/5/24, 6:23 PM

In what way? Pages has built in CI/CD, supports advanced mode so you can pop out of the provided stuff and use it more like Worker Sites, free unlimited static asset requests, versioning/rollbacks/etc

CChaika In what way? Pages has built in CI/CD, supports advanced mode so you can pop out...

lifeiscontent•9/5/24, 6:24 PM

can't seem to use durable objects / D1 Transactions but maybe I'm doing something wrong?

Devon•9/5/24, 6:25 PM

Yeah, the functionality venn diagram of Workers/Workers Sites and Pages/Pages Functions is... a bit awkward imho.

Llifeiscontent can't seem to use durable objects / D1 Transactions but maybe I'm doing somethin...

Chaika•9/5/24, 6:25 PM

Durable Objects have to be defined in a worker and then you can attach to in Pages, Explicit Transactions don't exist outside of batch

DDevon Yeah, the functionality venn diagram of Workers/Workers Sites and Pages/Pages F...

Chaika•9/5/24, 6:25 PM

They're working on converging Pages and Workers into one product: https://blog.cloudflare.com/pages-and-workers-are-converging-into-one-experience/

The Cloudflare Blog

Bringing a unified developer experience to Cloudflare Workers and P...

Today we’re excited to announce that over the next year we will be working to bring together the best traits and attributes you know and love from each product into one powerful platform!

CChaika They're working on converging Pages and Workers into one product: https://blog.c...

Devon•9/5/24, 6:25 PM

Yeah, I'm very much looking forwards to that!

Chaika•9/5/24, 6:26 PM

it's a little awkward right now, Pages still has a ton more stuff then normal Workers, would hardly say Worker Sites is more powerful outside of a few edge-case not supported stuff/bindings

lifeiscontent•9/5/24, 6:26 PM

@Chaika I thought you could provide a transactions.js file? https://blog.cloudflare.com/whats-new-with-d1/

The Cloudflare Blog

D1: our quest to simplify databases

Get an inside look on the D1 experience today, what the team is currently working on and what’s coming up!

Chaika•9/5/24, 6:27 PM

"Sneak peek"

Devon•9/5/24, 6:27 PM

For now I'm mostly doing my FE in Pages and my services as Workers, and just using lerna monorepo (sometimes combined with git submodules) to manage the whole thing.

lifeiscontent•9/5/24, 6:29 PM

@Chaika hmm, so if I wanted to build a social network on cloudflare, would that be something that would not make sense to do given the current scope of features that exist?

Chaika•9/5/24, 6:29 PM

It has implicit transactions with batch/queries

Chaika•9/5/24, 6:30 PM

https://developers.cloudflare.com/d1/build-with-d1/d1-client-api/#batch-statements

Cloudflare Docs

Query D1 | Cloudflare D1 docs

D1 is compatible with most SQLite’s SQL convention since it leverages SQLite’s query engine. D1 client API allows you to interact with a D1 database from within a Worker.

lifeiscontent•9/5/24, 6:30 PM

Decision fatigue is getting the best of me with all of this new tooling

Chaika•9/5/24, 6:31 PM

It depends exactly how you want to build it how you'd go about it, but I don't see any reason why it would be impossible, D1 is semi-limited though because right now it's a single javascript thread/isolate in a single location, so for dynamic social networks which aren't too cachable you might reach the limits of one + the max size of 10gb per db

Chaika•9/5/24, 6:32 PM

they want you to scale with more DBs but doing that with a social network would be interesting, I guess could have each user in its own D1 DB but would need a lot of glue + the tooling to handle that all well/dynamically is still unreleased

lifeiscontent•9/5/24, 6:34 PM

so maybe something like: https://sqlitecloud.io

SQLite Cloud - Share, scale and deploy SQLite databases.

SQLite Cloud offers an easy way to share single-user SQLite databases to the cloud. We offer enterprise features like advanced scaling solutions, continuous backup, ACID-compliant over multiple nodes (and multiple zones), pub/sub capabilities, powerful users/roles access control, and a javascript-based programming language to extend the built-in...

Chaika•9/5/24, 6:35 PM

you mean instead of d1? That's basically what D1 aims to provide eventually in some ways, although I would note their storage limits are no better/probably same other arch limits to a degree if that's why you don't want to use d1

Chaika•9/5/24, 6:36 PM

The advice of the D1 team has been if you want a monolithic db/one big db you should go with another provider and use an http api or #hyperdrive

lifeiscontent•9/5/24, 6:37 PM

yeah, I honestly don't know what I'm doing, I'm an expert in front-end but, building full fledged services is not something I've done actively

lifeiscontent•9/5/24, 6:45 PM

@Chaika does Hyperdrive work in pages?

lifeiscontent•9/5/24, 6:51 PM

@Chaika seems the demo GitHub is M.I.A. https://github.com/cloudflare/hyperdrive-demo

lifeiscontent•9/5/24, 6:52 PM

https://github.com/search?q=owner%3Acloudflare%20hyperdrive-demo&type=code

GitHub

Build software better, together

GitHub is where people build software. More than 100 million people use GitHub to discover, fork, and contribute to over 420 million projects.

jason•9/6/24, 6:01 AM

I have a CF worker (worker A) that exposes different endpoints using Hono, now I have another worker (Worker B) that needs to make a request to Worker A. Is it possible to make an RPC service binding call to a Worker A method, if so how would I achieve this, any documentation or examples appreciated.

javeed•9/6/24, 7:53 AM

Hey All,

Is it possible to use worker from ourside of the cloudflare zone?

Like CNAME the worker sub-domain from Go-Daddy?

jason•9/6/24, 8:37 AM

Thanks @FlikTeoh, totally agree the docs are impressive, I have read the RPC documentation and implemented it across other workers, this scenario is slightly different from documented. Or at least I couldn't work out from the docs how to implement my scenario...

I have a worker with the following simplified code:

import { Hono } from 'hono'
const app = new Hono()

app.get('/', (c) => c.text('Hello Cloudflare Workers!'))
app.get('/analyse', (c) => c.text('Hello Analyse endpoint!'))

export default app

import { Hono } from 'hono'
const app = new Hono()

app.get('/', (c) => c.text('Hello Cloudflare Workers!'))
app.get('/analyse', (c) => c.text('Hello Analyse endpoint!'))

export default app

In order to do a service to service binding I have the RPC or fetch option. With the RPC approach I have to export a class that extends WorkerEntrypointWorkerEntrypoint , in which case how do I also export the endpoints?

If I want to use the HTTP fetch interface how would I export a fetch handler and also the other endpoints via Hono?

I'm starting to wonder if there is a problem with my solution design, might rethink it, in the meantime any examples or pointers appreciated.

icontrader•9/6/24, 9:19 AM

hey there, I get a 525 error when I try to use the DeepL API from my worker. It works just fine locally and the issue only appears once deployed to production. From researching its got something to do with the SSL handshake between CF and API but I havent found a solution, anyone know how to solve it?

Original message was deleted

jason•9/6/24, 10:10 AM

thanks @Leo I'll give it a try later today.

celer•9/6/24, 12:49 PM

Hi. I'm trying to build a CF worker-based solution to create large zip files and looking for some advice.
I need to zip hundreds of few-MB files located in R2 into zip uploaded to R2. Resulting zip can be ~1GB which is way over worker memory limit so I had to stream zip into buffer and upload chunks using r2 multipart upload.
The problem is that both http fetch and queue consumer event are limited to 30s of cpu time, which causes cpu exceeded error usually around 500MB of processed zip data. I'm trying to improve the task to be able to recover from being terminated at any time (with queue retry) but it's non-trivial to resume original state of things.
Maybe using workers isn't the right choice for this task. Does CF have anything better suitable? Thanks!

Ashley•9/6/24, 1:10 PM

I'm not sure your use case or how scalable it needs to be, but if you only need to run it once per hour (or less), then cron triggers can use up to 15 mins of CPU time (more frequently than an hour and it's 30 seconds)

celer•9/6/24, 1:15 PM

@Ashley unfortunately cron is not an option for me. it needs to execute on demand.

Similar Threads