can anybody recommend a good logging system for production that will easily allow for filtering erro

can anybody recommend a good logging system for production that will easily allow for filtering errors? I know about Logpush - I'm wondering what I should push to

sathoroOP•5/14/23, 8:03 AM

also, we have been pushing to R2 but not doing anything with the logs... if there is a solution for seeing logs inside R2 that would work too

Ssathoro can anybody recommend a good logging system for production that will easily allo...

DaniFoldi•5/14/23, 8:42 AM

We use a tool called axiom (https://axiom.co), they have a built-in integration for worker logs, and they're also working on a logpush endpoint for ingest. Their free tier goes up to something like 500GB a month axiomspin

DDaniFoldi We use a tool called axiom (https://axiom.co), they have a built-in integration ...

sathoroOP•5/14/23, 8:46 AM

looks nice, if they had logpush I would use it

sathoroOP•5/14/23, 8:46 AM

I'm trying to setup Datadog and been quite unsuccessful. Cloudflare is not listed as an option on their logging pages at all

sathoroOP•5/14/23, 8:51 AM

okay it worked, not sure I did anything differently this time though

manstfu•5/14/23, 10:28 AM

laravel api can be used with cloudflare workers?

zegevlier•5/14/23, 10:32 AM

It looks like laravel is PHP, so no, not really. If you really want to you might be able to get it working with WASM though

Mmanstfu laravel api can be used with cloudflare workers?

sathoroOP•5/14/23, 10:37 AM

Neiki•5/14/23, 12:36 PM

can i do let my worker run for 5 minutes f.ex with "waitUntil" and a promise timeout that resolve after 5 minutes or 4 minutes? (currently i have free plan if that is important), after that 5 minutes it would fetch something and send response

manstfu•5/14/23, 12:37 PM

thats called cron job

Neiki•5/14/23, 12:44 PM

ah thanks!

NNeiki ah thanks!

sathoroOP•5/14/23, 1:14 PM

use alarms in Durable Objects

AA•5/14/23, 6:39 PM

whats the recommended way for connecting to a postgres db from a worker? cloudflare seems to have articles pointing lots of different ways.. and i also see the neon stuff

AAA whats the recommended way for connecting to a postgres db from a worker? cloudfl...

James•5/14/23, 7:10 PM

Stuff might be coming soon

https://twitter.com/CherryJimbo/status/1654505957316018177

James Ross (@CherryJimbo)

Cloudflare is looking at releasing TCP Workers very soon, allowing users to connect to any TCP service using Workers.

This can include things like databases, such as in this example. It's going to be super exciting to see what everyone builds with this!

The native API is…

Likes

471

Twitter

•

5/5/23, 3:18 PM

JJames Stuff might be coming soon 👀 https://twitter.com/CherryJimbo/status/16545059573...

AA•5/14/23, 7:11 PM

wow, my exact need.

AA•5/14/23, 7:12 PM

i've always found myself needing things 3-6 months ahead of when cloudflare is releasing something :/

TTom Sherman i wonder how connection pooling will work there

AA•5/14/23, 7:16 PM

yea i've wondered about that myself for any db connection from a worker

kian•5/14/23, 7:17 PM

iirc you can do it in a DO

sathoroOP•5/14/23, 7:23 PM

personally I'd setup pgbouncer and use that

AA•5/14/23, 7:28 PM

https://blog.cloudflare.com/neon-postgres-database-from-workers/ states

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

The Cloudflare Blog

Easy Postgres integration on Cloudflare Workers with Neon.tech

Neon.tech is a database platform that allows you to branch your (Postgres compatible) database exactly like your code repository. And with the release of their Cloudflare Workers integration you can get started in minutes

Original message was deleted

sathoroOP•5/14/23, 7:39 PM

not fully solved though at least not without building a lot of connection pool logic. for example you don't want only a single connection, you would want multiple and you also would want a different number of db connections and client connections, etc. and this is just the tip of iceberg

Original message was deleted

sathoroOP•5/14/23, 7:43 PM

1 single connection? I dunno... it would work fine until very suddenly it doesn't and then you'd be asking yourself why you didn't just setup a proper connection pooler while your app is down in production and you are scrambling

AA•5/14/23, 7:43 PM

pgbounce sounds better

AA•5/14/23, 7:44 PM

the mystery for me is the word "soon" if this is out in a month i'll hold off. if its 6 months. i'll need another solution

AAA the mystery for me is the word "soon" if this is out in a month i'll hold off. ...

sathoroOP•5/14/23, 7:45 PM

do you already have a postgres db? because one option is to use Supabase. you get a dedicated Postgres db and can use their HTTP APIs (this is what we do)

sathoroOP•5/14/23, 7:47 PM

we try to call Supabase directly from the client (browser) as much as possible but in a couple situations we call it from in a Worker and it is easy to do

AA•5/14/23, 7:47 PM

yea i already have a postgresdb. I can just host the webhooks somewhere else. but i wanted to use cloudflare

AAA yea i already have a postgresdb. I can just host the webhooks somewhere else. bu...

sathoroOP•5/14/23, 7:49 PM

another option is putting PostgREST in front of your db

AA•5/14/23, 7:49 PM

yea i saw some cloudflare docs recommending that as well

sathoroOP•5/14/23, 7:49 PM

actually I think Supabase uses this

sathoroOP•5/14/23, 7:49 PM

it has built in connection pooler

sathoroOP•5/14/23, 7:50 PM

so might as well do that since you'd have to setup a connection pooler anyways...

AA•5/14/23, 7:51 PM

supabase does look interesting, seems like it can be selfhosted as well

AAA supabase does look interesting, seems like it can be selfhosted as well

sathoroOP•5/14/23, 7:51 PM

yeah it can be, is almost entirely open source

AA•5/14/23, 7:52 PM

i wish it'd been more mature when i started this project ;P

sathoroOP•5/14/23, 7:52 PM

we use it for auth and CRUD stuff

sathoroOP•5/14/23, 7:52 PM

ha yeah stuff is moving fast the last couple years

AA•5/14/23, 7:52 PM

this projects from 2018.. still chugging.

AA•5/14/23, 7:53 PM

predates workers i believe

sathoroOP•5/14/23, 7:56 PM

it is a good time to start a project now

sathoroOP•5/14/23, 7:56 PM

DOs and workers have been a literal game changer

AA•5/14/23, 7:56 PM

'soon' is always a good time to start a project

TTom Sherman How? Don't think you'd be able to run that on a worker

sathoroOP•5/14/23, 8:22 PM

I meant once the TCP comes out. In meantime use Supabase or PostgREST

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

can anybody recommend a good logging system for production that will easily allow for filtering erro

Similar Threads

Similar Threads

Similar Threads