whats the recommended way for connecting to a postgres db from a worker? cloudflare seems to have ar

whats the recommended way for connecting to a postgres db from a worker? cloudflare seems to have articles pointing lots of different ways.. and i also see the neon stuff

AAA whats the recommended way for connecting to a postgres db from a worker? cloudfl...

James•5/14/23, 7:10 PM

Stuff might be coming soon

https://twitter.com/CherryJimbo/status/1654505957316018177

James Ross (@CherryJimbo)

Cloudflare is looking at releasing TCP Workers very soon, allowing users to connect to any TCP service using Workers.

This can include things like databases, such as in this example. It's going to be super exciting to see what everyone builds with this!

The native API is…

Likes

471

Twitter

•

5/5/23, 3:18 PM

JJames Stuff might be coming soon 👀 https://twitter.com/CherryJimbo/status/16545059573...

AAOP•5/14/23, 7:11 PM

wow, my exact need.

AAOP•5/14/23, 7:12 PM

i've always found myself needing things 3-6 months ahead of when cloudflare is releasing something :/

TTom Sherman i wonder how connection pooling will work there

AAOP•5/14/23, 7:16 PM

yea i've wondered about that myself for any db connection from a worker

kian•5/14/23, 7:17 PM

iirc you can do it in a DO

sathoro•5/14/23, 7:23 PM

personally I'd setup pgbouncer and use that

AAOP•5/14/23, 7:28 PM

https://blog.cloudflare.com/neon-postgres-database-from-workers/ states

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

The Cloudflare Blog

Easy Postgres integration on Cloudflare Workers with Neon.tech

Neon.tech is a database platform that allows you to branch your (Postgres compatible) database exactly like your code repository. And with the release of their Cloudflare Workers integration you can get started in minutes

Original message was deleted

sathoro•5/14/23, 7:39 PM

not fully solved though at least not without building a lot of connection pool logic. for example you don't want only a single connection, you would want multiple and you also would want a different number of db connections and client connections, etc. and this is just the tip of iceberg

Original message was deleted

sathoro•5/14/23, 7:43 PM

1 single connection? I dunno... it would work fine until very suddenly it doesn't and then you'd be asking yourself why you didn't just setup a proper connection pooler while your app is down in production and you are scrambling

AAOP•5/14/23, 7:43 PM

pgbounce sounds better

AAOP•5/14/23, 7:44 PM

the mystery for me is the word "soon" if this is out in a month i'll hold off. if its 6 months. i'll need another solution

AAA the mystery for me is the word "soon" if this is out in a month i'll hold off. ...

sathoro•5/14/23, 7:45 PM

do you already have a postgres db? because one option is to use Supabase. you get a dedicated Postgres db and can use their HTTP APIs (this is what we do)

sathoro•5/14/23, 7:47 PM

we try to call Supabase directly from the client (browser) as much as possible but in a couple situations we call it from in a Worker and it is easy to do

AAOP•5/14/23, 7:47 PM

yea i already have a postgresdb. I can just host the webhooks somewhere else. but i wanted to use cloudflare

AAA yea i already have a postgresdb. I can just host the webhooks somewhere else. bu...

sathoro•5/14/23, 7:49 PM

another option is putting PostgREST in front of your db

AAOP•5/14/23, 7:49 PM

yea i saw some cloudflare docs recommending that as well

sathoro•5/14/23, 7:49 PM

actually I think Supabase uses this

sathoro•5/14/23, 7:49 PM

it has built in connection pooler

sathoro•5/14/23, 7:50 PM

so might as well do that since you'd have to setup a connection pooler anyways...

AAOP•5/14/23, 7:51 PM

supabase does look interesting, seems like it can be selfhosted as well

AAA supabase does look interesting, seems like it can be selfhosted as well

sathoro•5/14/23, 7:51 PM

yeah it can be, is almost entirely open source

AAOP•5/14/23, 7:52 PM

i wish it'd been more mature when i started this project ;P

sathoro•5/14/23, 7:52 PM

we use it for auth and CRUD stuff

sathoro•5/14/23, 7:52 PM

ha yeah stuff is moving fast the last couple years

AAOP•5/14/23, 7:52 PM

this projects from 2018.. still chugging.

AAOP•5/14/23, 7:53 PM

predates workers i believe

sathoro•5/14/23, 7:56 PM

it is a good time to start a project now

sathoro•5/14/23, 7:56 PM

DOs and workers have been a literal game changer

AAOP•5/14/23, 7:56 PM

'soon' is always a good time to start a project

TTom Sherman How? Don't think you'd be able to run that on a worker

sathoro•5/14/23, 8:22 PM

I meant once the TCP comes out. In meantime use Supabase or PostgREST

sathoro•5/14/23, 8:22 PM

why

sathoro•5/14/23, 8:23 PM

pgbouncer will queue the connections

sathoro•5/14/23, 8:23 PM

that is half the point of using it

sathoro•5/14/23, 8:23 PM

also workers stick around for a while you could cache the requests locally I think. but establishing a connection to pgbouncer doesn't take that long

sathoro•5/14/23, 8:24 PM

I'm not saying you would run it in a worker

sathoro•5/14/23, 8:24 PM

you run it on a server close to the database

sathoro•5/14/23, 8:24 PM

and connect to it from the worker

sathoro•5/14/23, 8:24 PM

running it in a worker would make no sense lol

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

whats the recommended way for connecting to a postgres db from a worker? cloudflare seems to have ar

Similar Threads

Similar Threads

Similar Threads