@sathoro btw here's a reply from Supabase about Workers getting rate limited that might be useful fo

@sathoro btw here's a reply from Supabase about Workers getting rate limited that might be useful for you in the future.

Hi David,

Really appreciate the detailed reply here!

We've discussed this internally and it looks like we'll be going with this approach:

> Another possible simple idea, is to only bypass rate limiting for a new “no limit anon key”.

This will probably take some time to roll out since we have some other on-going tasks. I guess the temporary workaround you have helps for now and we'll definitely let you know once we've implemented the proper fix.

Hi David,

Really appreciate the detailed reply here!

We've discussed this internally and it looks like we'll be going with this approach:

> Another possible simple idea, is to only bypass rate limiting for a new “no limit anon key”.

This will probably take some time to roll out since we have some other on-going tasks. I guess the temporary workaround you have helps for now and we'll definitely let you know once we've implemented the proper fix.

Hi David,

Really appreciate the detailed reply here!

We've discussed this internally and it looks like we'll be going with this approach:

> Another possible simple idea, is to only bypass rate limiting for a new “no limit anon key”.

This will probably take some time to roll out since we have some other on-going tasks. I guess the temporary workaround you have helps for now and we'll definitely let you know once we've implemented the proper fix.

Hi David,

Really appreciate the detailed reply here!

We've discussed this internally and it looks like we'll be going with this approach:

> Another possible simple idea, is to only bypass rate limiting for a new “no limit anon key”.

This will probably take some time to roll out since we have some other on-going tasks. I guess the temporary workaround you have helps for now and we'll definitely let you know once we've implemented the proper fix.

Ddave @sathoro btw here's a reply from Supabase about Workers getting rate limited tha...

sathoro•5/14/23, 4:49 AM

are you using anon keys or service role?

Ssathoro are you using anon keys or service role?

daveOP•5/14/23, 4:51 AM

Both. I know it might seem a little funky since it's all server (Worker) side stuff , but I prefer using the anon key when possible to make it harder to shoot ourselves in the foot when it comes to access controls.

daveOP•5/14/23, 4:51 AM

Either key has the same rate limiting though

Ddave Both. I know it might seem a little funky since it's all server (Worker) side st...

sathoro•5/14/23, 4:52 AM

it does make sense

Ssathoro it does make sense

daveOP•5/14/23, 4:53 AM

the service key having rate limiting does seem odd to me, but tbh we're very new to supabase so there's probably use-cases we're totally unaware of

sathoro•5/14/23, 8:01 AM

can anybody recommend a good logging system for production that will easily allow for filtering errors? I know about Logpush - I'm wondering what I should push to

sathoro•5/14/23, 8:03 AM

also, we have been pushing to R2 but not doing anything with the logs... if there is a solution for seeing logs inside R2 that would work too

Ssathoro can anybody recommend a good logging system for production that will easily allo...

DaniFoldi•5/14/23, 8:42 AM

We use a tool called axiom (https://axiom.co), they have a built-in integration for worker logs, and they're also working on a logpush endpoint for ingest. Their free tier goes up to something like 500GB a month axiomspin

DDaniFoldi We use a tool called axiom (https://axiom.co), they have a built-in integration ...

sathoro•5/14/23, 8:46 AM

looks nice, if they had logpush I would use it

sathoro•5/14/23, 8:46 AM

I'm trying to setup Datadog and been quite unsuccessful. Cloudflare is not listed as an option on their logging pages at all

sathoro•5/14/23, 8:51 AM

okay it worked, not sure I did anything differently this time though

manstfu•5/14/23, 10:28 AM

laravel api can be used with cloudflare workers?

zegevlier•5/14/23, 10:32 AM

It looks like laravel is PHP, so no, not really. If you really want to you might be able to get it working with WASM though

Mmanstfu laravel api can be used with cloudflare workers?

sathoro•5/14/23, 10:37 AM

Neiki•5/14/23, 12:36 PM

can i do let my worker run for 5 minutes f.ex with "waitUntil" and a promise timeout that resolve after 5 minutes or 4 minutes? (currently i have free plan if that is important), after that 5 minutes it would fetch something and send response

manstfu•5/14/23, 12:37 PM

thats called cron job

Neiki•5/14/23, 12:44 PM

ah thanks!

NNeiki ah thanks!

sathoro•5/14/23, 1:14 PM

use alarms in Durable Objects

AA•5/14/23, 6:39 PM

whats the recommended way for connecting to a postgres db from a worker? cloudflare seems to have articles pointing lots of different ways.. and i also see the neon stuff

AAA whats the recommended way for connecting to a postgres db from a worker? cloudfl...

James•5/14/23, 7:10 PM

Stuff might be coming soon

https://twitter.com/CherryJimbo/status/1654505957316018177

James Ross (@CherryJimbo)

Cloudflare is looking at releasing TCP Workers very soon, allowing users to connect to any TCP service using Workers.

This can include things like databases, such as in this example. It's going to be super exciting to see what everyone builds with this!

The native API is…

Likes

471

Twitter

•

5/5/23, 3:18 PM

JJames Stuff might be coming soon 👀 https://twitter.com/CherryJimbo/status/16545059573...

AA•5/14/23, 7:11 PM

wow, my exact need.

AA•5/14/23, 7:12 PM

i've always found myself needing things 3-6 months ahead of when cloudflare is releasing something :/

TTom Sherman i wonder how connection pooling will work there

AA•5/14/23, 7:16 PM

yea i've wondered about that myself for any db connection from a worker

kian•5/14/23, 7:17 PM

iirc you can do it in a DO

sathoro•5/14/23, 7:23 PM

personally I'd setup pgbouncer and use that

AA•5/14/23, 7:28 PM

https://blog.cloudflare.com/neon-postgres-database-from-workers/ states

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

The Cloudflare Blog

Easy Postgres integration on Cloudflare Workers with Neon.tech

Neon.tech is a database platform that allows you to branch your (Postgres compatible) database exactly like your code repository. And with the release of their Cloudflare Workers integration you can get started in minutes

Original message was deleted

sathoro•5/14/23, 7:39 PM

not fully solved though at least not without building a lot of connection pool logic. for example you don't want only a single connection, you would want multiple and you also would want a different number of db connections and client connections, etc. and this is just the tip of iceberg

Original message was deleted

sathoro•5/14/23, 7:43 PM

1 single connection? I dunno... it would work fine until very suddenly it doesn't and then you'd be asking yourself why you didn't just setup a proper connection pooler while your app is down in production and you are scrambling

AA•5/14/23, 7:43 PM

pgbounce sounds better

AA•5/14/23, 7:44 PM

the mystery for me is the word "soon" if this is out in a month i'll hold off. if its 6 months. i'll need another solution

AAA the mystery for me is the word "soon" if this is out in a month i'll hold off. ...

sathoro•5/14/23, 7:45 PM

do you already have a postgres db? because one option is to use Supabase. you get a dedicated Postgres db and can use their HTTP APIs (this is what we do)

sathoro•5/14/23, 7:47 PM

we try to call Supabase directly from the client (browser) as much as possible but in a couple situations we call it from in a Worker and it is easy to do

AA•5/14/23, 7:47 PM

yea i already have a postgresdb. I can just host the webhooks somewhere else. but i wanted to use cloudflare

AAA yea i already have a postgresdb. I can just host the webhooks somewhere else. bu...

sathoro•5/14/23, 7:49 PM

another option is putting PostgREST in front of your db

AA•5/14/23, 7:49 PM

yea i saw some cloudflare docs recommending that as well

sathoro•5/14/23, 7:49 PM

actually I think Supabase uses this

sathoro•5/14/23, 7:49 PM

it has built in connection pooler

sathoro•5/14/23, 7:50 PM

so might as well do that since you'd have to setup a connection pooler anyways...

AA•5/14/23, 7:51 PM

supabase does look interesting, seems like it can be selfhosted as well

AAA supabase does look interesting, seems like it can be selfhosted as well

sathoro•5/14/23, 7:51 PM

yeah it can be, is almost entirely open source

AA•5/14/23, 7:52 PM

i wish it'd been more mature when i started this project ;P

sathoro•5/14/23, 7:52 PM

we use it for auth and CRUD stuff

sathoro•5/14/23, 7:52 PM

ha yeah stuff is moving fast the last couple years

AA•5/14/23, 7:52 PM

this projects from 2018.. still chugging.

AA•5/14/23, 7:53 PM

predates workers i believe

sathoro•5/14/23, 7:56 PM

it is a good time to start a project now

sathoro•5/14/23, 7:56 PM

DOs and workers have been a literal game changer

Even when Workers eventually support raw TCP communication, we will not have fully solved our problem, because database connections are expensive to set up and also have quite a bit of memory overhead.

@sathoro btw here's a reply from Supabase about Workers getting rate limited that might be useful fo

Similar Threads

Similar Threads

Similar Threads