50,000 instances are hard limit or can be increased by support? I'm thinking of one db/user to 'phys

50,000 instances are hard limit or can be increased by support? I'm thinking of one db/user to 'physically' separate user data but in my case I'll probably never need more than 300k databases

MMichał Wróblewski 50,000 instances are hard limit or can be increased by support? I'm thinking of ...

forslunds•4/2/24, 10:52 AM

Soft limit/unlimited-but-then-you-wont-believe-us is the talk in discord

Fforslunds Soft limit/unlimited-but-then-you-wont-believe-us is the talk in discord 👍🏼

Max (@rozenmd)•4/2/24, 11:31 AM

It's from our open beta blog:

Support for more than 100,000+ databases for Workers for Platforms users — there’s no limit, but if we said “unlimited” you might not believe us — on top of the 50,000 databases per account that D1 already enables.

MMax (@rozenmd)It's from our open beta blog: > Support for more than 100,000+ databases for Wor...

forslunds•4/2/24, 12:42 PM

lets just hope "workers for platforms" works on pages too once i get 50k paying users

MMichał Wróblewski 50,000 instances are hard limit or can be increased by support? I'm thinking of ...

Tony Leung•4/2/24, 12:46 PM

You can sharding your database by username or date of birth or registered month, btw 300k+ db is a crazy large amount of db to manage

Fforslunds lets just hope "workers for platforms" works on pages too once i get 50k paying ...

Tony Leung•4/2/24, 12:48 PM

It would be nice if they add logpush support for pages function, i think that's more important than

Fforslunds lets just hope "workers for platforms" works on pages too once i get 50k paying ...

rob•4/2/24, 12:49 PM

Yea was wondering if they are going to do pages for platforms or something similar for hosting your users frontend pages

forslunds•4/2/24, 12:50 PM

Pages and workers are going to be unified, how much and when we dont know, but its coming

Rrob Yea was wondering if they are going to do pages for platforms or something simil...

Tony Leung•4/2/24, 12:52 PM

I'm out of the loop, what is worker/pages for platform?

rob•4/2/24, 12:53 PM

https://developers.cloudflare.com/cloudflare-for-platforms/workers-for-platforms/get-started/configuration/

Cloudflare Docs

Configure Workers for Platforms · Cloudflare for Platforms docs

This guide will instruct you on setting up Workers for Platforms. You will configure a dispatch namespace, a dynamic dispatch Worker and a user Worker …

rob•4/2/24, 12:53 PM

Pages for platforms doesn't exist afaik

Max (@rozenmd)•4/2/24, 12:55 PM

Workers for Platforms + Pages + SSL for SaaS covers a lot of potential "Pages for Platforms" use cases tbh

Max (@rozenmd)•4/2/24, 12:56 PM

like if you offered some sort of hosted blog service, you'd have a single Pages app connected to a DB and use SSL for SaaS to configure the custom domains, maybe Workers for Platforms for custom logic on top

rob•4/2/24, 12:57 PM

ya I use SSL for sass now on my domain so customers can point their custom domains

LilHuyyyy•4/2/24, 1:07 PM

Hello guys i just wondering whichh orm lib you guys are using with d1?

rob•4/2/24, 1:16 PM

drizzle

LilHuyyyy•4/2/24, 1:27 PM

I use drizzle too but i like some things like typeorm :v

rob•4/2/24, 1:32 PM

tbh I've been usin "nuxt hub" which has all the cloudflare stuff baked in and it was super easy to setup https://hub.nuxt.com/docs/getting-started

Bernardo•4/2/24, 2:04 PM

Morning guys, is it possible to create a multi tenant database with D1? Do you have some article or demo on github with this approach? Thanks!

Titan•4/2/24, 2:12 PM

is there anyway to perform spatial queries in D1? Considering a switch from Postgres for a new project but worried I won't be able to perform a common query:

Find a row that is closest to the user's position

Find a row that is closest to the user's position

Tony Leung•4/2/24, 2:36 PM

Oh i get it, it's like aws outpost

Matt Silverlock•4/2/24, 2:43 PM

With the initial support for Python + Workers (https://blog.cloudflare.com/python-workers), we've put together a brief example on how to query D1 from Python: https://developers.cloudflare.com/d1/examples/query-d1-from-python-workers/

Cloudflare Docs

Query D1 from Python Workers · Cloudflare D1 docs

The Cloudflare Workers platform supports multiple languages, including TypeScript, JavaScript, Rust and Python.

TTitan is there anyway to perform spatial queries in D1? Considering a switch from Post...

Matt Silverlock•4/2/24, 2:44 PM

Not yet, but looking into supporting: https://vxtwitter.com/elithrar/status/1774819539261255950?s=20

vxTwitter / fixvxTwitter

Matt Silverlock 🐀 (@elithrar)

@ipsumhh @Cloudflare D1 already supports full-text search: you can use the SQLite FTS5 extension out-of-the-box: https://www.sqlite.org/fts5.html

which also has a trigram tokenizer.

e don't yet support R*Tree (https://www.sqlite.org/rtree.html) but are looking into it!

Rrenzor supabase has been GA for half a decade and still doesn't have transactions 😆

Epailes•4/2/24, 2:52 PM

I mean they've got RPC which works fine for transactions.

MMax (@rozenmd)It's from our open beta blog: > Support for more than 100,000+ databases for Wor...

Epailes•4/2/24, 3:04 PM

I'll admit at being disappointed seeing that requirement if you need to go above 50k instances, depending on the use case 50k instances is quite easy to reach (eg something with a freemium model), I wouldn't mind paying for the involved read/writes/storage, but enterprise contracts are pricey and would put me off switching to D1 even when dynamic bindings are available due to that, it's just too much unknown price wise to commit to that kind of vendor lock in.

Epailes•4/2/24, 3:06 PM

But congrats on reaching GA! I know it's been a lot of work getting here and I'm excited to see how D1 continues to grow over the next year :MeowHeartCloudflare:

EEpailes I'll admit at being disappointed seeing that requirement if you need to go above...

Tony Leung•4/2/24, 3:11 PM

Honestly how can you reach 50k db? I'm just curious

rob•4/2/24, 3:12 PM

if 1 user getting their own db , 50k users

talkingarmor•4/2/24, 3:13 PM

Hi, I am looking to migrate from Neon to D1 so that I can bind Pages functions to them directly. My database stores a lot of texts (which is auto compressed by Postgres). Does D1 supports auto compression?

Matt Silverlock•4/2/24, 3:15 PM

FYI: Prisma ORM support for D1 in preview: https://vxtwitter.com/prisma/status/1775170363791425667?s=46

vxTwitter / fixvxTwitter

Prisma (@prisma)

Prisma ORM v5.12.0 just dropped!

Here's what's new:

Cloudflare D1 Support (Preview)

createMany()

createMany()

for SQLite

https://github.com/prisma/prisma/releases/tag/5.12.0

Rrob if 1 user getting their own db , 50k users

Tony Leung•4/2/24, 3:15 PM

I will not sharding like that tho..., i will shard it by date of birth, date of registration or anything like that (i used to do that in dynamo db to reduce costs), but in another way i usually split the app into many small business logic and create a database for each of them.

Tony Leung•4/2/24, 3:16 PM

Btw while designing the system i will try to store data as much as possible in s3 (sacrifice a bit of convenient) to make the db light and fast

Tony Leung•4/2/24, 3:17 PM

Only metadata are stored and query in db

Tony Leung•4/2/24, 3:17 PM

Might not be the brightest idea but it saves me a lot of money on aws

TTony Leung I will not sharding like that tho..., i will shard it by date of birth, date of ...

Epailes•4/2/24, 3:20 PM

Yeah pretty much what rob said, eg my service has a free tier, so those users are low revenue, but also low read/write/storage, so a traditional monolithic db is generally fine, just need to upgrade the size when necessary. D1 would be significantly better though for auto-scaling and data separation concerns (once dynamic binding and tooling is in place to manage the schema of that many instances).

rob•4/2/24, 3:21 PM

Workers for platforms ups the limits , maybe reach out to someone and see what the requirments are to get that enabled

Epailes•4/2/24, 3:21 PM

There's workarounds I could do to use D1 today, like sharing dbs between users as you said, but I'm using postgres right now and rely on RLS to keep data separate, I'd rather have a guarantee of data separation rather than refactor everything to make sure data is separate (alongside the risk of developer error in the future potentially leaking data), but that's my personal preference.

Epailes•4/2/24, 3:23 PM

It's the kind of thing where once I'd be fine signing up for an ent contract I'll consider it, but by that point it becomes even more work to migrate over to D1 that I'll likely have higher priorities unless I was facing technical issues with my current setup.

forslunds•4/2/24, 4:24 PM

Or skip freemium, i only have 5usd users, Meaning 250k mrr.. im sure i can affiord enterprise once the limit is reached.

.. waiting on dynamic binding

bun•4/2/24, 7:46 PM

Not d1 related much but how do you guys deal with dates those that use drizzle? Simple createdAt column with CURRENT_TIMESTAMP as default doesn’t work for me

bun•4/2/24, 7:47 PM

It gives “Invalid date” upon data retrieval

Bbun It gives “Invalid date” upon data retrieval

mw10013•4/2/24, 8:22 PM

https://orm.drizzle.team/learn/guides/timestamp-default-value

Drizzle ORM - SQL Timestamp as a default value

Drizzle ORM is a lightweight and performant TypeScript ORM with developer experience in mind.

Mmw10013 https://orm.drizzle.team/learn/guides/timestamp-default-value

bun•4/2/24, 9:57 PM

ty worked

Village (Josef)•4/3/24, 2:01 AM

Are you able to use the limit request form to get increased per database now? I’m happy with no replicas as a tradeoff, just want to be future proof with more storage.

VVillage (Josef)Are you able to use the limit request form to get increased per database now? I’...

Matt Silverlock•4/3/24, 2:19 AM

All existing databases (if you have a paid Workers plan) can grow to 10GB each - https://developers.cloudflare.com/d1/platform/changelog/#d1-is-generally-available

Cloudflare Docs

Changelog · Cloudflare D1 docs

D1 is now generally available and production ready. Read the blog post for more details on new features in GA and to learn more about the upcoming D1 …

MMatt Silverlock All existing databases (if you have a paid Workers plan) can grow to 10GB each -...

Village (Josef)•4/3/24, 2:20 AM

Are you able to request a limit beyond that or is it still a hard-coded value like in the beta?

VVillage (Josef)Are you able to request a limit beyond that or is it still a hard-coded value li...

Matt Silverlock•4/3/24, 2:22 AM

We don’t currently increase that limit - it’s not that it’s hard coded, it’s that we have a very (very) high bar for performance & cold starts.

We’re continuing to work on raising it over time - and as we do it’ll just work. But also unlikely a single D1 DB will be 100GB (which is a large transactional DB by any standard)

Matt Silverlock•4/3/24, 2:23 AM

Keep in mind that a 10GB database storing user records @ 1KB per row = 10M users.

Village (Josef)•4/3/24, 2:24 AM

That's fair yeah, we're considering a serverless migration at work and our current DB is 108GB (we can't split by user with our use case) so size is the issue

Tony Leung•4/3/24, 4:36 AM

does SQLite View improve query speed? I'm not planning to join view with anything else

50,000 instances are hard limit or can be increased by support? I'm thinking of one db/user to 'phys

Similar Threads

Similar Threads

Similar Threads