Oh nevermind 1200 req per 5min limit, so it's impossible in production. Ok got it.

Ccosbgn Oh nevermind 1200 req per 5min limit, so it's impossible in production. Ok got i...

DaniFoldi•5/10/24, 9:01 AM

Yup, first there's the rate limit, and Cloudflare REST API goes to a few colos, so the request will definitely be noticeably slower - the exact duration depends on your and your DB's location

Nehal Ali•5/10/24, 2:42 PM

Hello , i am trying to perform an alpha database migration for one of my alpha databases , i followed this guide: https://developers.cloudflare.com/d1/platform/alpha-migration/#1-verify-that-a-database-is-alpha
but i keep getting error

  Internal error: failed to run backup: Failed to query D1: D1 API returned: (500 Internal Server
  Error) {"error":"Error 9000: something went wrong","success":false} [code: 7500]

  Internal error: failed to run backup: Failed to query D1: D1 API returned: (500 Internal Server
  Error) {"error":"Error 9000: something went wrong","success":false} [code: 7500]

when i run wrangler d1 backup command , any idea how to resolve this ?

Cloudflare Docs

Alpha database migration guide · Cloudflare D1 docs

D1 alpha databases will stop accepting live SQL queries on July 1, 2024.

DavidHidvegi•5/10/24, 8:47 PM

Hi, do you know if in the D1 Limits Docs (https://developers.cloudflare.com/d1/platform/limits/) the following part means that it would be possible to increase the size of one database up to 10TB (from 10GB) ?

Increase your limits

Request adjustments to limits that conflict with your project goals by contacting Cloudflare. To request an increase to a limit, complete the Limit Increase Request Form
and we will contact you with next steps.

DDavidHidvegi Hi, do you know if in the D1 Limits Docs (https://developers.cloudflare.com/d1/p...

Chaika•5/10/24, 8:54 PM

that's not how they want you to scale, they want you to make more d1 dbs and spread out on them, not a single. the 10gb is a hard technical limit
d1-database

Chaika•5/10/24, 8:55 PM

and they've said before they don't currently increase that limit at all
d1-database
I kind of doubt we'll ever see singular D1 DBs bigger then 100 gb, let alone 10 tb lol

CChaika and they've said before they don't currently increase that limit at all https://...

DavidHidvegi•5/10/24, 8:57 PM

Ah thanks, that was my assumption

Murder Chicken•5/10/24, 9:40 PM

Is it possible yet to leverage a sqlite client with a remote D1 database yet? I know there's a JDBC connector being tested but anything that allows us to leverage a stand-alone GUI app to interact with a remote DB?

MMurder Chicken Is it possible yet to leverage a sqlite client with a remote D1 database yet? I...

Hello, I’m Allie!•5/10/24, 9:42 PM

Not that I know of(might be some 3rd-party package for it, idk). The issue is is that there isn't really a standard SQLite Protocol as far as I'm aware, so most clients just open a file. This is made even more difficult because D1 itself doesn't store the database as a file, but in a different way that makes it easier for them to handle on the backend

HHello, I’m Allie!Not that I know of(might be some 3rd-party package for it, idk). The issue is is...

Murder Chicken•5/10/24, 9:43 PM

Bummer. I was hoping something might have popped up in the community in the last few months. Thanks for the info!

MMurder Chicken Is it possible yet to leverage a sqlite client with a remote D1 database yet? I...

josh•5/11/24, 12:22 AM

Any D1 clients JDBC, ODBC, or otherwise would be built against our HTTP API. It should be pretty trivial to make use of the API yourself, but currently you should expect it to be slightly less reliable (auth for the HTTP API goes through our control plane whereas bindings from workers do not).

Jjosh Any D1 clients JDBC, ODBC, or otherwise would be built against our HTTP API. It ...

Murder Chicken•5/11/24, 12:55 PM

Thank you for that input Josh. I saw some VSCode extension (https://marketplace.visualstudio.com/items?itemName=yawarjamal.cf-d1) that purports to do just that but I'm hesitant to use it.

Cloudflare D1 - Visual Studio Marketplace

Extension for Visual Studio Code - Explore and query Cloudflare D1 databases

AngusMa•5/11/24, 3:37 PM

I’m sure I bound the database in wrangler.tomlwrangler.toml correctly, and a table named recordrecord is in the database.
Why can’t it found the table?

AngusMa•5/11/24, 3:43 PM

Yeah I forgot it.
It had been a long time since I edited the code last time.

Codename_A•5/11/24, 6:27 PM

npx wrangler d1 execute hadith-db --file=db.sql

it complains about my db size. The db size is about 58 mb and there are some long entries. I really want to use d1 as I am using cf for other stuff. Is there a way to do this?

wrangler-2024-05-11_18-16-55_223.log2.33KB

MMurder Chicken Bummer. I was hoping something might have popped up in the community in the las...

IEatBeans•5/11/24, 9:21 PM

I use a project called d1 manager on GitHub. It’s very basic but is good enough (better than the one on the cf dashboard)

MMurder Chicken Thank you for that input Josh. I saw some VSCode extension (https://marketplace...

IEatBeans•5/11/24, 9:21 PM

That looks cool, did you ever try it?

Alec | Kriebel LLC.•5/12/24, 5:32 PM

On May 5th, some of my D1 queries spuriously started failing with:

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.`

D1_ERROR: Internal error while starting up D1 storage caused object to be reset.`

I don't see any other mentions of this and there were no incidents declared during this time. Anyone know what happened here?

IIEatBeans That looks cool, did you ever try it?

Murder Chicken•5/12/24, 11:08 PM

I did not. It didn't have any kind of feedback that I could see and so I didn't dive into it.

Martial•5/13/24, 12:47 AM

I am not sure to understand the purpose of the D1 database, the 10GB limit seems rather low for a serverless database. How I am supposed to go beyond that limit?

MMartial I am not sure to understand the purpose of the D1 database, the 10GB limit seems...

IEatBeans•5/13/24, 3:10 AM

You are supposed to use many databases. I think you can have like thousands bound to a worker

MetalGear•5/14/24, 4:33 AM

I am building a hotel booking system. I am building the backend with cloudflare workers and wondering if my sql database should be D1 or supabase postgres. I would prefer to stay within cloudflare ecosystem but saw some older posts people reporting serious latency. Today is D1 ready? Thinking to have a D1 per tenant to store their bookings and etc. What do I do as I get closer to 10gb limit? Offload to planetscale?

Oom Per tenant. 🤔. Think about it. 10gb is a lot.. i realised it later. You can sto...

MetalGear•5/14/24, 2:16 PM

Wow please stop ur getting me too excited

what is your typical latency calling d1 from a worker by binding

MetalGear•5/14/24, 2:18 PM

Also do you recommend drizzzle orm

MetalGear•5/14/24, 2:19 PM

Wow nice okay

MetalGear•5/14/24, 2:19 PM

At this point cloudflare workers can literally do everything

MetalGear•5/14/24, 2:20 PM

I was going to build with nest js typical server but really not trying to manage all that. Cloudflare really can’t make it any easier

Oom Per tenant. 🤔. Think about it. 10gb is a lot.. i realised it later. You can sto...

Jadugar_Jaggu•5/14/24, 5:08 PM

10GB ? in docs it says 5 GB storage.

https://developers.cloudflare.com/d1/platform/pricing/

Am I missing something?

Cloudflare Docs

Pricing · Cloudflare D1 docs

D1 bills based on:

Jadugar_Jaggu•5/14/24, 5:12 PM

Great, looks like they forgot to update the 5 to 10 GB on the pricing page

JJadugar_Jaggu Great, looks like they forgot to update the 5 to 10 GB on the pricing page

Chaika•5/14/24, 5:31 PM

no, you just get 5gb for free on free plan and 5gb included on paid plan

Chaika•5/14/24, 5:31 PM

unless I'm missing something else you're talking about

Chaika•5/14/24, 5:32 PM

The free limit is 5 GB for free, spread across 10 max DBs with 500 mb max per each

CChaika unless I'm missing something else you're talking about

Jadugar_Jaggu•5/14/24, 5:32 PM

Yea I got it. I was confused with limits and pricing

matt•5/15/24, 4:28 AM

Are there any updates to a lot of the D1 features mentioned during developer week?

Mmatt Are there any updates to a lot of the D1 features mentioned during developer wee...

Vy•5/15/24, 2:46 PM

we're deep into read replication, targetted for Q3

Marcel Overdijk•5/15/24, 6:42 PM

Would it be an idea to create a d1-databased1-database help channel which support threads? So answered topics can be archived.
I'm asking as questions/discussions in this channel are not really trackable...

Marcel Overdijk•5/15/24, 6:43 PM

E.g. the disucssion I had about the rows_readrows_read in case of counts is completely snowed under...

Marcel Overdijk•5/15/24, 6:43 PM

Or should I create an issue somewhere else for this?

MMarcel Overdijk I assume 174 + 1 as it accesses the index? But anyway, I cannot seem to get coun...

Matt Silverlock•5/15/24, 9:44 PM

Indexes don’t store row counts. It’s not possible to do a countcount and get one row read back in SQLite (the query engine D1 uses). Keep in mind you also get 25 billion reads included in the paid plan

MMarcel Overdijk I assume 174 + 1 as it accesses the index? But anyway, I cannot seem to get coun...

Matt Silverlock•5/15/24, 9:46 PM

https://marc.info/?l=sqlite-users&m=112679232205850

johtso•5/15/24, 11:43 PM

I'm getting a "D1_ERROR: no such table" error when running my worker locally. I've applied my migrations and have checked the table exists using "PRAGMA table_list;". The database id is definitely the same as the one that wrangler says it's binding to. Is there anything else I can check?

johtso•5/15/24, 11:49 PM

when I try to list the tables from my worker there seem to be none at all (just _cf_KV, sqlite_schema and sqlite_temp_schema)

Oh nevermind 1200 req per 5min limit, so it's impossible in production. Ok got it.

Similar Threads

Similar Threads

Similar Threads