It looks great to make d1 a “schema-less” database, but performance is important
It looks great to make d1 a “schema-less” database, but performance is important
MSadly seeing very random
Sometimes it responds within 150ms, other times it errors
Error: D1_ERRORSometimes it responds within 150ms, other times it errors
MDid anything regarding the non-experimental D1 change today as well?
This is the file it's failing in: https://github.com/leonlarsson/bfstats-api/blob/main/handlers/cacheD1.ts
This is the file it's failing in: https://github.com/leonlarsson/bfstats-api/blob/main/handlers/cacheD1.ts
MSpecifically started having issues around this time
MNothing regarding the original alpha changed (at all).
MIf your database has grown, then it's likely you're just running into the limitations of the original alpha
MIt's going to really depend on what you're querying and what the shape of the objects you're using is. You also need to take into account the benefits of doing this in your database vs. in your application.
MCan you share more information please? Specifically: your database ID, the query itself (with any PII redacted), and whether this is repeatable?
S@elithrar just read the blog on D1 updates, great job guys, its looking promising. I have been waiting to hear about how we can create database per customer, however, nothing was mentioned about that in the blog. are you guys still considering that in near future or that will be available after GA?
MHmm, it doesn't grow super quickly. Maybe a huge coincidence then
MThe entire DB is about 9mb
MWe'll be increasing limits (on DB size and total # of DBs) over the coming months. Are you using Workers for Platforms?
MThanks. Looking into it. May not be a quick fix.
DI might be 
MD1 Beta doesn't like it either 
MMCoincidence or not, I just got the same error in a completely different place: https://github.com/leonlarsson/bfstats-api/blob/main/handlers/D1Handler.ts#L58
JTrying to load my alpha db dump into the new backend via wrangler, with 27k or so lines, first just hung as it did for @mozzy , tried breaking into a file with 4999 lines, now getting
JTried pasting entire 27k sql lines into the web console, after a minute or two all the statements showed up in the console but the last line is again:
statement too long
NI'm confused about the db size limits. The blog says in the pricing that 1GB is available to free users and 5GB included and $0.75/GB beyond that.
But then it says "Developerson the Workers Paid plan will get access to 1GB dbs in the very near future".
Does this mean that the limit is currently still 100mb, will soon be 1Gb and later will change to what the pricing shows?
But then it says "Developerson the Workers Paid plan will get access to 1GB dbs in the very near future".
Does this mean that the limit is currently still 100mb, will soon be 1Gb and later will change to what the pricing shows?
Bmaybe a better approach would be dbs per regional area
Bwhen a user creates their account, pick a db based on their geography to route to, and always use that db for that user
Bdepending on how far you want to take that, you could do an NA region, EU region and Asia region for example, or more
BLocation Hints will allow you to peg where the write region is placed
IYes. Limit is still 100mb, will be raised to 1GB, and then likely further eventually.
IYes it's possible but undocumented as far as I know (and the API is slower than D1 from a Worker)
UCurrently in alpha it is free to use and limited to 100mb. In the future those payment plans will come into play and the limits for dbs will be higher
II(think those endpoints should still work)
NThanks! Very exciting stuff
MYep, you can bind to a D1 DB from multiple Workers, just like Queues/KV/R2/etc.
JLooks like it was one of the statements in my dumped/converted .sql file that was inserting a very long binary blob and this was throwing the error. If I skipped that insert statement, the rest of it imported alright
MAny ideas what might be causing this or a way to debug this issue a bit more? https://github.com/cloudflare/workers-sdk/issues/3294
GitHub
Which Cloudflare product(s) does this pertain to? Wrangler What version of Wrangler are you using? 3.0.0 What operating system are you using? Windows Describe the Bug create a fresh D1 local DB wit...
MHow long? https://developers.cloudflare.com/d1/platform/limits/
- I bet you hit the max row length with a big blob. Would be helpful to know so we can think about adjusting over time.
J267k characters
Joh yeah i see the max statement length is 100kb
JIt's interesting that it let me insert that row initially from within the worker, but not via wrangler or the console
M- Right now, deletes are treated as writes. Subject to change. Unless you're deleting a LOT of data, all the time, I'd be very surprised if your write+delete costs on D1 exceeded DO.
- No limit on tables, but any table is non-zero bytes (to store the schema and allocate storage for an empty table). If an empty table is ~4KB or so you could have thousands of empty tables with no data, if you really desired to do so
