At the moment each D1 db depends on a single DO thread, meaning you can run into performance issues

At the moment each D1 db depends on a single DO thread, meaning you can run into performance issues at around 500-800 requests per second, depending on the query (faster queries = more performance)

AAskar MrMirql thanks! what about concurrent operations, race conditions, transactions? i think...

Max (@rozenmd)OP•7/9/24, 11:56 AM

D1's storage implementation uses WAL mode

WAL provides more concurrency as readers do not block writers and a writer does not block readers. Reading and writing can proceed concurrently.

https://www.sqlite.org/wal.html

you may also want to read https://developers.cloudflare.com/d1/build-with-d1/d1-client-api/#batch-statements

Sheha•7/9/24, 1:48 PM

Just asking. Whats the size limit of a single D1 database ? is it 5 Gigs or 500 MB ?

SSheha Just asking. Whats the size limit of a single D1 database ? is it 5 Gigs or 500 ...

Chaika•7/9/24, 1:52 PM

Maximum database size 10 GB (Workers Paid) / 500 MB (Free)
https://developers.cloudflare.com/d1/platform/limits/

CChaika Maximum database size 10 GB (Workers Paid) / 500 MB (Free) <https://developer...

Sheha•7/9/24, 2:40 PM

are these sizes per DB or is that the total size ?

SSheha are these sizes per DB or is that the total size ?

Chaika•7/9/24, 2:40 PM

that is the max size for a single database. In that link you can see the account-wide limit
Maximum storage per account 250 GB (Workers Paid)1 / 5 GB (Free)

Sheha•7/9/24, 2:41 PM

ahh okay. Thanks.

Sheha•7/9/24, 2:41 PM

MMax (@rozenmd)remove the PRAGMAs and comment block, should work

Codename_A•7/9/24, 4:52 PM

should this be stated in the docs or is this an error on my end? I as following this here: https://developers.cloudflare.com/d1/build-with-d1/import-export-data/#convert-sqlite-database-files

Cloudflare Docs

Import and export data · Cloudflare D1 docs

D1 allows you to import existing SQLite tables and their data directly, enabling you to migrate existing data into D1 quickly and easily. This can be …

CCodename_A should this be stated in the docs or is this an error on my end? I as following ...

Max (@rozenmd)OP•7/9/24, 4:58 PM

true, should be documented

MMax (@rozenmd)true, should be documented

Codename_A•7/9/24, 5:00 PM

And the error was basically useless. I think some more details could be better

布

布鲁诺普雷托•7/10/24, 12:50 AM

Question

布

布鲁诺普雷托•7/10/24, 12:50 AM

Screenshot_2024-07-10-01-45-09-873_com.android.chrome.jpg

布

布鲁诺普雷托•7/10/24, 12:50 AM

The paid version shouldn't be 25M per day?

布

布鲁诺普雷托•7/10/24, 12:51 AM

Cuz otherwise the free is cheaper

布

布鲁诺普雷托•7/10/24, 12:51 AM

Nvm

布

布鲁诺普雷托•7/10/24, 12:51 AM

I'm dumb

Codename_A•7/10/24, 5:06 AM

fixed it

Codename_A•7/10/24, 5:06 AM

idk what I did but its working now

Codename_A•7/10/24, 5:06 AM

¯\_(ツ)_/¯

Sheha•7/10/24, 7:14 AM

Just wondering... What is the error message returned when I try to write something using my cloudflare worker application to a D1 database that is full?

Vikash•7/10/24, 10:47 AM

What is D1_ERROR: Failed to parse body as JSOND1_ERROR: Failed to parse body as JSON i get randomly on my query

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

VVikash What is `D1_ERROR: Failed to parse body as JSON` i get randomly on my query ```...

布

布鲁诺普雷托•7/10/24, 4:47 PM

Use ?1 and ?2

布

布鲁诺普雷托•7/10/24, 4:48 PM

Also on a console log check the type of each variable

布

布鲁诺普雷托•7/10/24, 4:48 PM

It has to be string

VVikash What is `D1_ERROR: Failed to parse body as JSON` i get randomly on my query ```...

布

布鲁诺普雷托•7/10/24, 4:48 PM

Perhaps you missed a JSON.parse()

布

布鲁诺普雷托•7/10/24, 4:52 PM

Yo cloudflare people, is there any limitation in just using the D1 that comes with Cloudflare, I mean instead of using posgress or wtv... I've just been using env.db.prepare(query) is it enough for most of SQL queries?

布布鲁诺普雷托 Use ?1 and ?2

Vikash•7/10/24, 5:18 PM

The same query is working in production, so no issue in code. I just see 3-4 such errors on global error handler out of 200k requests daily

Vikash•7/10/24, 5:19 PM

The error is D1 type and not in my code

布

布鲁诺普雷托•7/10/24, 6:15 PM

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

Is this ok to run or the Values should also be with "?" ?

Codename_A•7/10/24, 9:21 PM

D1 export is not working. X [ERROR] near "index": syntax error at offset 7

I am confused as the d1 worker is functional so it doesn't make sense that there should be an error when exporting

Ppeshakoo How will read replication work in the future with important atomic/transactional...

Max (@rozenmd)OP•7/11/24, 5:27 AM

any breaking functionality will be strictly opt-in. code that works today will continue to work tomorrow by default

Ppeshakoo That's cool, as I'd like to opt-in 2/3 of my databases in the future. Any exampl...

Max (@rozenmd)OP•7/11/24, 5:30 AM

Yeah, we wrote about what we're building here: https://blog.cloudflare.com/building-d1-a-global-database

The Cloudflare Blog

Building D1: a Global Database

D1, Cloudflare’s SQL database, is now generally available. With new support for 10GB databases, data export, and enhanced query debugging, we empower developers to build production-ready applications with D1 to meet all their relational SQL needs

Tarnadas•7/11/24, 7:37 PM

Hey, I've been trying to understand the limitations of D1 when it comes to big integers, but I'm a bit clueless. I have to handle up to 16 byte integers in my application and to my understanding SQLite/D1 only supports 8 byte integer and there is no bigint type. However I've been storing values larger than the max value that can be represented via integer and it didn't throw an error.
How is this possible?

TTarnadas Hey, I've been trying to understand the limitations of D1 when it comes to big i...

i40west•7/11/24, 8:44 PM

If the value doesn't fit in a 64-bit integer it is converted to a REAL type, which is a 64-bit IEEE floating point value. This can precisely represent integers up to 2^53 and -2^53. Beyond that you will lose precision

i40west•7/11/24, 8:46 PM

You can store big integers as text or blob types, in which case the database won't be able to do calculations with them.

Ii40west If the value doesn't fit in a 64-bit integer it is converted to a REAL type, whi...

Tarnadas•7/12/24, 4:14 AM

thx, yeah I think this is happening

RRahul Is there any trigger function in Cloudflare worker when data changes in D1? like...

kraustifer•7/12/24, 5:32 AM

Not currently. They did mention this was a possibility in the future, though

MERGE INTO pt_player_tribe AS target USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source ON (target.player_id = source.player_id AND target.world = source.world) WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN UPDATE SET tribe_id = source.tribe_id WHEN NOT MATCHED THEN INSERT (player_id, world, tribe_id) VALUES (source.player_id, source.world, source.tribe_id);

At the moment each D1 db depends on a single DO thread, meaning you can run into performance issues

Similar Threads

Similar Threads

Similar Threads