please read before replying. https://discord.com/channels/595317990191398933/992060581832032316/1259

Lluna please read before replying. https://discord.com/channels/595317990191398933/992...

M

I'm not giving any feedback or discussing the merits of it, i am just highlighting the reason behind it to educate, so that others facing similar issue would get what to do.

L

lunaOP•7/9/24, 4:02 AM

i already know the issue. as stated right from the beginning. please stop trying to add to an already finished conversation. a mod has already said this.

L

lunaOP•7/9/24, 4:02 AM

you’re now the third person todo this.

C

Codename_A•7/9/24, 5:58 AM

Excecuting remotely is giving me the error

X [ERROR] not authorized

X [ERROR] not authorized

X [ERROR] not authorized

X [ERROR] not authorized

C

Codename_A•7/9/24, 5:59 AM

The log

wrangler-2024-07-09_05-59-26_126.log4.96KB

C

Codename_A•7/9/24, 6:02 AM

Could it be a malformed sql file somehow?

C

Codename_A•7/9/24, 6:03 AM

here is the start of the sqlite file:

PRAGMA journal_mode = MEMORY;
PRAGMA synchronous = OFF;
PRAGMA foreign_keys = OFF;
PRAGMA ignore_check_constraints = OFF;
PRAGMA auto_vacuum = NONE;
PRAGMA secure_delete = OFF;

#=====================================================================
#
#  Quran Translation
#  Name: Pickthall
#  Translator: Mohammed Marmaduke William Pickthall
#  Language: English
#  ID: en.pickthall
#  Last Update: September 4, 2010
#  Source: Tanzil.net
#
#=====================================================================
# CREATE DATABASE IF NOT EXISTS `quran`
# USE `quran`;
DROP TABLE IF EXISTS `en_pickthall`;

CREATE TABLE `en_pickthall` (
`index` INTEGER NOT NULL ,
`sura` INTEGER NOT NULL default '0',
`aya` INTEGER NOT NULL default '0',
`text` text NOT NULL,
PRIMARY KEY  (`index`)
);
INSERT INTO `en_pickthall` (`index`, `sura`, `aya`, `text`) VALUES
(1, 1, 1, 'In the name of Allah, the Beneficent, the Merciful.'),
(2, 1, 2, 'Praise be to Allah, Lord of the Worlds,'),
(3, 1, 3, 'The Beneficent, the Merciful.'),
(4, 1, 4, 'Master of the Day of Judgment,'),
(5, 1, 5, 'Thee (alone) we worship; Thee (alone) we ask for help.'),
(6, 1, 6, 'Show us the straight path,'),

PRAGMA journal_mode = MEMORY;
PRAGMA synchronous = OFF;
PRAGMA foreign_keys = OFF;
PRAGMA ignore_check_constraints = OFF;
PRAGMA auto_vacuum = NONE;
PRAGMA secure_delete = OFF;

#=====================================================================
#
#  Quran Translation
#  Name: Pickthall
#  Translator: Mohammed Marmaduke William Pickthall
#  Language: English
#  ID: en.pickthall
#  Last Update: September 4, 2010
#  Source: Tanzil.net
#
#=====================================================================
# CREATE DATABASE IF NOT EXISTS `quran`
# USE `quran`;
DROP TABLE IF EXISTS `en_pickthall`;

CREATE TABLE `en_pickthall` (
`index` INTEGER NOT NULL ,
`sura` INTEGER NOT NULL default '0',
`aya` INTEGER NOT NULL default '0',
`text` text NOT NULL,
PRIMARY KEY  (`index`)
);
INSERT INTO `en_pickthall` (`index`, `sura`, `aya`, `text`) VALUES
(1, 1, 1, 'In the name of Allah, the Beneficent, the Merciful.'),
(2, 1, 2, 'Praise be to Allah, Lord of the Worlds,'),
(3, 1, 3, 'The Beneficent, the Merciful.'),
(4, 1, 4, 'Master of the Day of Judgment,'),
(5, 1, 5, 'Thee (alone) we worship; Thee (alone) we ask for help.'),
(6, 1, 6, 'Show us the straight path,'),

PRAGMA journal_mode = MEMORY;
PRAGMA synchronous = OFF;
PRAGMA foreign_keys = OFF;
PRAGMA ignore_check_constraints = OFF;
PRAGMA auto_vacuum = NONE;
PRAGMA secure_delete = OFF;

#=====================================================================
#
#  Quran Translation
#  Name: Pickthall
#  Translator: Mohammed Marmaduke William Pickthall
#  Language: English
#  ID: en.pickthall
#  Last Update: September 4, 2010
#  Source: Tanzil.net
#
#=====================================================================
# CREATE DATABASE IF NOT EXISTS `quran`
# USE `quran`;
DROP TABLE IF EXISTS `en_pickthall`;

CREATE TABLE `en_pickthall` (
`index` INTEGER NOT NULL ,
`sura` INTEGER NOT NULL default '0',
`aya` INTEGER NOT NULL default '0',
`text` text NOT NULL,
PRIMARY KEY  (`index`)
);
INSERT INTO `en_pickthall` (`index`, `sura`, `aya`, `text`) VALUES
(1, 1, 1, 'In the name of Allah, the Beneficent, the Merciful.'),
(2, 1, 2, 'Praise be to Allah, Lord of the Worlds,'),
(3, 1, 3, 'The Beneficent, the Merciful.'),
(4, 1, 4, 'Master of the Day of Judgment,'),
(5, 1, 5, 'Thee (alone) we worship; Thee (alone) we ask for help.'),
(6, 1, 6, 'Show us the straight path,'),

PRAGMA journal_mode = MEMORY;
PRAGMA synchronous = OFF;
PRAGMA foreign_keys = OFF;
PRAGMA ignore_check_constraints = OFF;
PRAGMA auto_vacuum = NONE;
PRAGMA secure_delete = OFF;

#=====================================================================
#
#  Quran Translation
#  Name: Pickthall
#  Translator: Mohammed Marmaduke William Pickthall
#  Language: English
#  ID: en.pickthall
#  Last Update: September 4, 2010
#  Source: Tanzil.net
#
#=====================================================================
# CREATE DATABASE IF NOT EXISTS `quran`
# USE `quran`;
DROP TABLE IF EXISTS `en_pickthall`;

CREATE TABLE `en_pickthall` (
`index` INTEGER NOT NULL ,
`sura` INTEGER NOT NULL default '0',
`aya` INTEGER NOT NULL default '0',
`text` text NOT NULL,
PRIMARY KEY  (`index`)
);
INSERT INTO `en_pickthall` (`index`, `sura`, `aya`, `text`) VALUES
(1, 1, 1, 'In the name of Allah, the Beneficent, the Merciful.'),
(2, 1, 2, 'Praise be to Allah, Lord of the Worlds,'),
(3, 1, 3, 'The Beneficent, the Merciful.'),
(4, 1, 4, 'Master of the Day of Judgment,'),
(5, 1, 5, 'Thee (alone) we worship; Thee (alone) we ask for help.'),
(6, 1, 6, 'Show us the straight path,'),

D

Disciple of Caoximeihao•7/9/24, 8:05 AM

can i use d1 and not create worker is it possible?

DDisciple of Caoximeihao can i use d1 and not create worker is it possible?

H

harshil1712•7/9/24, 9:47 AM

You want to use D1 outside of a worker/pages project? Did I understand it correctly?

CCodename_A here is the start of the sqlite file: ``` PRAGMA journal_mode = MEMORY; PRAGMA s...

M

Max (@rozenmd)•7/9/24, 11:45 AM

remove the PRAGMAs and comment block, should work

DDisciple of Caoximeihao can i use d1 and not create worker is it possible?

M

Max (@rozenmd)•7/9/24, 11:45 AM

Possible yes, but not performant

AAskar MrMirql Hi Guys! what do you think? is d1 database is capable of working with highload o...

M

Max (@rozenmd)•7/9/24, 11:51 AM

At the moment each D1 db depends on a single DO thread, meaning you can run into performance issues at around 500-800 requests per second, depending on the query (faster queries = more performance)

AAskar MrMirql thanks! what about concurrent operations, race conditions, transactions? i think...

M

Max (@rozenmd)•7/9/24, 11:56 AM

D1's storage implementation uses WAL mode

WAL provides more concurrency as readers do not block writers and a writer does not block readers. Reading and writing can proceed concurrently.

https://www.sqlite.org/wal.html

you may also want to read https://developers.cloudflare.com/d1/build-with-d1/d1-client-api/#batch-statements

S

Sheha•7/9/24, 1:48 PM

Just asking. Whats the size limit of a single D1 database ? is it 5 Gigs or 500 MB ?

SSheha Just asking. Whats the size limit of a single D1 database ? is it 5 Gigs or 500 ...

C

Chaika•7/9/24, 1:52 PM

Maximum database size 10 GB (Workers Paid) / 500 MB (Free)
https://developers.cloudflare.com/d1/platform/limits/

CChaika Maximum database size 10 GB (Workers Paid) / 500 MB (Free) <https://developer...

S

Sheha•7/9/24, 2:40 PM

are these sizes per DB or is that the total size ?

SSheha are these sizes per DB or is that the total size ?

C

Chaika•7/9/24, 2:40 PM

that is the max size for a single database. In that link you can see the account-wide limit
Maximum storage per account 250 GB (Workers Paid)1 / 5 GB (Free)

S

Sheha•7/9/24, 2:41 PM

ahh okay. Thanks.

S

Sheha•7/9/24, 2:41 PM

MMax (@rozenmd)remove the PRAGMAs and comment block, should work

C

Codename_A•7/9/24, 4:52 PM

should this be stated in the docs or is this an error on my end? I as following this here: https://developers.cloudflare.com/d1/build-with-d1/import-export-data/#convert-sqlite-database-files

Cloudflare Docs

Import and export data · Cloudflare D1 docs

D1 allows you to import existing SQLite tables and their data directly, enabling you to migrate existing data into D1 quickly and easily. This can be …

CCodename_A should this be stated in the docs or is this an error on my end? I as following ...

M

Max (@rozenmd)•7/9/24, 4:58 PM

true, should be documented

MMax (@rozenmd)true, should be documented

C

Codename_A•7/9/24, 5:00 PM

And the error was basically useless. I think some more details could be better

布

布鲁诺普雷托•7/10/24, 12:50 AM

Question

布

布鲁诺普雷托•7/10/24, 12:50 AM

Screenshot_2024-07-10-01-45-09-873_com.android.chrome.jpg

布

布鲁诺普雷托•7/10/24, 12:50 AM

The paid version shouldn't be 25M per day?

布

布鲁诺普雷托•7/10/24, 12:51 AM

Cuz otherwise the free is cheaper

布

布鲁诺普雷托•7/10/24, 12:51 AM

Nvm

布

布鲁诺普雷托•7/10/24, 12:51 AM

I'm dumb

C

Codename_A•7/10/24, 5:06 AM

fixed it

C

Codename_A•7/10/24, 5:06 AM

idk what I did but its working now

C

Codename_A•7/10/24, 5:06 AM

¯\_(ツ)_/¯

S

Sheha•7/10/24, 7:14 AM

Just wondering... What is the error message returned when I try to write something using my cloudflare worker application to a D1 database that is full?

V

Vikash•7/10/24, 10:47 AM

What is

D1_ERROR: Failed to parse body as JSON

D1_ERROR: Failed to parse body as JSON

D1_ERROR: Failed to parse body as JSON

D1_ERROR: Failed to parse body as JSON i get randomly on my query

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

const sqlQuery = env.DB.prepare(
    `SELECT * FROM Resources WHERE resource_id = ? and account_id = ?`
  ).bind(resourceId, authUser.account_id);
  const resource = await sqlQuery.first<Resource>();

VVikash What is `D1_ERROR: Failed to parse body as JSON` i get randomly on my query ```...

布

布鲁诺普雷托•7/10/24, 4:47 PM

Use ?1 and ?2

布

布鲁诺普雷托•7/10/24, 4:48 PM

Also on a console log check the type of each variable

布

布鲁诺普雷托•7/10/24, 4:48 PM

It has to be string

VVikash What is `D1_ERROR: Failed to parse body as JSON` i get randomly on my query ```...

布

布鲁诺普雷托•7/10/24, 4:48 PM

Perhaps you missed a JSON.parse()

布

布鲁诺普雷托•7/10/24, 4:52 PM

Yo cloudflare people, is there any limitation in just using the D1 that comes with Cloudflare, I mean instead of using posgress or wtv... I've just been using env.db.prepare(query) is it enough for most of SQL queries?

布布鲁诺普雷托 Use ?1 and ?2

V

Vikash•7/10/24, 5:18 PM

The same query is working in production, so no issue in code. I just see 3-4 such errors on global error handler out of 200k requests daily

V

Vikash•7/10/24, 5:19 PM

The error is D1 type and not in my code

布

布鲁诺普雷托•7/10/24, 6:15 PM

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

MERGE INTO pt_player_tribe AS target
USING (SELECT ?1 AS player_id, ?2 AS tribe_id, ?3 AS world) AS source
ON (target.player_id = source.player_id AND target.world = source.world)
WHEN MATCHED AND target.tribe_id <> source.tribe_id THEN
    UPDATE SET tribe_id = source.tribe_id
WHEN NOT MATCHED THEN
    INSERT (player_id, world, tribe_id)
    VALUES (source.player_id, source.world, source.tribe_id);

Is this ok to run or the Values should also be with "?" ?

please read before replying. https://discord.com/channels/595317990191398933/992060581832032316/1259

Similar Threads