could you send me your account id please?

WWalshy could you send me your account id please?

SteffTek•11/22/24, 9:05 AM

Sure! Account ID is f61e2912c0937987fbd186d3523dc847 and our Dev Worker is called "worker-customer-devinc" (screenshot above is from one of our tenants)

WalshyOP•11/22/24, 9:05 AM

Thanks let me take a look

WalshyOP•11/22/24, 9:14 AM

So, it looks like smart placement was re-enabled 30 mins ago and yeah, so far it doesn't have enough requests

WWalshy So, it looks like smart placement was re-enabled 30 mins ago and yeah, so far it...

SteffTek•11/22/24, 9:14 AM

yeah i did it (a few times in fact) to see if it reappears

SteffTek•11/22/24, 9:14 AM

the other worker hadn't hat it reenabled and doesnt have it either

WalshyOP•11/22/24, 9:15 AM

I can check that one too, what's it called?

SteffTek•11/22/24, 9:15 AM

worker-customer-***

SteffTek•11/22/24, 9:15 AM

last deployment there was a month ago

WalshyOP•11/22/24, 9:18 AM

It looks like that also has pretty minimal traffic. looks like it was placed on the 13th and then not on the 15th - let me see what changed

SteffTek•11/22/24, 9:19 AM

Thx! The problem is each of our tenants won't have much traffic. we are a cloudbased cash register provider, so we only have a limited amount of users per tenant

WalshyOP•11/22/24, 9:21 AM

Ok I see what changed.. figuring out why

WalshyOP•11/22/24, 9:25 AM

Ok yep, looks like an issue our side - gonna let the team know!
Thanks for reporting, we'll get it fixed!

WWalshy Ok yep, looks like an issue our side - gonna let the team know! Thanks for repor...

SteffTek•11/22/24, 9:25 AM

<3 Thank you!!!

Kimitri•11/22/24, 9:43 AM

can someone help me with this. I'm trying to connect vitest with D1 local generated by wrangler dev, but it's not working, I use Vitest-pool-workers to do it with this configuration:

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config";

export default defineWorkersConfig({
  
  test: {
    globals: true,
    poolOptions: {
      workers: {
        isolatedStorage: true,
        wrangler: { configPath: "./wrangler.toml" },
      },
    },
  },
});

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config";

export default defineWorkersConfig({
  
  test: {
    globals: true,
    poolOptions: {
      workers: {
        isolatedStorage: true,
        wrangler: { configPath: "./wrangler.toml" },
      },
    },
  },
});

and to ensure I tried to show in the logs like this

import { Hono } from 'hono'

export type Env = {
  DB: D1Database
}
const app = new Hono<{ Bindings: Env}>()

app.get('/', async (c) => {

  console.log(c.env.DB)

  return c.text("Hello world!")
})

export default app

import { Hono } from 'hono'

export type Env = {
  DB: D1Database
}
const app = new Hono<{ Bindings: Env}>()

app.get('/', async (c) => {

  console.log(c.env.DB)

  return c.text("Hello world!")
})

export default app

and it's show undefined, it just show some data when I run wrangler dev,

andifined.dev•11/22/24, 10:33 AM

Is it possible to increase the 10 gb Limit d1 has currently?

Aandifined.dev Is it possible to increase the 10 gb Limit d1 has currently?

1984 Ford Laser•11/22/24, 10:39 AM

In the docs: https://developers.cloudflare.com/d1/platform/limits/

Cloudflare Docs

Limits | Cloudflare D1 docs

Cloudflare also offers other storage solutions such as Workers KV, Durable Objects, and R2. Each product has different advantages and limits. Refer to Choose a data or storage product to review which storage option is right for your use case.

andifined.dev•11/22/24, 10:40 AM

Yes, already read that, but was not sure if applicable to the db limit in General too. Thanks!

Aandifined.dev Yes, already read that, but was not sure if applicable to the db limit in Genera...

1984 Ford Laser•11/22/24, 10:47 AM

I think most of the limits can be increased, its mostly about being able to justify your use case. If you need the 10GB DB limit raised, you would probably want the 250GB account limit raised too?

andifined.dev•11/22/24, 10:48 AM

Don‘t know yet, just exploring possibilities. And if there’s no hard cap that can’t be raised, d1 seems good to go

Aandifined.dev Don‘t know yet, just exploring possibilities. And if there’s no hard cap that ca...

1984 Ford Laser•11/22/24, 10:49 AM

If you are storing close top 10GB in a single DB, there is probably a better way to store/split the data up. If you do ever need the limit increased, I'd be asking way in advance

Wes•11/22/24, 9:37 PM

Hi all. Does anyone know/heard if there are any plans to run D1 in

sam

sam

? It just says it's not available but no comments on weather there are plans or not. (https://developers.cloudflare.com/d1/configuration/data-location/#available-location-hints)

SSteffTek <3 Thank you!!!

WalshyOP•11/23/24, 1:13 AM

Heyo, sorry for not getting back sooner - just lots of other stuff going on

Eng released a fix and I can see your Workers being placed again

WWalshy Heyo, sorry for not getting back sooner - just lots of other stuff going on Eng...

SteffTek•11/23/24, 9:04 AM

Thx! I can confirm for our test tenant, but not the prod one. Still says insufficient invocations

after testing, the responsetime of our test tenant is back to the original ^^

Kotkoroid•11/23/24, 9:21 AM

Hey, where do I find D1 repository? Couldn't find it on GitHub.

James•11/23/24, 4:17 PM

For what specifically? You'll find some of D1 source in the

workerd

workerd

repo like https://github.com/cloudflare/workerd/blob/main/src/workerd/util/sqlite.c%2B%2B, but if you're new to D1, the Getting Started guide is going to the best place to start: https://developers.cloudflare.com/d1/get-started/

Cloudflare Docs

Get started | Cloudflare D1 docs

This guide instructs you through:

TOPGUN•11/23/24, 7:40 PM

Hello everyone,

Quick question. Is D1 a suitable backend database for a financial wallet web application? i.e. ensuring consistency across users funds balances / withdrawing funds and depositing funds reflect consistently across all users of the wallet app. Is D1 sufficient for this use case? or will i need a Postgres db for example?

Thanks,

JJames For what specifically? You'll find some of D1 source in the `workerd` repo like ...

Kotkoroid•11/23/24, 7:40 PM

Specifically for the D1 engine. Afaik it's an extension of SQLite engine.

TTOPGUN Hello everyone, Quick question. Is D1 a suitable backend database for a financ...

Larry•11/23/24, 8:53 PM

From a consistency perspective, D1 is on par with Postgres. Reliability and recoverability are more a function of how each is hosted and Cloudflare is well above average on this front. The biggest difference is scaling both in size and throughput. D1 maxes out at 10GB. Postgres DBs can be TBs. Similarly, D1 also has significant throughput scaling limitations compared to Postgres and I suspect that will continue even after D1 is upgraded to support read replicas.

LLarry From a consistency perspective, D1 is on par with Postgres. Reliability and reco...

João Castro•11/23/24, 9:30 PM

I remember reading a message about "unlimited read throughput" once read replicas arrive. But writes would still have the same throughput limitations as it has today.

JJoão Castro I remember reading a message about "unlimited read throughput" once read replica...

Larry•11/23/24, 11:01 PM

That's good news. I hadn't read that.

ella•11/24/24, 2:30 PM

is d1 down? i keep getting auth errors

ella•11/24/24, 2:32 PM

@Walshy ?

Flare•11/24/24, 2:35 PM

Please do not ping community members for non-moderation reasons. Doing so will not solve your issue faster and will make people less likely to want to help you.

Vlady•11/24/24, 3:07 PM

Hi y'all, what's the latest news on transaction support?
I'm using the Drizzle ORM and transactions don't work there: https://github.com/drizzle-team/drizzle-orm/issues/2463

GitHub

[BUG]: Cloudflare D1 transaction not supported · Issue #2463 · driz...

What version of drizzle-orm are you using? 0.31.1 What version of drizzle-kit are you using? 0.22.2 Describe the Bug When trying to execute a transacction with cloudflare d1 adapter it throws the f...

elpupper•11/24/24, 3:36 PM

how do i force a schema change? I added autoincrement like a noob

maco6517•11/24/24, 6:12 PM

helpme

Mmaco6517 helpme

Isaac McFadyen•11/24/24, 6:47 PM

This is the Cloudflare D1 channel, unrelated to MySQL. I'd recommend positing in #off-topic, but at the same time, there's not much we can do to help with a single screenshot of a MySQL process using a lot of resources.

rumata•11/25/24, 12:55 AM

hi. i've been trying to make d1 work in rust with bigint (i64) data types, and i keep getting this error: Error: Error: D1_TYPE_ERROR: Type 'bigint' not supported for value '300' - Cause: Error: D1_TYPE_ERROR: Type 'bigint' not supported for value '300'. what am i missing?

Rrumata hi. i've been trying to make d1 work in rust with bigint (i64) data types, and i...

lambrospetrou•11/25/24, 9:51 AM

D1 is based on SQLite, so these are the types you can use: https://www.sqlite.org/datatype3.html
Not sure how Rust is involved in your code, but

bigint

bigint

is not a valid SQLite type and gets converted to one of the native ones, in this case

INTEGER

INTEGER

.

How are you using Rust, are you using the D1 Worker binding with Rust WASM, or something else?
That error is coming from the D1 Worker binding, so it expects JS types.

rumata•11/25/24, 12:30 PM

yes, i am using d1 worker with rust and i have a i64 variable, i am trying to bind to an Integer column when i get this error. Here is the code and schema:
Drop Table Test;
CREATE TABLE IF NOT EXISTS Test (
Id TEXT PRIMARY KEY NOT NULL,
Value INTEGER NOT NULL
);

rumata•11/25/24, 12:30 PM

let d1 = ctx.env.d1("DB")?;
let statement = d1.prepare("INSERT INTO Test (Id, Value) VALUES (?1, ?2)");
let v: i64 = 300;
let query = statement.bind(&["abc".into(),
v.into()])?;
let result = query.run().await?;
console_log!("result: {:?}", result.success());

rumata•11/25/24, 12:51 PM

i think i figured this out - i have to convert everything to string on rust side - and then despite things being strings, d1 interprets them correctly as integer of varying size.

Rrumata i think i figured this out - i have to convert everything to string on rust side...

lambrospetrou•11/25/24, 1:13 PM

Are you sure they are written as integers though? SQLite non-strict tables accept anything you give them regardless of the column type. I would suggest converting the i64 into a normal integer before passed to the statement bind call. Maybe this works, and you will keep them as integers.

Christian•11/26/24, 8:58 PM

Super weird issue but could it be that the Cloudflare D1 export via

npx wrangler d1 export dharmaradio --remote --output=dump.sql

npx wrangler d1 export dharmaradio --remote --output=dump.sql

creates a dump which can't be imported again via

npx wrangler d1 execute dharmaradio --remote --file=dump.sql

npx wrangler d1 execute dharmaradio --remote --file=dump.sql

.

The first issue is that datetime fields aren't put under quotes. After fixing that via multi-cursor editing I'm getting the following error

{"D1_RESET_DO":true}

{"D1_RESET_DO":true}

.

I know D1 is still new but I would expect that I could import the dump I exported via it.

Original message was deleted

Christian•11/26/24, 9:12 PM

40mb but that doesn't explain why the export can't be imported

Original message was deleted

Christian•11/26/24, 9:23 PM

No, it first fails on parsing the sql because of the missing quotes around the dates. Once i fixed that it succeeds parsing the sql and then breaks with the d1_reset_do error.

I wrote a script to chunk the inserts in the dump so hopefully that works out but the export 100% has some issue

GooningChatter•11/26/24, 10:27 PM

(In this screenshot

ENAM_OBJECTS

ENAM_OBJECTS

is an empty database in a closer pop than

ENAM_USERS

ENAM_USERS

. Same with the

WNAM

WNAM

databases)

GooningChatter•11/26/24, 10:44 PM

It's especially apparent when on average it's this drastic

dev•11/27/24, 12:26 AM

I need to specify where my D1 database will be located. As in, it needs to be in Canada. Is it possible? I can only see location hints but I don't think that's enough due to legal reasons

import { defineWorkersConfig } from "@cloudflare/vitest-pool-workers/config"; export default defineWorkersConfig({ test: { globals: true, poolOptions: { workers: { isolatedStorage: true, wrangler: { configPath: "./wrangler.toml" }, }, }, }, });

import { Hono } from 'hono' export type Env = { DB: D1Database } const app = new Hono<{ Bindings: Env}>() app.get('/', async (c) => { console.log(c.env.DB) return c.text("Hello world!") }) export default app

could you send me your account id please?

Similar Threads

Similar Threads

Similar Threads