Cloudflare Developers•3y ago

Is it possible we can just get the sqlite file? We are just trying to move off of this because it is

Is it possible we can just get the sqlite file? We are just trying to move off of this because it is unusable

Bbenthecarman Is it possible we can just get the sqlite file? We are just trying to move off o...

Matt Silverlock•9/24/23, 11:17 PM

There isn't the concept of a 'single SQLite file' in D1 (as that wouldn't allow us to be distributed).

Bbenthecarman Is it possible we can just get the sqlite file? We are just trying to move off o...

Matt Silverlock•9/24/23, 11:18 PM

And I understand the frustration: we don't want these kind of bugs, but this is an alpha/beta.

benthecarmanOP•9/24/23, 11:20 PM

okay, if guys can get it back up for a couple hours we can transfer off of it

Bbenthecarman okay, if guys can get it back up for a couple hours we can transfer off of it

Matt Silverlock•9/24/23, 11:41 PM

Can you confirm it's running now?

MMatt Silverlock Can you confirm it's running now?

benthecarmanOP•9/25/23, 12:04 AM

Back up, thanks

Mrxbox98•9/25/23, 12:30 AM

Is there a way to get a database size limit increase? I have a multi-gb sqlite database that I wish to use with d1.

MMrxbox98 Is there a way to get a database size limit increase? I have a multi-gb sqlite d...

benthecarmanOP•9/25/23, 12:40 AM

I wouldn't use d1, it only has like 20% uptime

Cyb3r-Jak3•9/25/23, 12:41 AM

I definitely doesn't have that low. I've been using it since the very start and had one issue

benthecarmanOP•9/25/23, 1:01 AM

we just had like a 20 hour downtime

Bbenthecarman Back up, thanks

captain•9/25/23, 1:07 AM

Just curious, have you been doing anything complicated with your DB, is it a big DB? I haven't been having any issues but would like to look ahead to understand posisble concerns. And you are seeing only 20% uptime?

Ccaptain Just curious, have you been doing anything complicated with your DB, is it a big...

benthecarmanOP•9/25/23, 1:09 AM

db is around 100mb, we basically just used it like a kv store for encrypted cloud storage

Bbenthecarman db is around 100mb, we basically just used it like a kv store for encrypted clou...

captain•9/25/23, 1:10 AM

was it on alpha or beta and did you find out why it went down?

captain•9/25/23, 1:10 AM

what errors did u get?

benthecarmanOP•9/25/23, 1:10 AM

20% is an exageration but it would go down for about a day every week

Ccaptain was it on alpha or beta and did you find out why it went down?

benthecarmanOP•9/25/23, 1:10 AM

CF doesn't tell us why, one said to stop using the product, we just can't connect to the db

Bbenthecarman CF doesn't tell us why, one said to stop using the product, we just can't connec...

captain•9/25/23, 1:11 AM

what region are you hinting with? I'm still on alpha but haven't had any downtime...ever. Was going to move it to beta DB today.

benthecarmanOP•9/25/23, 1:12 AM

we have people globally

Bbenthecarman we have people globally

captain•9/25/23, 1:12 AM

got it

captain•9/25/23, 1:13 AM

well hopefully they are seeing your bugs

benthecarmanOP•9/25/23, 1:13 AM

half the time they were unaware their system was down lol

captain•9/25/23, 1:16 AM

D1 is a game changer and so is workers, god speed!

benthecarmanOP•9/25/23, 1:16 AM

it would have been perfect for our usecase if it actually worked

captain•9/25/23, 1:18 AM

it wil be perfect for many, but what they are attempting to accomplish is super difficult, but workers is pretty amazing, kv is pretty solid, so just gotta be patient with the bleeding edge tech. I'm attempting to rewrite things from KV to D1 to shadow what I am doing with KV, but i'm still leaving KV as the baseline till D1 is out of ALpha/beta

captain•9/25/23, 1:19 AM

but perhaps if you need it now, you should be exploring durable objects more with nosql

Bbenthecarman I wouldn't use d1, it only has like 20% uptime

Matt Silverlock•9/25/23, 1:27 AM

This has been one of the very rare cases where we’ve seen this — it’s certainly not 20% (or even 5%). I get that you’re frustrated from your experience with D1, but 20% isn’t true.

MMatt Silverlock This has been one of the very rare cases where we’ve seen this — it’s certainly ...

captain•9/25/23, 1:43 AM

are you finding the version alpha or beta is currently more stable?

Ccaptain are you finding the version alpha or beta is currently more stable?

Matt Silverlock•9/25/23, 1:46 AM

The new storage subsystem is substantially more reliable and has been for months.

Matt Silverlock•9/25/23, 1:46 AM

(That’s why we made it the default)

MMatt Silverlock (That’s why we made it the default)

captain•9/25/23, 1:47 AM

copy that...in the midst of transfering over now

captain•9/25/23, 1:47 AM

enjoying being around for the cloudflare ride!

Adi•9/25/23, 3:18 AM

Genuinely can't wait to see what's announced for birthday week!
Hopefully some news around D1 as well

Santa DCON 🎄•9/25/23, 3:29 AM

D1 is actually shockingly amazing, I'm excited to move my everything to it as soon as it's production ready. Amazing work team!

AAdi Genuinely can't wait to see what's announced for birthday week! Hopefully some n...

Sameer Ali•9/25/23, 3:54 AM

When is the birthday week? just curious

Sameer Ali•9/25/23, 3:55 AM

I have been using D1 for long time, love the experience so far. Cloudflare Team is doing Excellent Job

SSameer Ali When is the birthday week? just curious

Adi•9/25/23, 3:58 AM

I believe it's this week

Expect quite a few announcements/blogs from Cloudflare

jb•9/25/23, 4:11 AM

https://blog.cloudflare.com/welcome-to-birthday-week-2023/

The Cloudflare Blog

Welcome to Birthday Week 2023

Building the future is, in part, what Birthday Week is about. Over the past 13 years we’ve announced things like Universal SSL (doubling the size of the encrypted web overnight), or Cloudflare Workers (helping change the way people build and scale applications). This year will be no different

divby0•9/25/23, 12:08 PM

Which orm do you people use with d1? I am so in love with how prisma allows you to query stuff, I don't want to go back to SQL-esque queries. But prisma doesn't work with d1 (yet). I tried drizzle whihc is the next best thing I have discovered, but I'd definitely like to try something more prisma-like

Adi•9/25/23, 12:47 PM

I can't recommend Drizzle enough, it's amazing. But it's syntax is definitely more SQL like.
That being said drizzle now has relationship like queries, so maybe it'll work for you.

boywonder350•9/25/23, 3:17 PM

I am hoping d1 goes to production soon so there is no 500mb limit

captain•9/25/23, 3:54 PM

I am diving in D1 again, previously was using a D1 alpha and now resetting things up with a D1 beta. Everything seems in order, however now I'm making my first entry and for some reason when it gets to the D1 code section...it doesn't get past it and the console log i have set to print after is not being printed.

1. Is the TOML set up any different
2. https://developers.cloudflare.com/d1/learning/debug-d1/ for the debug statement uses: e: any which is typescript only, for js should it just be e for the catch area (which is what I have now and is not showing anything)

thanks!

Debug D1 · Cloudflare D1 docs

D1 allows you to capture exceptions and log errors returned when querying a database. To debug D1, you will use the same tools available when …

captain•9/25/23, 3:57 PM

(also runing 3.6 , should probably change that)

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

Matt Silverlock•9/25/23, 4:06 PM

Can you share what your config is? There's no changes to how

wrangler.toml

wrangler.toml

works. Is this a Workers or a Pages project?

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

Matt Silverlock•9/25/23, 4:06 PM

Sharing your Workers code would be great too.

captain•9/25/23, 4:10 PM

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

captain•9/25/23, 4:13 PM

and in the TOML file:
d1_databases = [
{ binding = "DBNAME_DB", database_name = "DBNAME_DB", database_id = "74244d9f-afa8-4ca2-ab7f-NEWID" }, #{ binding = "DBNAME_DB", database_name = "DBNAME_DB", database_id = "e6cf047a-8ce0-41a9-a47e-OLDID" },
]

captain•9/25/23, 4:14 PM

I am placing this just below where I set my kv_namespaces = [] stuff.

captain•9/25/23, 4:22 PM

the expectation would be it should display some error if getting here, but for some reason its like a black hole

captain•9/25/23, 4:40 PM

I lowered the position of where d1_databases = is in the toml file (just below my [vars] and now I can see the try getting catched

captain•9/25/23, 4:40 PM

but when printing out the: "e" it's empty

Ccaptain ``` console.log("we start the new DB"); try { console.log("we start...

Matt Silverlock•9/25/23, 4:58 PM

Can you run just a very basic query - start from scratch. Just

await db.exec("PRAGMA table_list")

await db.exec("PRAGMA table_list")

- and nothing else? Your binding appears fine. You aren't returning any results (because it's an INSERT without any RETURNING) - what do you expect to happen? It should just insert without an error.

console.log("we start the new DB"); try { console.log("we start the new DB test 1"); await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run() console.log("we start the new DB test 2"); } catch (e) { console.log("we start the new DB test 3"); console.log({ message: e.message, cause: e.cause.message, }); } console.log("we end the new DB");

Is it possible we can just get the sqlite file? We are just trying to move off of this because it is

Similar Threads

Similar Threads

Similar Threads