question, is it not possible to backup an alpha database and then restore it into a beta database. W

question, is it not possible to backup an alpha database and then restore it into a beta database. When I attempt the basic method of restoring in that situation i get:
Internal error: failed to restore backup: Experimental DBs do not support backups yet:
74244d9f-afa8-4ca2-ab7f-8067f4505c97 (v3) [code: 7500]

Ccaptain question, is it not possible to backup an alpha database and then restore it int...

Isaac McFadyen•9/24/23, 6:43 PM

I believe you need to dump it to a SQL file and reupload.

IIsaac McFadyen I believe you need to dump it to a SQL file and reupload.

captainOP•9/24/23, 7:12 PM

success!

captainOP•9/24/23, 7:44 PM

another question...did a dump from an alpha database, created a new database, importanted the dump, success. NOW to the that new database I'm running the sql:

DROP TABLE IF EXISTS messages;
CREATE TABLE IF NOT EXISTS messages (
  title TEXT NOT NULL,
  body TEXT NOT NULL,
  amount INTEGER NOT NULL,
  color TEXT NOT NULL,
  event_type TEXT NOT NULL,
  e_id TEXT NOT NULL, 
  i_id TEXT NOT NULL, -- invoice id
  o_id TEXT NOT NULL, --
  s_id TEXT NOT NULL, -- subscription id
  p_id TEXT NOT NULL, -- payment id
  c_id TEXT NOT NULL, -- customer id
  service TEXT NOT NULL, 
  email TEXT NOT NULL,
  name TEXT NOT NULL,
  link TEXT NOT NULL,
  related_locations TEXT NOT NULL,
  time_stamp INTEGER NOT NULL, -- time_stamp INTEGER NOT NULL DEFAULT CURRENT_TIMESTAMP,
  customer_dismiss INTEGER, -- 0 or 1
  location_id TEXT NOT NULL,
  status TEXT NOT NULL, -- new or dismissed
  status_type TEXT NOT NULL, -- notification / 
  other TEXT NOT NULL
);

DROP TABLE IF EXISTS messages;
CREATE TABLE IF NOT EXISTS messages (
  title TEXT NOT NULL,
  body TEXT NOT NULL,
  amount INTEGER NOT NULL,
  color TEXT NOT NULL,
  event_type TEXT NOT NULL,
  e_id TEXT NOT NULL, 
  i_id TEXT NOT NULL, -- invoice id
  o_id TEXT NOT NULL, --
  s_id TEXT NOT NULL, -- subscription id
  p_id TEXT NOT NULL, -- payment id
  c_id TEXT NOT NULL, -- customer id
  service TEXT NOT NULL, 
  email TEXT NOT NULL,
  name TEXT NOT NULL,
  link TEXT NOT NULL,
  related_locations TEXT NOT NULL,
  time_stamp INTEGER NOT NULL, -- time_stamp INTEGER NOT NULL DEFAULT CURRENT_TIMESTAMP,
  customer_dismiss INTEGER, -- 0 or 1
  location_id TEXT NOT NULL,
  status TEXT NOT NULL, -- new or dismissed
  status_type TEXT NOT NULL, -- notification / 
  other TEXT NOT NULL
);

and getting the following error:

SQL code did not contain a statement. [code: 7500]

This same statement seemed to work on the alpha database, thoughts?

Resolved, I had a comment with a semi colon which is an bug documented here: https://github.com/cloudflare/workers-sdk/issues/3892 whats interesting is this bug only applies to the beta D1 and not the alpha

GitHub

🐛 BUG: d1 execution with comment including semicolon causes SQL cod...

Which Cloudflare product(s) does this pertain to? D1 What version(s) of the tool(s) are you using? 3.6.0 What version of Node are you using? 20.5.1 What operating system are you using? Mac Describe...

MMatt Silverlock Thanks: looking into why it's sticking.

benthecarman•9/24/23, 9:42 PM

it's still down, any updates here?

Bbenthecarman it's still down, any updates here?

Matt Silverlock•9/24/23, 9:43 PM

We’re still chasing down the cause of the bug. I’ll provide an update when we have one.

benthecarman•9/24/23, 9:44 PM

Is it possible we can just get the sqlite file? We are just trying to move off of this because it is unusable

Bbenthecarman Is it possible we can just get the sqlite file? We are just trying to move off o...

Matt Silverlock•9/24/23, 11:17 PM

There isn't the concept of a 'single SQLite file' in D1 (as that wouldn't allow us to be distributed).

Bbenthecarman Is it possible we can just get the sqlite file? We are just trying to move off o...

Matt Silverlock•9/24/23, 11:18 PM

And I understand the frustration: we don't want these kind of bugs, but this is an alpha/beta.

benthecarman•9/24/23, 11:20 PM

okay, if guys can get it back up for a couple hours we can transfer off of it

Bbenthecarman okay, if guys can get it back up for a couple hours we can transfer off of it

Matt Silverlock•9/24/23, 11:41 PM

Can you confirm it's running now?

MMatt Silverlock Can you confirm it's running now?

benthecarman•9/25/23, 12:04 AM

Back up, thanks

Mrxbox98•9/25/23, 12:30 AM

Is there a way to get a database size limit increase? I have a multi-gb sqlite database that I wish to use with d1.

MMrxbox98 Is there a way to get a database size limit increase? I have a multi-gb sqlite d...

benthecarman•9/25/23, 12:40 AM

I wouldn't use d1, it only has like 20% uptime

Cyb3r-Jak3•9/25/23, 12:41 AM

I definitely doesn't have that low. I've been using it since the very start and had one issue

benthecarman•9/25/23, 1:01 AM

we just had like a 20 hour downtime

Bbenthecarman Back up, thanks

captainOP•9/25/23, 1:07 AM

Just curious, have you been doing anything complicated with your DB, is it a big DB? I haven't been having any issues but would like to look ahead to understand posisble concerns. And you are seeing only 20% uptime?

Ccaptain Just curious, have you been doing anything complicated with your DB, is it a big...

benthecarman•9/25/23, 1:09 AM

db is around 100mb, we basically just used it like a kv store for encrypted cloud storage

Bbenthecarman db is around 100mb, we basically just used it like a kv store for encrypted clou...

captainOP•9/25/23, 1:10 AM

was it on alpha or beta and did you find out why it went down?

captainOP•9/25/23, 1:10 AM

what errors did u get?

benthecarman•9/25/23, 1:10 AM

20% is an exageration but it would go down for about a day every week

Ccaptain was it on alpha or beta and did you find out why it went down?

benthecarman•9/25/23, 1:10 AM

CF doesn't tell us why, one said to stop using the product, we just can't connect to the db

Bbenthecarman CF doesn't tell us why, one said to stop using the product, we just can't connec...

captainOP•9/25/23, 1:11 AM

what region are you hinting with? I'm still on alpha but haven't had any downtime...ever. Was going to move it to beta DB today.

benthecarman•9/25/23, 1:12 AM

we have people globally

Bbenthecarman we have people globally

captainOP•9/25/23, 1:12 AM

got it

captainOP•9/25/23, 1:13 AM

well hopefully they are seeing your bugs

benthecarman•9/25/23, 1:13 AM

half the time they were unaware their system was down lol

captainOP•9/25/23, 1:16 AM

D1 is a game changer and so is workers, god speed!

benthecarman•9/25/23, 1:16 AM

it would have been perfect for our usecase if it actually worked

captainOP•9/25/23, 1:18 AM

it wil be perfect for many, but what they are attempting to accomplish is super difficult, but workers is pretty amazing, kv is pretty solid, so just gotta be patient with the bleeding edge tech. I'm attempting to rewrite things from KV to D1 to shadow what I am doing with KV, but i'm still leaving KV as the baseline till D1 is out of ALpha/beta

captainOP•9/25/23, 1:19 AM

but perhaps if you need it now, you should be exploring durable objects more with nosql

Bbenthecarman I wouldn't use d1, it only has like 20% uptime

Matt Silverlock•9/25/23, 1:27 AM

This has been one of the very rare cases where we’ve seen this — it’s certainly not 20% (or even 5%). I get that you’re frustrated from your experience with D1, but 20% isn’t true.

MMatt Silverlock This has been one of the very rare cases where we’ve seen this — it’s certainly ...

captainOP•9/25/23, 1:43 AM

are you finding the version alpha or beta is currently more stable?

Ccaptain are you finding the version alpha or beta is currently more stable?

Matt Silverlock•9/25/23, 1:46 AM

The new storage subsystem is substantially more reliable and has been for months.

Matt Silverlock•9/25/23, 1:46 AM

(That’s why we made it the default)

MMatt Silverlock (That’s why we made it the default)

captainOP•9/25/23, 1:47 AM

copy that...in the midst of transfering over now

captainOP•9/25/23, 1:47 AM

enjoying being around for the cloudflare ride!

Adi•9/25/23, 3:18 AM

Genuinely can't wait to see what's announced for birthday week!
Hopefully some news around D1 as well

Santa DCON 🎄•9/25/23, 3:29 AM

D1 is actually shockingly amazing, I'm excited to move my everything to it as soon as it's production ready. Amazing work team!

AAdi Genuinely can't wait to see what's announced for birthday week! Hopefully some n...

Sameer Ali•9/25/23, 3:54 AM

When is the birthday week? just curious

Sameer Ali•9/25/23, 3:55 AM

I have been using D1 for long time, love the experience so far. Cloudflare Team is doing Excellent Job

SSameer Ali When is the birthday week? just curious

Adi•9/25/23, 3:58 AM

I believe it's this week

Expect quite a few announcements/blogs from Cloudflare

jb•9/25/23, 4:11 AM

https://blog.cloudflare.com/welcome-to-birthday-week-2023/

The Cloudflare Blog

Welcome to Birthday Week 2023

Building the future is, in part, what Birthday Week is about. Over the past 13 years we’ve announced things like Universal SSL (doubling the size of the encrypted web overnight), or Cloudflare Workers (helping change the way people build and scale applications). This year will be no different

divby0•9/25/23, 12:08 PM

Which orm do you people use with d1? I am so in love with how prisma allows you to query stuff, I don't want to go back to SQL-esque queries. But prisma doesn't work with d1 (yet). I tried drizzle whihc is the next best thing I have discovered, but I'd definitely like to try something more prisma-like

Adi•9/25/23, 12:47 PM

I can't recommend Drizzle enough, it's amazing. But it's syntax is definitely more SQL like.
That being said drizzle now has relationship like queries, so maybe it'll work for you.

boywonder350•9/25/23, 3:17 PM

I am hoping d1 goes to production soon so there is no 500mb limit

captainOP•9/25/23, 3:54 PM

I am diving in D1 again, previously was using a D1 alpha and now resetting things up with a D1 beta. Everything seems in order, however now I'm making my first entry and for some reason when it gets to the D1 code section...it doesn't get past it and the console log i have set to print after is not being printed.

1. Is the TOML set up any different
2. https://developers.cloudflare.com/d1/learning/debug-d1/ for the debug statement uses: e: any which is typescript only, for js should it just be e for the catch area (which is what I have now and is not showing anything)

thanks!

Debug D1 · Cloudflare D1 docs

D1 allows you to capture exceptions and log errors returned when querying a database. To debug D1, you will use the same tools available when …

captainOP•9/25/23, 3:57 PM

(also runing 3.6 , should probably change that)

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

Matt Silverlock•9/25/23, 4:06 PM

Can you share what your config is? There's no changes to how

wrangler.toml

wrangler.toml

works. Is this a Workers or a Pages project?

Ccaptain I am diving in D1 again, previously was using a D1 alpha and now resetting thing...

Matt Silverlock•9/25/23, 4:06 PM

Sharing your Workers code would be great too.

captainOP•9/25/23, 4:10 PM

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

    console.log("we start the new DB");
    try {
      console.log("we start the new DB test 1");
      await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run()
      console.log("we start the new DB test 2");
    } catch (e) {
      console.log("we start the new DB test 3");
      console.log({
        message: e.message,
        cause: e.cause.message,
      });
    }
    console.log("we end the new DB");

DROP TABLE IF EXISTS messages; CREATE TABLE IF NOT EXISTS messages ( title TEXT NOT NULL, body TEXT NOT NULL, amount INTEGER NOT NULL, color TEXT NOT NULL, event_type TEXT NOT NULL, e_id TEXT NOT NULL, i_id TEXT NOT NULL, -- invoice id o_id TEXT NOT NULL, -- s_id TEXT NOT NULL, -- subscription id p_id TEXT NOT NULL, -- payment id c_id TEXT NOT NULL, -- customer id service TEXT NOT NULL, email TEXT NOT NULL, name TEXT NOT NULL, link TEXT NOT NULL, related_locations TEXT NOT NULL, time_stamp INTEGER NOT NULL, -- time_stamp INTEGER NOT NULL DEFAULT CURRENT_TIMESTAMP, customer_dismiss INTEGER, -- 0 or 1 location_id TEXT NOT NULL, status TEXT NOT NULL, -- new or dismissed status_type TEXT NOT NULL, -- notification / other TEXT NOT NULL );

console.log("we start the new DB"); try { console.log("we start the new DB test 1"); await env.DBNAME_DB.prepare(`insert into messages (location_id,time_stamp,status,customer_dismiss) values (?,?,?,?)`).bind(restaurant_token_used, timestamp_index, 'new', 0).run() console.log("we start the new DB test 2"); } catch (e) { console.log("we start the new DB test 3"); console.log({ message: e.message, cause: e.cause.message, }); } console.log("we end the new DB");

question, is it not possible to backup an alpha database and then restore it into a beta database. W

Similar Threads

Similar Threads

Similar Threads