Cloudflare Developers•3y ago

trying to find the easiest way to manage like 1,000,000 rows

Jjohn mcafee trying to find the easiest way to manage like 1,000,000 rows

Cyb3r-Jak3•7/29/23, 8:33 PM

Manage how? Like query them?

john mcafeeOP•7/29/23, 8:38 PM

like configure / edit

Cyb3r-Jak3•7/29/23, 8:39 PM

Probabaly the console in the dasboard

john mcafeeOP•7/29/23, 8:39 PM

currently managin my database via google sheets, exporting to csv then importing into my sql database lol

john mcafeeOP•7/29/23, 8:39 PM

its a nightmare

ZZiga Zajc It's possible to move old D1 to new one?

Matt Silverlock•7/30/23, 11:11 AM

Manually, yes. Take a backup, import it into a new DB. https://developers.cloudflare.com/d1/learning/backups/#downloading-a-backup-locally

Backups (Legacy) · Cloudflare D1 docs

D1 has built-in support for creating and restoring backups of your databases, including support for scheduled automatic backups and manual backup …

Cyb3r-Jak3•7/30/23, 12:19 PM

I believe there is no planned auto migration.
The new backend will no longer have backups and only time travel

Cyb3r-Jak3•7/30/23, 12:27 PM

My guess is you missed the converting step https://developers.cloudflare.com/d1/learning/importing-data/#converting-sqlite-database-files

CCole Xemi Is there a way to export a DB from the experimental backend?

Matt Silverlock•7/30/23, 3:53 PM

Not at the moment. Prioritizing larger DBs, performance, and bringing branching & cloning to Time Travel first.

MMatt Silverlock Not at the moment. Prioritizing larger DBs, performance, and bringing branching ...

Sameer Ali•7/30/23, 8:37 PM

First one is the most exciting and much needed! Larger DBs!

MMatt Silverlock Not at the moment. Prioritizing larger DBs, performance, and bringing branching ...

Bram•7/30/23, 9:22 PM

question on the "larger databases" part, is the plan to (eventually) to support large databases of 100GB - 500GB?

Unsmart•7/30/23, 9:25 PM

This was the last message in regards to DB size and based on it I'd assume under 100GB d1-database

Unsmart•7/30/23, 9:28 PM

(also scroll down a bit for the talk about adding some form of way for you to shard a db)

Bram•7/30/23, 9:39 PM

thx, sharding would be completely reasonable of course

λ.ςζ•7/31/23, 4:04 PM

is it possible to get a dump of D1 (alpha) database?

λ.ςζ•7/31/23, 4:09 PM

could you point me how? i couldn't find anything helpful

λ.ςζ•7/31/23, 4:11 PM

oh. i've tried that.

Experimental DBs do not support backups yet

Experimental DBs do not support backups yet

Cyb3r-Jak3•7/31/23, 4:14 PM

It’s still alpha just the new vs old backend. The new backend doesn’t support direct dumps but rather time travel

λ.ςζ•7/31/23, 4:15 PM

thanks

ZZiga Zajc So both old backend and new backend are still called Alpha?

DaniFoldi•7/31/23, 4:17 PM

correct

Hyper•7/31/23, 7:58 PM

I saw somewhere on the docs that running wrangler d1 info or a command that is similar gives u either version: alpha or version: beta based on whether you’re using the exp backend or not

HHyper I saw somewhere on the docs that running wrangler d1 info or a command that is s...

Matt Silverlock•7/31/23, 8:32 PM

Right at the top of https://developers.cloudflare.com/d1/learning/time-travel/

MMatt Silverlock Right at the top of https://developers.cloudflare.com/d1/learning/time-travel/

Cyb3r-Jak3•7/31/23, 8:33 PM

I think the confusion is because d1 says open alpha

CCyb3r-Jak3 I think the confusion is because d1 says open alpha

Matt Silverlock•7/31/23, 8:34 PM

Choice we had to make. This will be the backend going forward.

MMatt Silverlock Choice we had to make. This will be the backend going forward.

Cyb3r-Jak3•7/31/23, 8:36 PM

Yeah I figured the beta backend will be the one for open beta just confusing for now

trying to find the easiest way to manage like 1,000,000 rows

Similar Threads

Similar Threads

Similar Threads