Cloudflare Developers•3y ago

wondering if that would make sense if they were more aligned to both either be in ms or secs?

Ccaptain wondering if that would make sense if they were more aligned to both either be i...

Isaac McFadyen•9/26/23, 5:53 PM

It might, but that would deviate from SQLite behavior, which I doubt they'd want to do.

Isaac McFadyen•9/26/23, 5:54 PM

It would mean every time someone imported a SQLite database the user would need to know to convert manually.

captainOP•9/26/23, 5:54 PM

true

captainOP•9/26/23, 5:54 PM

perhaps the D1 wizzards could deviate slightly and created a new unixepoch function ie, unixepochD1

captainOP•9/26/23, 5:55 PM

that would use ms, given the environment its used in

captainOP•9/26/23, 6:00 PM

idk maybe its a silly idea

captainOP•9/26/23, 6:00 PM

i am going to set time_stamp_updated INTEGER DEFAULT (unixepoch('now') * 1000) to aleviate confusion

Ccaptain i am going to set time_stamp_updated INTEGER DEFAULT (unixepoch('now') * 1000) t...

Matt Silverlock•9/26/23, 6:30 PM

timestamp_updated_mstimestamp_updated_ms

give your names units

MMatt Silverlock `timestamp_updated_ms` - give your names units 🙂

captainOP•9/26/23, 6:37 PM

how would one define that...? I tried time_stamp_updated INTEGER DEFAULT (timestamp_updated_ms('now')) AND time_stamp_updated INTEGER DEFAULT timestamp_updated_ms

captainOP•9/26/23, 6:38 PM

but no success

captainOP•9/26/23, 6:43 PM

or are you just saying label it with the expected units?

Matt Silverlock•9/26/23, 6:43 PM

^ that. Give your column the name of the units it contains. Not a requirement - just a tip

captainOP•9/26/23, 6:44 PM

got it! I just set it via: time_stamp_updated INTEGER DEFAULT (unixepoch('now') * 1000)

captainOP•9/26/23, 6:44 PM

to normalize things which works for mee

captainOP•9/26/23, 6:45 PM

but that said, if setting time_stamp_updated INTEGER DEFAULT CURRENT_TIMESTAMP, i think wrangle should flag that as an error

captainOP•9/26/23, 6:45 PM

with type mismatch of some sort given CURRENT_TIMESTAMP will save a non integer result
wrangler could check for that when the following line is executed:
wrangler d1 execute <DB_NAME> --file=dbtablecreate.sql

captainOP•9/26/23, 6:48 PM

wrangler could check for that when the following line is executed:
wrangler d1 execute <DB_NAME> --file=dbtablecreate.sql

captainOP•9/26/23, 6:53 PM

https://developers.cloudflare.com/vectorize/ seeing this in the realease notes (3.10)...but its a dead link

Bbretto Has geospatial support (latitude/longitude) made it onto the D1 backlog? Or is ...

Matt Silverlock•9/26/23, 8:16 PM

Which specific math functions?

Bbretto Has geospatial support (latitude/longitude) made it onto the D1 backlog? Or is ...

Matt Silverlock•9/26/23, 8:17 PM

All the built-ins work: https://www.sqlite.org/lang_mathfunc.html

Matt Silverlock•9/26/23, 8:19 PM

Source: https://github.com/cloudflare/workerd/blob/b3b85c0d1ff286552b446fa2e7a65384ff9df154/src/workerd/util/sqlite.c%2B%2B#L197

GitHub

workerd/src/workerd/util/sqlite.c++ at b3b85c0d1ff286552b446fa2e7a6...

The JavaScript / Wasm runtime that powers Cloudflare Workers - cloudflare/workerd

kian•9/27/23, 9:41 AM

Have you actually used COSCOS (i.e all caps) or coscos?

kian•9/27/23, 9:48 AM

Hmm.

kian•9/27/23, 9:48 AM

I might just be blind, but I don't see anything in workerd indicating that it even has the maths functions enabled.

kian•9/27/23, 10:04 AM

https://github.com/cloudflare/workerd/issues/1245

enfipy•9/27/23, 12:29 PM

Hey guys, I was wondering - is there any actual uptime or analytics for the D1 database? On the cloudflarestatus.com website, there's no status for D1 specifically but there are Workers and Durable Objects (I believe D1 is based on them). Is it safe to assume that D1 uptime is basically the same as DO/Workers?

Ccaptain got it! I just set it via: time_stamp_updated INTEGER DEFAULT (unixepoch('now') ...

Steved•9/27/23, 1:04 PM

SQLite is very loose on data types (by default), and won't complain if you put the wrong thing in a given column. To make it more strict you can use: https://www.sqlite.org/stricttables.html
And then on the date/times, you can get a more precise time (sub second) and a human readable ISO form with:

    createdAt DATETIME DEFAULT (strftime('%Y-%m-%dT%H:%M:%fZ', 'now'))

    createdAt DATETIME DEFAULT (strftime('%Y-%m-%dT%H:%M:%fZ', 'now'))

The DATETIME isn't a specific Sqlite datatype, but it distinguishes it from TEXT. Also if you're setting the value from Javascript, use the Date.toISOString().
More info on the SQLite handling of dates/times: https://www.sqlite.org/lang_datefunc.html

Kkian <https://github.com/cloudflare/workerd/issues/1245>

kian•9/27/23, 3:48 PM

https://github.com/cloudflare/workerd/pull/1246

saviourdog•9/28/23, 2:27 AM

May I know when the official version will be released? I am eagerly looking forward to using D1 for my personal project. As long as the subsequent updates do not result in data loss, I am okay with it

Ssaviourdog May I know when the official version will be released? I am eagerly looking forw...

Unsmart•9/28/23, 2:31 AM

Afaik theres never been data loss with D1 and I doubt there will be any

saviourdog•9/28/23, 2:36 AM

That's great to hear!May I know when the official version will be released?

Unsmart•9/28/23, 2:45 AM

Theres no GA release date it will come eventually

Jonatan•9/28/23, 8:49 AM

Hello all, when I try to deploy/test my worker it says 'D1 bindings require module-format workers. [code: 10021]'. Could someone pls explain what this means? Am I missing a node module?

Jonatan•9/28/23, 9:11 AM

~~Nvm, I forgot to use the wrangler beta instead of normal wranler~~

Jonatan•9/28/23, 9:35 AM

Yeah I was using script-format workers, whoops

Epailes•9/28/23, 1:02 PM

Congrats to the team for all the hard work they've put in getting D1 to beta status! MeowHeartCloudflare

Matt Silverlock•9/28/23, 1:04 PM

https://blog.cloudflare.com/d1-open-beta-is-here/

The Cloudflare Blog

D1: open beta is here

D1 is now in open beta, and the theme is “scale”: with higher per-database storage limits and the ability to create more databases, we’re unlocking the ability for developers to build production-scale applications on D1

Matt Silverlock•9/28/23, 1:22 PM

https://developers.cloudflare.com/d1/changelog/#the-d1-public-beta-is-here

Changelog · Cloudflare D1 docs

D1 is now in public beta, and storage limits have been increased:

Matt Silverlock•9/28/23, 1:23 PM

D1 is now in public beta, and storage limits have been increased:

Developers with a Workers paid plan now have a 2 GB per-database limit (up from 500MB) and can create 50,000 databases per account (up from 10). These limits will continue to increase automatically during the public beta.
Developers with a Workers free plan retain the 500 MB per-database limit and can create up to 10 databases per account.Databases must be using D1's [new storage subsystem](/d1/changelog/#new-default-storage-subsystem) to benefit from the increased database limits. See the announcement blog for more details about what's new in the beta and what's coming in the future for D1.

walkersyed581•9/28/23, 1:28 PM

Hi, need some help guys, new dev here so let me know if I am posting to the wrong channel. I am running wrangler d1 migrations in postCommands after deployment which gives an error but it used to work just fine in the preCommands of the "yml" file. Now, I am getting the error "non-zero exit code"

Epailes•9/28/23, 1:33 PM

Is support for a large number of d1 instances going to be solely tied to Workers for Platforms users (which needs ent contract), or is it something which would be generally available?

EEpailes Is support for a large number of d1 instances going to be solely tied to Workers...

Matt Silverlock•9/28/23, 1:35 PM

We can increase on a case-by-case basis. We intend to substantially increase the # of databases per account (per the blog) during the beta period as well.

EEpailes Is support for a large number of d1 instances going to be solely tied to Workers...

Matt Silverlock•9/28/23, 1:36 PM

At "100k databases" there are other things that make you want to use WfP in terms of how many bindings you can have per script, how you are managing user scripts, etc.

MMatt Silverlock At "100k databases" there are other things that make you want to use WfP in term...

Epailes•9/28/23, 1:38 PM

Ah I thought if D1 supported a large number of instances it would move to the DO method of connecting where you don't need an individual binding per worker

Epailes•9/28/23, 1:40 PM

At least for the use case where each instance has the same schema and many instances is more a method of sharding to prevent everything being stored in one huge instance which slows down, and there's no legal/contractual requirements to store user data separately.
If each d1 can be unique then platforms makes a lot more sense

wondering if that would make sense if they were more aligned to both either be in ms or secs?

Similar Threads