Cloudflare Developers•3y ago

e.g. (this is all junk data, not real emails)

Original message was deleted

《

《 Sarge 》•7/17/23, 6:51 PM

The DROP TABLE IF EXISTSDROP TABLE IF EXISTS runs fine in DBeaver, but not wrangler@3.20

MMatt Silverlock e.g. (this is all junk data, not real emails)

《

《 Sarge 》•7/17/23, 6:54 PM

No I'm not querying the 'main.' in SQL at all. I have a build data script that drops everything and rebuilds the database from scratch.
at he beginning of it, I have the drops, then I have the entire DB created again.
The script is rather large @ikea.se, and I'd probably not be able to post it all here anyway

《

《 Sarge 》•7/17/23, 6:54 PM

The I run wrangler pointing to a file

《

《 Sarge 》•7/17/23, 6:55 PM

I've used a binary search algo, to narrow it down to the drop if exists statements

《《 Sarge 》The I run wrangler pointing to a file

Matt SilverlockOP•7/17/23, 6:55 PM

I've yet to see

wrangler d1 execute

wrangler d1 execute

report this.

Matt SilverlockOP•7/17/23, 6:56 PM

or --command='PRAGMA table_list'--command='PRAGMA table_list'

《

《 Sarge 》•7/17/23, 6:58 PM

okay I'll give it a go. @ikea.se
Yeah, It has to be something in the script. I've been rebuilding this for a while, and not had this issue in the past @Matt
What throws me off is the script works and rebuilds fine form DBeaver. So smells like a support thing.

《

《 Sarge 》•7/17/23, 7:00 PM

Yeah that passes @ikea.se.
So might be a symptom then...interesting

《

《 Sarge 》•7/17/23, 7:03 PM

But when I run my large script it comes back with the same error. painful.
I'll try to comment out things again and see what it doesn't like again.

MMatt Silverlock or `--command='PRAGMA table_list'`

《

《 Sarge 》•7/17/23, 7:10 PM

Yes that works as well. Lists out the tables in there.

《

《 Sarge 》•7/17/23, 7:21 PM

Hmmm I have created a sub set of the scripts that I'm working with.
I have a list of all the DROP TABLE IF EXISTS,
and a sub set of CREATE table x4.
and I'm seeing the no such table error again.

I assume this is the correct command to see locally?
wrangler d1 execute <db> --command='PRAGMA table_list' --localwrangler d1 execute <db> --command='PRAGMA table_list' --local
Because when I check the table_list, it seems like nothing changed.

《

《 Sarge 》•7/17/23, 7:22 PM

Maybe I can DM more details to one of you, and share a little more detail, then come back with a conclusion here?
I don't want to share IP, nor spam this room too much.

《《 Sarge 》Hmmm I have created a sub set of the scripts that I'm working with. I have a li...

Matt SilverlockOP•7/17/23, 7:29 PM

Yes,

--local

--local

is local. If you don't pass

--local

--local

, and run wrangler d1 execute [...]wrangler d1 execute [...]

it runs on the Cloudflare network or "production" to some. If you haven't created that table in prod == you get errors.

MMatt Silverlock Yes, `--local` is local. If you don't pass `--local`, and run `wrangler d1 execu...

《

《 Sarge 》•7/17/23, 7:31 PM

okay cool. So everything I'm doing right now is --local. I do have a production and develop database in the network, and have previously used this method to update them with no issue.

《

《 Sarge 》•7/17/23, 7:32 PM

I did attempt to run ths same script against my development database, and wittnessed the same error I'm getting locally.

《

《 Sarge 》•7/17/23, 7:33 PM

SO at least it's consistent...

《《 Sarge 》I did attempt to run ths same script against my development database, and wittne...

Matt SilverlockOP•7/17/23, 8:08 PM

Note that if you're using DBeaver: I don't think it supports D1. Local SQLite != D1. I have a suspicion some of your issues are distinct from D1 itself.

MMatt Silverlock Note that if you're using DBeaver: I don't think it supports D1. Local SQLite !=...

《

《 Sarge 》•7/17/23, 8:12 PM

Right, so the sqlite3 files was originally created with wrangler, but I have been editing it locally using DBeaver, by pointing the connection to ./.wrangler/state/d1/...
So you think DBeaver might have currupted the sqlite3 file in some way? Because yeah, I was just writing a list of things I tried, and there is some odd stuff happening.

《

《 Sarge 》•7/17/23, 8:13 PM

What IDE would you recommend?

《

《 Sarge 》•7/17/23, 8:14 PM

I do have Views, and triggers in this DB too.. I'm assuming that fine, because it all seems to be working.

《

《 Sarge 》•7/17/23, 8:27 PM

So with that train of thought. I removed DBeaver from the process. I delete the local database, and rebuilt it using the same script locally using wrangler only.
Then tried to run the database build script a 2nd time using just wrangler and got the same no such table error.
If I manually drop the tables in the same order as the script attempts, with no 'If Exists' then it works.
If I try to drop the tables in the same order with If Exists is shows the error.

So not sure if that makes sense, but yeah. I wouldn't expect to see that error.

MMatt Silverlock It sounds like you’re using the original alpha backend - that error is very spec...

Lucian•7/17/23, 8:28 PM

Hi Matt, yes I am using the original backend since it has back-ups enabled. Is there a migration path planned from the original backend to the experimental backend when backups become available on the experimental as well?

《

《 Sarge 》•7/17/23, 8:30 PM

@Matt Anyway I'll leave this and come back to it tomorrow. Thanks for the help so far. I'll prob come back tomorrow with a solution hopefully. Thanks again

LLucian Hi Matt, yes I am using the original backend since it has back-ups enabled. Is t...

Matt SilverlockOP•7/17/23, 8:35 PM

Not an automated path in the near term (primarily because these are alpha databases, not production databases). You can easily export and then run

execute DB_NAME --file=export.sql

execute DB_NAME --file=export.sql

to import your old database.

《《 Sarge 》So with that train of thought. I removed DBeaver from the process. I delete the ...

Matt SilverlockOP•7/17/23, 8:36 PM

I'd suggest opening an issue on GitHub — I think we have exhausted debugging here via Discord without seeing your SQL. I really suspect your migration/seed scripts are just not creating the right tables first.

MMatt Silverlock Not an automated path in the near term (primarily because these are alpha databa...

Lucian•7/17/23, 9:27 PM

This will sound really dumb but, how do I export my database using Wrangler?

Original message was deleted

Lucian•7/18/23, 12:38 AM

Thanks nora!
Just FYI, in case someone else runs into a problem that I ran into during the process:

On windows, after converting the backup to a sql file using sqlite3 (using sqlite3 <path-to-downloaded-file> .dump > latest.sql) when attempting to import via npx wrangler d1 execute <name> --file=latest.sql, wrangler was complaining about an imaginary synthax error like this:

near "��P": syntax error [code: 7500]".

It turns out this is an encoding problem, the sql file ended up encoded in UTF-8-BOM and had to be converted to UTF-8. You can do this using Notepad++ via the Encoding menu option and then saving. After which, the import worked flawlessly (18MB database imported in about 30 seconds or so)

MMatt Silverlock Not an automated path in the near term (primarily because these are alpha databa...

Lucian•7/18/23, 1:37 AM

Is there a rough estimate regarding enabling backups on the experimental backend?
This backend is significantly faster, event without indexes, but I am reluctant to using it until I have backups running.

LLucian Is there a rough estimate regarding enabling backups on the experimental backend...

Cyb3r-Jak3•7/18/23, 1:47 AM

You can try it: d1-database

CCyb3r-Jak3 You can try it: https://discord.com/channels/595317990191398933/9920605818320323...

Lucian•7/18/23, 2:34 AM

Thanks @Cyb3r-Jok3 Time travel seems super cool, but so far when following the blog post and trying stuff out (like this wrangler d1 time-travel info YOUR_DATABASE) I get [ERROR] Unknown argument: time-travel. I am using wrangler 3.2.0

LLucian Thanks @Cyb3r-Jok3 Time travel seems super cool, but so far when following the b...

Cyb3r-Jak3•7/18/23, 2:38 AM

I believe you need to be using the

d1

d1

release of the wrangler branch as it hasn't been merged into a release yet. If you do

npx wrangler@d1 d1 time-travel info <db>

npx wrangler@d1 d1 time-travel info <db>

then I believe it should work

CCyb3r-Jak3 I believe you need to be using the `d1` release of the wrangler branch as it has...

Lucian•7/18/23, 2:41 AM

Just tried, it seems to not be working as of now . Unless I am doing something really wrong

npx wrangler@d1 d1 time-travel info <db>
X [ERROR] Unknown arguments: time-travel, info

lll-QWQ•7/18/23, 3:49 AM

Does D1 database have limit on how many tables you can create?

LLucian Just tried, it seems to not be working as of now . Unless I am doing something r...

Matt SilverlockOP•7/18/23, 3:58 AM

Double check you have the latest

wrangler@d1

wrangler@d1

branch. It definitely works. I am using the same public version as everyone else. But also note that this isn’t final - I’d suggest holding off until we officially release it if you rely on your database.

LLucian Thanks @Cyb3r-Jok3 Time travel seems super cool, but so far when following the b...

Matt SilverlockOP•7/18/23, 3:59 AM

Also, I spell out the commands in that comment, so please read it carefully

d1-database

Etrain•7/18/23, 12:49 PM

Hello, I've been digging through chat and the documentation to look for a way to use D1 with

vite dev

vite dev

and the best I could find is re-running the production build. https://discord.com/channels/595317990191398933/1042974692186804295/1048148731670835290

For SvelteKit specifically, it looks like the

platform

platform

parameter needs to be able to receive the D1 client library when developing locally: https://github.com/sveltejs/kit/issues/4292
That may eventually be addressable through the adapter. This would be great to have to improve the developer experience.
Could I be missing something meanwhile? The docs mention a

--d1

--d1

flag to set up the database binding locally, but I assume that's for the

wrangler

wrangler

CLI and not Vite.

EEtrain Hello, I've been digging through chat and the documentation to look for a way to...

Matt SilverlockOP•7/18/23, 1:23 PM

If you don't inject the binding into the application - vite or not - you won't be able to access the local DB. The flag — the binding — is what allows your app to talk to D1. Think of it like a DB driver = without it, there's no way for your code to talk to the DB. In lieu of that, you can see that others are mocking the

platform

platform

object and the APIs they need.

chientrm.com•7/18/23, 1:33 PM

how do I drop a

DEFAULT

DEFAULT

constraint?

Oodin im getting "* * * * *" @ 7/18/2023, 4:07:12 PM - Exception Thrown X [ERROR] ...

Matt SilverlockOP•7/19/23, 6:57 AM

Known bug with

DROP COLUMN

DROP COLUMN

specifically: d1-database

Original message was deleted

Matt SilverlockOP•7/19/23, 6:58 AM

Known bug: d1-database (see the messages either side of this linked one)

cdslash•7/19/23, 11:27 AM

I have some workers routes defined in my

wrangler.toml

wrangler.toml

that work in production:

routes = [
    { pattern = "*/send", zone_id = "[id]" },
    { pattern = "*/login", zone_id = "[id]" },
    { pattern = "*/services", zone_id = "[id]" },
]

routes = [
    { pattern = "*/send", zone_id = "[id]" },
    { pattern = "*/login", zone_id = "[id]" },
    { pattern = "*/services", zone_id = "[id]" },
]

when I print the login url (using Hono via

c.req.url

c.req.url

) I correctly get

https://foo.com/login

https://foo.com/login

when it's deployed to Cloudflare.

Locally though, with

wrangler dev

wrangler dev

, I get

http://send/login

http://send/login

it seems to be using the first route as the hostname, which is bizarre. Is this is known issue?

Ccdslash I have some workers routes defined in my `wrangler.toml` that work in production...

Max (@rozenmd)•7/19/23, 11:40 AM

can you please report this in https://github.com/cloudflare/workers-sdk/issues ?

Original message was deleted

Max (@rozenmd)•7/19/23, 11:41 AM

this is now live

MMax (@rozenmd)can you please report this in https://github.com/cloudflare/workers-sdk/issues ?

cdslash•7/19/23, 11:53 AM

I've reported and added a little more information, specifically that commenting out the wildcard route definitions makes it work as expected locally, but those are required for production.

https://github.com/cloudflare/workers-sdk/issues/3635

GitHub

🐛 BUG: reported url differs between production and local · Issue #3...

Which Cloudflare product(s) does this pertain to? Wrangler core What version(s) of the tool(s) are you using? 3.3.0 What version of Node are you using? No response What operating system are you usi...

Ccdslash I've reported and added a little more information, specifically that commenting ...

Max (@rozenmd)•7/19/23, 11:54 AM

cheers - btw #wrangler might be a better place to ask folks if they've run into this issue

MMax (@rozenmd)cheers - btw #wrangler might be a better place to ask folks if they've run into ...

cdslash•7/19/23, 12:08 PM

Great, thanks for the tip

e.g. (this is all junk data, not real emails)

Similar Threads

Similar Threads

Similar Threads