Ban AGI Petition

I first thought the FLI pause letter already was a suitable petition, but it's not. It focuses on companies being the responsible ones, not on governments. Plus, it is about pausing for 6 months - which is probably way too short.

So we need a new petition.

Where to petition?

Change.org seems like a good place. Other ideas welcome

Text

AI companies are trying to build superintelligence
This is dangerous
Nobody knows how these things work
We need governments to step in

Here's the draft: https://docs.google.com/document/d/1I-J13XvtlLoKYXgbq-L5bKTCiVPyp0JCylnCvUfxZnU/edit?usp=sharing

Feedback welcome!

Marketing

Find partners to help spread it / agree to it (FLI, safe.ai, humanetech)
Make accompanying video (maybe @Niki Drozdowski?)

## How you can help

Feedback on the plan and text
Help find partners
Make promo content

hurt-tomatoOP•9/21/23, 12:40 PM

@Niki Drozdowski thanks for pushing to start work on this

sad-indigo•9/21/23, 1:05 PM

I could definitely help with the video

If you want to speak in the video yourself, I could drive over to your place

awake-maroon•9/21/23, 4:55 PM

Here's the only thing for me about Change.org. You have to enter an email address in order to sign, but then you get a ton of email from them, about all kinds of petitions. That's a mild annoyance, and it makes me wonder about the value of a signature on their petitions.

I don't know of any decent alternative. It's just a complaint I've always had about change.org. They'll guilt you to death if you let them.

sacred-rose•9/21/23, 4:57 PM

Shouldn't he have a more homogenous messaging, instead of "Banning AGI", "Pausing AI" capabilities development or something like that?

hurt-tomatoOP•9/21/23, 5:01 PM

Current title is "Ban building AI that is smarter than humans"

I'd like to frame it specifically around human competence level, since the recent poll shows that people seem to fear this

hurt-tomatoOP•9/21/23, 5:01 PM

https://www.vox.com/future-perfect/2023/9/19/23879648/americans-artificial-general-intelligence-ai-policy-poll

Vox

AI that’s smarter than humans? Americans say a firm "no thank you."

Exclusive: 63 percent of Americans want regulation to actively prevent superintelligent AI, a new poll reveals.

awake-maroon•9/21/23, 5:16 PM

I think that is a good way to go. If we figure out an awesome solution to alignment, the matter can be revisited sometime down the road.

awake-maroon•9/21/23, 5:18 PM

I don't know that it would be enough, but that isn't the point. A firm clear message is the point. There can be a lot more in the fine print.

awake-maroon•9/21/23, 5:19 PM

(And I'm sure there would be a mountain of fine print.)

full-green•9/23/23, 6:49 PM

I added a few suggested edits. Feel free to ping me at some point in the future if you want me to look at this again. I'm a little scattered.

scornful-crimson•9/26/23, 10:11 PM

avaaz.org could be another option

moderate-tomato•10/3/23, 11:24 PM

What if instead of change.org you use your website for such a petition? Change.org is mostly about anonymous petitions and they aren't very convincing.
One non-anonymous signature from person you know means more than 1k signatures from anonymous people.

hurt-tomatoOP•10/4/23, 5:59 AM

Definitely possible, I've built petition websites before. There is some extra technical barrier for doing it well though, e.g. Email confirmation

hurt-tomatoOP•10/6/23, 9:30 AM

I got some more advice to add it to the PauseAI website, one reason is that we can use the e-mails for getting people to join protests / newsletter etc.

hurt-tomatoOP•10/6/23, 9:34 AM

But it will be more of a technical challenge. I built a petition site before, and an e-democracy platform, so I know I can do it, but previous approaches were sub-optimal.

Github issue for technical discussion: https://github.com/joepio/pauseai/issues/14

GitHub

Petition · Issue #14 · joepio/pauseai

I'd like to do a petition (a la change.org / avaaz). Show signees Easy signature setting Only verified emails? This means the signatures are more credible, but it's also way more of a hassl...

awake-maroon•10/6/23, 3:06 PM

Ask GPT 4 for help.

hurt-tomatoOP•10/6/23, 3:10 PM

I did haha

hurt-tomatoOP•10/6/23, 3:10 PM

it suggested a bunch of tools that can't fix what i need

awake-maroon•10/6/23, 3:12 PM

bummer

awake-maroon•10/7/23, 9:25 AM

I still like this idea. I think it's useless unless made big though. I've seen our AI onder controle petitie get fairly big in the Netherlands. I think we should replicate this process internationally: call all the network we can gather before putting out the statement. Allow big names to change the phrasing. Then put it out, all at once, and get journalists to report on it. The statement itself should be drafted to be news-worthy.

ERO can help, but after Bletchley Park.

awake-maroon•10/7/23, 9:25 AM

If we want to do this, we should not put it online before that.

hurt-tomatoOP•10/7/23, 12:37 PM

Absolutely, we do it slow and big.

sacred-rose•1/27/24, 6:15 AM

I think this was done with the https://aitreaty.org at the end of october. It's a shame that even tho it was signed by important people I didn't see anywhere outside this server. I doubt it can be "revived"

Urging an International AI Treaty: An Open Letter | aitreaty.org

Leading researchers and experts call for the international community to forge an AI treaty in response to the potentially catastrophic risks posed by AI systems, aiming to ensure that AI is developed safely, responsibly, and for the betterment of humanity.

full-green•4/7/24, 6:24 PM

I bought a bunch of domains intended to advocate for a global referendum on this topic. Lets demand that wer should ask all earthlings if they are OK or Not with building AGI before we know beyond reasonable doubt that we have figured out how to do it without massive disasters or extinctions of humanity. I am willing to donate those domains to this organization.

full-green•4/7/24, 6:54 PM

worthy-azure•4/26/24, 1:24 PM

An Open Letter to Pause AI

In 2023, the Future of Life Institute and the Center for AI Safety released statements that heightened public awareness of AI risks and, in the case of the FLI letter, introduced the concept of an AI Pause to many people for the first time.

These letters sported the signatures of some of the world’s most influential figures in AI and tech policy, as well as countless other academics, policymakers, and public figures.

We can replicate these successes. If PauseAI publishes an open letter calling for a global moratorium on the development of human-level AI, perhaps modeled on our current proposal, this could catapult our proposal to international recognition virtually overnight. If we can accrue signatures from some of the most well-respected AI researchers (some of whom have already supported a Pause), this will add significantly to our legitimacy and that of our proposal.

Draft proposal/plan: https://docs.google.com/document/d/12DStX4xEN1DIfA9OIN3LcW4f6WcO3qn3TTXC650fTqg/edit?usp=sharing

Google Docs

PauseAI Open Letter: Action Plan

sacred-rose•4/26/24, 7:34 PM

I think it could be cool to try it in the future. at least after the next protests

Wworthy-azure An Open Letter to Pause AI In 2023, the Future of Life Institute and the Center...

yucky-gold•4/27/24, 6:19 AM

Interesting idea and it does intertwine with @Giulia Consonni Giulia's project. Do you have a draft text yet or still at that plan stage?

Yyucky-gold Interesting idea and it does intertwine with @Giulia Consonni Giulia's project. ...

improved-purple•4/27/24, 6:42 AM

The point of the ECI is to ask for a pause both at the EU level (with amendments to the AI act, for example) and globally (through initiation of treaty negotiations). The submission focus is on requesting the EU Commission to act in areas of its competence, so the treaty text is only an extra (despite being quite important!).
For this reason, and given that there are very valid treaty proposals in line with our goals, my idea was to promote a treaty proposal by someone else, who already spent 100s of hours on it, and has expertise on the topic.
One option would be the proposal by Miotti and Wasil. I already contacted their org, Control AI asking exactly this. Waiting for a reply atm.

Wworthy-azure An Open Letter to Pause AI In 2023, the Future of Life Institute and the Center...

improved-purple•4/27/24, 6:46 AM

I think this could be a great way of kickstarting the signature-gathering phase of the ECI and to get a lot of authoritative people on board, boosting our credibility - as you say. That would be fantastic.
Not sure how the signatures can be redirected to the official EU portal, while also added to the letter on PauseAI’s page.
We could brainstorm a few scenarios this can be pulled off, especially if the letter is published way before the ECI is registered.

Iimproved-purple The point of the ECI is to ask for a pause both at the EU level (with amendments...

yucky-gold•4/27/24, 8:35 AM

Sounds strategically sound, yes

Ban AGI Petition

Where to petition?

Text

Marketing

Similar Threads

Similar Threads

Similar Threads