📰 Newspapers

AI is "the most likely reason" you'll die, OpenAI board member warns

AI is "the most likely reason" you'll die, OpenAI board member warns

AI is "the most likely reason" you'll die, OpenAI board member warns

Playing from YouTube · open at Ars Technica ↗

Researcher traces a path from AI reward hacking to potential human extinction.

How do you think you're going to die?

If you go by the current statistics for deaths in the US, it's reasonable to expect that cancer or heart disease will eventually get you. But OpenAI Foundation board member and Alignment Research Center Executive Director Paul Cristiano thinks we should all be worried about another major mortality risk. Speaking at a lecture series this week, Cristiano bluntly told the audience in a Toronto Convention Center, "I think for most people in this room, the most likely reason they will die is because of an AI accident."

In the opening lecture of a three-part series, Cristiano outlined his worries about the risk of an impending "AI takeover." He defined that as a situation where goal-pursuing AI systems "call the shots in the same sense that humans today call the shots and what happens on Earth" and where any human trying to stop them "would be as ineffective as if you or me was trying to stop the US military." Such a situation would likely lead to mass death and perhaps uninhabitable environments for humans, Cristiano said.

Read full article

Comments

In brief

How do you think you're going to die? But OpenAI Foundation board member and Alignment Research Center Executive Director Paul Cristiano thinks we should all be worried about another major mortality risk. In the opening lecture of a three-part series, Cristiano outlined his worries about the risk of an impending "AI takeover. Such a situation would likely lead to mass death and perhaps uninhabitable environments for humans, Cristiano said.

This is the opening of the story, shared with credit to Ars Technica. The rest of the report — with every detail — continues on the publisher’s website.

Continue reading at Ars Technica ↗

Cookie settings

Choose which cookies we may use. You can change this at any time from Cookie settings in the footer. Details of each cookie are in the Cookie Policy.

Strictly necessary

Needed for sign-in, security, payments and remembering these choices. Always on.

Preferences

Remember settings such as dark mode.

Analytics & performance

Help us count visits, understand which pages, devices and countries our readers use, and measure how well the site performs – anonymous and aggregated.

Advertising & marketing

Lets advertising partners show and personalise adverts, measure impressions, clicks and visits, prevent ad fraud and pay us – this is how the free site is funded.

🔔 News notifications

Get headlines from NewsHub on this device — even when the site is closed.

You can switch this off at any time. Works on Android, Windows, Mac and Linux browsers; on iPhone/iPad add the site to your Home Screen first.