As AI advances, doomers warn the superintelligence apocalypse is nigh

2025-09-24 20:21:33 英文原文

作者:Martin Kaste

As AI advances, doomers warn the superintelligence apocalypse is nigh

The Anthropic website on a laptop arranged in New Hyde Park, New York, on Aug. 22. Anthropic is one of the leading artificial intelligence companies. The company's CEO was among those that signed a public statement in 2023 acknowledging the "risk of extinction from AI."

The Anthropic website on a laptop arranged in New Hyde Park, New York, on Aug. 22. Anthropic is one of the leading artificial intelligence companies. The company's CEO was among those that signed a public statement in 2023 acknowledging the "risk of extinction from AI." Gabby Jones/Bloomberg via Getty Images hide caption

toggle caption

Gabby Jones/Bloomberg via Getty Images

Nate Soares, president of the Machine Intelligence Research Institute, on the campus of UC Berkeley

Nate Soares, co-author of the book If Anyone Builds It, Everyone Dies, says time is running out to stop a superhuman AI from wiping out humanity. Martin Kaste/NPR hide caption

toggle caption

Martin Kaste/NPR

What happens when we make an artificial intelligence that's smarter than us? Some AI researchers have long warned that moment will mean humanity's doom.

Now that AI is rapidly advancing, some "AI Doomers" say it's time to hit the brakes. They say the machine learning revolution that led to everyday AI models such as ChatGPT has also made it harder to figure out how to "align" artificial intelligence with our interests – namely, keeping AI from outsmarting humans. Researchers into AI safety say there's a chance that such a superhuman intelligence would act quickly to wipe us out.

NPR's Martin Kaste reports on the tensions in Silicon Valley over AI safety.

For a more detailed discussion on the arguments for — and against — AI doom, please listen to this special episode of NPR Explains:

AI and the Probability of Doom

And for the truly curious, a reading list:

The abbreviated version of the "Everyone Dies" argument, in the Atlantic.

The "useful idiots" rebuttal, also in the Atlantic

The potential timeline of an AI takeover

Research into "AI Faking" and deception

Smith College economics professor James Miller reflects on the game theory of expecting AI apocalypse, while hoping for AI salvation

Maybe AI isn't speeding up smarter AI, at least not yet. Research from METR

Analysis — and skepticism — from experts about the near-term likelihood of human- or superhuman-level artificial intelligence

关于《As AI advances, doomers warn the superintelligence apocalypse is nigh》的评论


暂无评论

发表评论

摘要

As AI advances rapidly, some researchers, referred to as "AI Doomers," warn that the development of superintelligent AI poses an existential risk to humanity. These concerns stem from the difficulty in aligning such advanced AI with human interests, potentially leading to catastrophic outcomes. NPR's Martin Kaste reports on the growing tensions within Silicon Valley regarding AI safety and the likelihood of an AI apocalypse.