Skip to main content

Artificial Intelligence is coming, and it could wipe us out if we’re not careful

The RSA information security conference this week in San Francisco has been a labyrinth filled with professionals who believe they know best when it comes to information and the Internet. But what if in 25 years humans are no longer good enough to be the gatekeepers of the Internet?

Nick Bostrom, a professor of philosophy at the University of Oxford and founding director of the Future of Humanity Institute, spoke in a keynote address at the Moscone Center conference about the “Midas effect” of wanting artificial intelligence (AI) as smart as humans and ignoring potential downsides.

You would no longer have some cool technology toy [in AI],” Bostrom said. “You would have the last invention that humans will need to make.

During his 30-minute talk, Bostrom outlined three points about AI: Artificial intelligence on a level with human intelligence is a very good likelihood by 2050; the rise of superintelligent machines beyond the control of humans may be a possibility; and superintelligence could either prove a path to “cosmic endowment”—the potential to colonize the universe using technology—or to the extinction of the human race.

While his talk of cosmic endowment may sound a bit New Age, Bostrom has been one of the most prominent scholars on the philosophy and ethics behind AI, frequently speaking in TED talks and featured in articles, including ones in The New Yorker and The Atlantic. His skeptical view of the robotic future has the support of such Silicon Valley executives as Tesla CEO Elon Musk.

Bostrom's talk also surveyed the current innovations in the artificial intelligence community, ranging from cybersecurity (hence the invitation to RSA) to lethal automatic weapons like predator drones. Bostrom expressed both excitement and concern over the recent zeal for AI technology, most notably with the recent news of Google’s deep-learning AI system's “dreaming” of psychedelic-looking images. Using the fable of King Midas as an example, Bostrom worried about engineers’ “literal fulfillment of a wish but with qualifications.

According to a survey he conducted among industry experts, most predicted a 50 percent likelihood of human-level AI being available between 2040 and 2050. With decades to mitigate the “extinction risk,” a phrase he coined in 2002, Bostrom hoped for more pre-emptive caution. “[AI’s] still a fragile thing,” Bostrom said. “The view that we will have machine intelligence in our lifetimes is not some ridiculous idea but a very mainstream idea.

Source:


Related:

Comments

Popular posts from this blog

Capitalism & Genocide - Yanis Varoufakis Speech at the Gaza Tribunal, 23rd October 2025, Istanbul

Yanis Varoufakis   On 23rd October, Yanis Varoufakis testified in front of the Jury of Conscience in the context of the Gaza Tribunal. His speech focused on the economic forces underpinning the genocide of the Palestinian people. In particular, he spoke on the manner in which capitalist dynamics have historically fuelled the white settler colonial project and, more recently, how the accumulation of a new form of capital - which he calls cloud capital - has accelerated, deepened and amplified the economic forces powering and propelling the machinery of genocide. 

Gaza 2 Years On: Yanis Varoufakis & Katie Halper on the Flotilla, Israel's PR Machine & What’s Next

DiEM25   Two years since October 7, Katie Halper (‪@TheKatieHalperShow‬) and Yanis Varoufakis join host Mehran Khalili to break down Israel’s genocide in Gaza, the latest on the flotilla, Israel’s influencer PR push, and the “peace plan”.  

The Rise of the Thielverse & the Surveillance State

The Chris Hedges YouTube Channel  Whitney Webb traces the Thielverse’s rise and the construction of the bipartisan modern surveillance state that Trump and his benefactors are deploying against dissidents and immigrants today.

Freedom Flotilla Coalition & Thousand Madleens to Gaza sailing to break the siege

Freedom Flotilla Coalition   The next wave is already being prepared, help us buy the boats and get them ready to sail!  

World leaders rebel against US & Israel: to save Gaza, they demand international intervention

Geopolitical Economy Report   Leaders from dozens of countries condemned the USA and Israel in their speeches at the UN General Assembly, demanding international intervention to save Gaza. Diplomats staged a mass walkout to protest Netanyahu's speech. Ben Norton shows how Latin American governments are standing in solidarity with Palestine.  

A response to misinformation on Nicaragua: it was a coup, not a ‘massacre’

There is so much misinformation in mainstream corporate media about recent events in Nicaragua that it is a pity that Mary Ellsberg’s article for Pulse has added to it with a seemingly leftish critique. Ellsberg claims that recent articles, including from this website, often “ paint a picture of the crisis in Nicaragua that is dangerously misleading. ” Unfortunately, her own article does just that. It looks at the situation entirely from the perspective of those opposing Daniel Ortega’s government while whitewashing their malevolent behavior and downplaying the levels of US support they have relied on. Her piece is an incomplete depiction of what is happening on the ground, ignoring many salient facts that have come to light and which have been outdated by recent events. The following is a brief response to Ellsberg’s main points from someone who lives in Nicaragua and has observed the situation directly and intimately: https://grayzoneproject.com/2018/08/15/a-res...

Προβλέψεις ...

GR elections Update (15/9): Αναθεωρημένες προβλέψεις (μετά το δεύτερο debate): ΣΥΡΙΖΑ 28-30% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 2,5-3% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (11/9): Αναθεωρημένες προβλέψεις (μετά το πρώτο debate): ΣΥΡΙΖΑ 25-28% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (04/9): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update (29/8): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 4-4,5% ΠΟΤΑΜΙ 4-4,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update : Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 26-27% ...

Will Mamdani manage to liberate New York from brutal neoliberalism?

globinfo freexchange    Fifty years ago, New York City was on the verge of collapse . The politicians who run the city had borrowed more and more money from the banks to pay for its growing services and welfare. But in the early 70s, the middle classes fled from the city and the taxes they paid disappeared with them. So, the banks lent the city even more. But then, they began to worry about the size of the growing debt and whether the city would ever be able to pay it back. And then, one day in 1975, the banks just stopped.   The city held its regular meeting to issue bonds in return for the loans, overseen by the city's financial controller. The banks were supposed to turn up at 11 a.m., but it soon became clear that none of them were going to appear. The meeting was rescheduled for 2 p.m. and the banks promised they would turn up. What happened that day in New York, marked a radical shift in power. The banks insisted that in order to protect their loans, they sho...

The REAL reason why Trump is attacking Latin America

Geopolitical Economy Report   The Donald Trump administration seeks to forcibly impose the US empire's hegemony in Latin America, waging war on Venezuela, imposing sanctions on Colombia's President Gustavo Petro, hitting Brazil with tariffs, and meddling in Argentina's election. Ben Norton explains how Trump and Marco Rubio are trying to cut off all western hemisphere ties with China and Russia, bringing back the colonial Monroe Doctrine, now known as the Donroe Doctrine.   

How Western media helped build and then protect the Israeli narrative that allowed a genocide to continue

globinfo freexchange    For two years, Palestinians in Gaza have been killed in 4K on all of our screens. And for those same two years, many of the Western media institutions meant to hold power to account chose silence, distortion and doubt. Newsrooms repeated Israel's allegations with no pushback, ignored the evidence of genocide even as it played out live. This isn't a story about bias or mistakes. It's a story about how Western media helped build and then protect the Israeli narrative that allowed a genocide to continue.  So, how many Palestinian lives have been lost because the world's news outlets chose to repeat Israel's narrative instead of questioning it?    From the earliest days following October 7th, Israel's talking points were treated as fact. The now disproven claims of 40 beheaded babies and the story that Hamas used Palestinian civilians as human shields revived with every bombing of a hospital or school despite the mountain of evidence that it...