Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Why are Israeli war criminals hiding out in Patagonia?

The Grayzone   The Grayzone 's Oscar Leon examines reports of Israeli veterans of Gaza hiding out in the Patagonia region of Argentina, a country governed by a hardcore supporter of Israel who has forged close ties to messianic networks and the government of Benjamin Netanyahu. To place the issue in a wider context, Leon spoke to veteran Argentine journalist Sebastian Salgado, and Santiago Cuneo, a former boss of Milei and now one of his fiercest opponents. 

BRICS expands to majority of world population: Vietnam joins, USA fails to divide China & Vietnam

Geopolitical Economy Report   BRICS has expanded to 20 countries - 10 members and 10 partners - after adding Vietnam. BRICS+ now makes up 43.93% of world GDP (PPP) and 55.61% of the global population. Ben Norton explains how the US failed to divide China and Vietnam in the Second Cold War. 

Trump Welcomed a War Criminal to the White House

Senator Bernie Sanders   Benjamin Netanyahu has been indicted as a war criminal. His government is systematically killing and starving the people of Gaza. He will be remembered as one of the monsters of modern history. And Trump welcomed him to the White House.  

Funcionario de Trump: el director de la CIA “toma dictado” del Mossad sobre Irán

Un funcionario de la administración Trump le cuenta a The Grayzone que el Mossad israelí está usando al director de la CIA, John Ratcliffe y al jefe del CENTCOM, general Michael Kurilla, para influenciar a Trump con inteligencia manipulada sobre el programa nuclear iraní. Dentro de la Casa Blanca, los disidentes han sido aislados, preparando el terrenno para una guerra de cambio de régimen que pudiera costar vidas estadounidenses.   Max Blumenthal and Anya Parampil  Parte 4 - La jefa de gabinete aísla a Trump con “el general favorito de Israel”   El funcionario de la administración le contó a The Grayzone que la jefa de gabinete de la Casa Blanca, Suzie Wiles, se aseguró de que el presidente permaneciera rodeado por Ratcliffe y el general Michael Kurilla en los briefings relacionados con Irán. Se dice que Ratcliffe toma dictado del Mossad y lee los documentos que ellos prepararon al presidente sin ningún sentido de desapego crítico, o revelar que las valoraciones provinie...

As Trump threatens BRICS, it grows stronger, resisting US dollar and Western imperialism

Geopolitical Economy Report   US President Donald Trump has threatened heavy tariffs on BRICS, claiming the organization is "dead", but it is actually growing in size and influence. 10 members and 10 partners participated in the 2025 BRICS summit in Brazil, where they discussed plans for dedollarization, trade and investment in national currencies, and how to create a more multipolar global order. Ben Norton explains.     Related:   Trump's tariffs: A unique opportunity for BRICS and the Global South to fully escape from dollar tyranny

SHOCKING Outburst in EU Parliament: ‘Isráel Must Be Held Accountable!

The Africa News Network  

Israel is responsible for one of the cruelest genocides in modern history

UN Palestinian Rights Committee   In her address to the Human Rights Council on 3 July 2025, Francesca Albanese, the UN Special Rapporteur on the situation of human rights in the Palestinian territories occupied since 1967, warned of a genocide unfolding in Gaza and the West Bank.    She described the situation as “apocalyptic,” stating that “Israel is responsible for one of the cruelest genocides in modern history.”    With over 200,000 Palestinians reported killed or injured and the real toll “far higher,” she accused Israel of dismantling humanitarian aid in Gaza, replacing it with a “so-called 'Gaza Humanitarian Foundation' [that] is nothing else than a death trap.”    She emphasized that this was not an isolated crisis but part of a decades-long “settler colonial project of erasure” that has intensified in recent months through military force, starvation, and mass displacement. Albanese condemned the deep complicity of corporate and state actors i...

Israel Is Building A CONCENTRATION CAMP In Gaza

Owen Jones                    There are no pretenses here. No pretenses at all. This is a genocide being committed in front of the whole world.  

Trump’s Tariff Threat on BRICS BACKFIRES— Is He Fueling the Rebellion?

GVS Deep Dive   Donald Trump just slapped a 10% tariff threat on BRICS countries — calling them “anti-American” and accusing them of trying to destroy the U.S. dollar. But instead of weakening the bloc, his aggressive posture might be doing the opposite.   GVS Deep Dive unpacks Trump’s July 2025 tariff ultimatum, the explosive Truth Social posts, and the BRICS summit response from leaders like Lula and Modi. From new financial systems like BRICS Pay to de-dollarization and sovereign trade in local currencies, the Global South is pushing back. And here’s the twist: as Trump tries to defend the dollar with threats, he may actually be accelerating the very rebellion he fears. 🎯 Why is the U.S. struggling to sign new trade deals? 🇮🇳 Will India bend under Trump’s pressure — or break away? 🌍 Is BRICS the future of global power? 📉 And what happens if the dollar really does decline?     Related:  Trump's tariffs: A unique opportunity for BRICS and the Global So...

Spying on Iran: How MI6 infiltrated the IAEA

Leaked confidential files indicate the International Atomic Energy Agency was infiltrated by a veteran British spy who has claimed credit for sanctions on Iran. The documents lend weight to the Islamic Republic’s accusation that the nuclear watchdog secretly colluded with its enemies. by Kit Klarenberg Part 2 - Langman’s name placed under official UK censorship order In 2016, Langman was named a Companion of the Order of St Michael and St George, the same title bestowed on fictional British spy James Bond. By that point, the supposed secret agent held the dubious distinction of being publicly ‘burned’ as an MI6 operative on two separate occasions. First, in 2001, journalist Stephen Dorril revealed that Langman had arrived in Paris weeks prior to Princess Diana’s fatal car crash in the city on August 31 1997, and was subsequently charged with conducting “information operations” to deflect widespread public speculation British intelligence was responsible for her death. Then, in 2005, he...