Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

F-35s & AI Chips: How MBS Outplayed Washington & Beijing

GVS Deep Dive  Saudi Arabia just secured two of the most powerful assets in modern geopolitics: the U.S. F-35 stealth fighter and tens of thousands of Nvidia’s most advanced AI chips. Washington hoped this would pull Riyadh firmly back into the American orbit. But the outcome is something neither side fully expected: Mohammad bin Salman outplayed both Washington and Beijing — and used the great-power rivalry to his advantage.

Greece, Palestine & Zionism: FPTV Reports from Athens

Free Palestine TV   Laith Marouf & Rabih Ghannam travel to Athens, Greece, and take a walking tour with local activists Evan Katsounis and Maria Kosmidi, to discover the rich history of anti-Zionist and anti-Fascist actions in the city, as well as the current Zionist incursion into the property sector and the counter actions directed at the presence of these War Criminals on the streets of the city. 

Trump RUINED: Israel First Lies & Economic Freefall Just ENDED MAGA

Danny Haiphong   Tucker Carlson isn't the only journalist breaking with Trump. In this video, Patrick Henningsen goes scorched earth on Trump's massive betrayal of what he promised his "MAGA" base and blows the lid off how his massive lies serve as a cover up for a much bigger structural problem in America's 'Israel First' political system, what Tucker and major voices in elite MAGA won't tell you.  

Trump BLEW IT: Israel, Candace Owens & Epstein BURY MAGA (But Not How You Think)

Danny Haiphong   Trump has bent the knee to Israel for the last time. Patrick Henningsen exposes his horrid record and all the elements that has led to his rapidly coming collapse. 

Capitalism & Genocide - Yanis Varoufakis Speech at the Gaza Tribunal, 23rd October 2025, Istanbul

Yanis Varoufakis   On 23rd October, Yanis Varoufakis testified in front of the Jury of Conscience in the context of the Gaza Tribunal. His speech focused on the economic forces underpinning the genocide of the Palestinian people. In particular, he spoke on the manner in which capitalist dynamics have historically fuelled the white settler colonial project and, more recently, how the accumulation of a new form of capital - which he calls cloud capital - has accelerated, deepened and amplified the economic forces powering and propelling the machinery of genocide. 

Varoufakis: IT technologies will overthrow Capitalism

globinfo freexchange The former Greek Minister of Finance, Yanis Varoufakis, ended his recent speech on the Future of Capitalism, at the New School, New York, with some interesting remarks. As he said: The world we live in, is increasingly rudderless, in a constant slow burning recession, while at the very same time, the increasing concentration in the IT sector is creating the new technologies that will do that which the Left has failed to do: overthrow Capitalism. It is really very simple. The moment machines pass the Turing test properly, and you pick up the phone and you do not know whether the person you are talking to is a human being or a machine ˙ the moment we are going to have 3D printers operating as public utilities - you can send any blueprint to it and it can print from one pin to a motorcycle, or to a car - the moment that this happens, we have not just a process of Schumpeterian creative destruction, but we have a process where economies of sc...

Racing Extinction

suggested by failedevolution.blogspot 18th Thessaloniki Documentary Festival Scientists predict that humanity’s footprint on the planet may cause the loss of 50% of all species by the end of the century. They believe we have entered the sixth major extinction in Earth’s history, following the fifth great extinction which took out the dinosaurs. Our era is called the Anthropocene, or “Age of Man,” because evidence shows that humanity has sparked a cataclysmic change of the world’s natural environment and animal life. Yet, we are the only ones who can stop the change we have created. The Oceanic Preservation Society (OPS), the group behind the Academy Award-winning film The Cove, is back with a new groundbreaking documentary. Joined by new innovators, this highly charged, impassioned collective of activists brings a voice to the thousands of species teetering on the very edge of life. The director has crafted an ambitious mission to clearly and artfu...

Trump Welcomes Syrian Leader & “REFORMED” TERRORIST To White House!

The Jimmy Dore Show   President Donald Trump is planning a White House welcome for Syria’s new president, former al-Qaeda in Iraq leader Ahmed al-Sharaa, who was installed after the overthrow of Bashar al-Assad. Jimmy Dore argues that the U.S. and its allies, including Israel, have long funded extremist groups such as ISIS and al-Qaeda to serve foreign policy interests in the Middle East, so the embrace of al-Sharaa makes sense, even if it might confuse anyone who thought we took seriously the so-called “War on Terror.” He and Americans’ Comedian Kurt Metzger contrast Trump’s willingness to meet with alleged terrorists to his refusal to engage in dialogue with leaders like Venezuela’s Nicolás Maduro, accusing U.S. policy of hypocrisy and imperialism.  

How The CIA & Mossad Set Up Sudan for Genocide since the 1990s

MintPress News   Sudan is being systematically destroyed - not by accident, but by design. This investigation reveals how US imperialism, through Israeli and UAE proxies, has engineered Sudan's collapse since the 1990s to crush the axis of resistance, block China's Belt and Road, and loot Africa's resources families are killed, children starve, and the west profits. 

Maduro's opening to China

“ Chinese President Xi Jinping on Wednesday said he hopes Venezuela will use bilateral financing mechanisms and channel more funds to the areas of energy, mining, agriculture and industry while meeting with Venezuelan President Nicolas Maduro.” “ Financing mechanisms between the two countries total more than 50 billion U.S. dollars, according to Venezuelan experts. Financing mechanisms, including the China-Venezuela Fund, have provided financial support for some 256 projects. China and Venezuela upgraded their relationship to a comprehensive strategic partnership during Xi's visit to Venezuela in 2014, opening a new chapter in bilateral ties.” “ During their meeting, Xi called on the two sides to push bilateral ties to a higher-level. China supports Venezuela's efforts in restructuring its economy and establishing a manufacturing economic model, he said. Xi suggested the two countries push forward cooperation in the fields of oil exploration, infrastru...