Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Capitalism & Genocide - Yanis Varoufakis Speech at the Gaza Tribunal, 23rd October 2025, Istanbul

Yanis Varoufakis   On 23rd October, Yanis Varoufakis testified in front of the Jury of Conscience in the context of the Gaza Tribunal. His speech focused on the economic forces underpinning the genocide of the Palestinian people. In particular, he spoke on the manner in which capitalist dynamics have historically fuelled the white settler colonial project and, more recently, how the accumulation of a new form of capital - which he calls cloud capital - has accelerated, deepened and amplified the economic forces powering and propelling the machinery of genocide. 

Iranian Seyed M. Marandi: What REALLY happened in Iran & why U.S. wants to destroy the country

Li Jingjing 李菁菁   Track records of Western interventions tell us we need to be skeptical and cautious whenever some Western politicians and pundits claim they want to liberate people in another country and bring them democracy. Seyed Mohammad Marandi is a professor at the University of Tehran in Iran. In this episode, he told Li Jingjing what happened during the protests in Iran and how Western sanctions hurt the lives of ordinary Iranians.

Iran’s Missiles will DESTROY US Bases & Israel if Trump Attacks

Danny Haiphong   Iran is ready for war, and its hypersonic ballistic missile system could destroy Israel & US military presence forever says Scott Ritter who joined the show to break down the consequences of Trump's march to war with Iran. The former UN Weapons Inspector does a deep dive into Iran's readiness and why it should terrify Trump & Israel together. 

Israel & CIA Behind Iran Protests To Get U.S. To Attack!

The Jimmy Dore Show    As protests in Iran have heated up, western media has actively exaggerated and selectively framed the violence by using casualty figures from U.S.- and Israel-funded NGOs — all in order to build public support for another regime-change war. Former CIA officer John Kiriakou and guest Scott Ritter claim protests were infiltrated by foreign intelligence networks and that Israel and the U.S. are using “human rights” narratives similarly to the way they were used in Iraq and Syria.   Dore and Ritter contend that Iran’s government responded to armed unrest rather than peaceful protest, while mainstream outlets ignore attacks on police and public infrastructure. They warn that propaganda, sanctions, and media coordination are laying the groundwork for a wider U.S.–Israel conflict with Iran. 

US & Israel support protests in Iran: Trump calls for regime change

Geopolitical Economy Report   The US government is openly backing the protests in Iran. An Israeli media outlet admitted foreign powers are arming Iranian rioters with weapons to try to overthrow the government. Ben Norton explains the geopolitical context and why the USA has sought regime change ever since the 1979 Iranian Revolution.   

Iran's Next Strike OBLITERATES US Navy & Israel, War Has BEGUN

Danny Haiphong   Prof. Mohammad Marandi joins the show to react to Iran's vow to strike a devastating blow to the heart of Tel Aviv and US Navy as imminent US war approaches. Trump has moved military assets to the region and now Iran has responded by moving its missiles and drones in strike position. Watch until the end for an in-depth analysis of a war that's already begun, and is about to change everything with one fatal move by the US empire.

Ο βασικός λόγος που ο Τραμπ διστάζει να χτυπήσει το Ιράν

"Μικρά και ασήμαντα" από τον Πίκο Απίκο Ο βασικός λόγος που δεν έγινε η επίθεση στο Ιράν, είναι το γεγονός ότι πρόσφατα, το Ιράν αποχώρησε από το δορυφορικό σύστημα GPS που είναι Αμερικανικό και εντάχθηκε στο Κινεζικό BeiDou. Που σημαίνει ότι οι Αμερικανοί δεν έχουν τη δυνατότητα να σαμποτάρουν τους Ιρανικούς πυραύλους.  Έτσι εξηγείται και το μεγάλο ποσοστό ευστοχίας των Ιρανικών πυραύλων στην τελευταία σύγκρουση με το Ισραήλ, μέσα στο Ισραηλινό έδαφος. Αλλά και το γεγονός ότι πριν λίγες μέρες, οι ίδιοι οι Ισραηλινοί ζήτησαν τη διαμεσολάβηση της Ρωσίας, προκειμένου να αποκλιμακωθεί η ένταση με το Ιράν, αφού Ισραηλινές εφημερίδες και αξιωματούχοι είχαν παραδεχθεί ανοιχτά την παρουσία πρακτόρων της Μοσάντ σε Ιρανικό έδαφος και τον κομβικό τους ρόλο στις πρόσφατες εξεγέρσεις. Οι Αμερικανοί επομένως γνωρίζουν ότι αυτή τη στιγμή οι Ιρανοί έχουν τη δυνατότητα να χτυπήσουν Αμερικανικές βάσεις (όπως απείλησαν ότι θα κάνουν αν ο Τραμπ κάνει πράξη τις απειλές του), χωρίς να μπορούν να ...

Billionaires are social distancing in super yachts as tens of millions lose jobs

Everyday, it becomes clearer: the COVID-19 pandemic is hitting poor, working, and marginalized communities the hardest. Millions of workers – especially low-wage retail, food service, hospitality, and care workers – have faced the terrible choice daily between going to work and risking their health, or staying home and risking their paychecks. Many other workers don’t even have that choice, with around 30 million people in the US filing for unemployment in the past six weeks. But billionaires don’t face these same problems. As tens of millions have lost their jobs over the past two months, billionaire wealth soared by a whopping $282 billion between March 18 and April 10, according to a new study from the Institute for Policy Studies.  And while finding enough space to wait out the pandemic is something many struggle with, billionaires have been escaping to their second (or third, or fourth) homes to ride it out in luxury – all while they position themselves to ...

A response to misinformation on Nicaragua: it was a coup, not a ‘massacre’

There is so much misinformation in mainstream corporate media about recent events in Nicaragua that it is a pity that Mary Ellsberg’s article for Pulse has added to it with a seemingly leftish critique. Ellsberg claims that recent articles, including from this website, often “ paint a picture of the crisis in Nicaragua that is dangerously misleading. ” Unfortunately, her own article does just that. It looks at the situation entirely from the perspective of those opposing Daniel Ortega’s government while whitewashing their malevolent behavior and downplaying the levels of US support they have relied on. Her piece is an incomplete depiction of what is happening on the ground, ignoring many salient facts that have come to light and which have been outdated by recent events. The following is a brief response to Ellsberg’s main points from someone who lives in Nicaragua and has observed the situation directly and intimately: https://grayzoneproject.com/2018/08/15/a-res...

The real reason Trump hesitates to strike Iran

globinfo freexchange   Recent statements by the Iranian leadership concerning the ability of Iran to hit US military bases, should not be taken lightly. It is not just the missile capability and - in some cases - even superiority of Iran in the broader region. That alone, would not be enough for Washington to take Tehran's threats seriously.    It has to do also with a strategic move by Iran in the geopolitical battlefield that changes the balance decisively in the war field too. As Pakistan Today reported back in July 2025:   In two recent wars that nearly tipped the world into a full-scale global conflict— one between Pakistan and India, and the other between Iran and Israel— a new determinant of military dominance emerged. In both cases, countries under pressure, Pakistan and Iran, not only stood their ground but struck deep into enemy territory with astonishing precision and devastating impact.  ... in a 12-day war with Israel, Iran destroyed numerous h...