Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Telegram Founder & CEO Pavel Durov Arrested in France as Online Censorship Escalates

Glenn Greenwald  

Όσοι περνάν των χώρα της απόγνωσης παθαίνουν αμνησία ...

globinfo freexchange Δανειστήκαμε αυτή τη φράση από ένα παλιό κομμάτι της Ελληνικής ροκ μπάντας "Τρύπες", για να περιγράψουμε με λίγα λόγια αυτό που φαίνεται να έχει πάθει η Ελληνική κοινωνία.  Πώς είναι δυνατόν μια ολόκληρη κοινωνία να έχει ξεχάσει ποιοι τη χρεοκόπησαν; Ποιοι έστησαν το άθλιο σύστημα των κρατικοδίαιτων 'ημέτερων' και της οικογενειοκρατίας; Ποιοι έσωσαν τις τράπεζες με πακτωλό δισεκατομμυρίων σε βάρος της μεσαίας τάξης; Ποιοι έκαναν τη μίζα και το ρουσφέτι επάγγελμα; Πώς είναι δυνατόν αυτή η κοινωνία να ετοιμάζεται να ξαναφέρει στην εξουσία ένα κομμάτι αυτού του άθλιου πολιτικού κατεστημένου, με την επιστροφή μάλιστα του αμετανόητα νεοφιλελεύθερου Κυριάκου Μητσοτάκη και της ομάδας του;   Η απόγνωση που έφεραν εννέα χρόνια βάρβαρων νεοφιλελεύθερων πολιτικών και σκληρής λιτότητας και που ανάγκασε τη χώρα να διαβεί τον εφιαλτικό μονόδρομο της μόνιμης χρεοκοπίας, πρέπει να έπαιξε σημαντικό ρόλο.  Διότι ως γνωστόν, η απελπισία...

Netanyahu Threatens Lebanon With Genocidal Mayhem

Owen Jones   Where is the media outrage?  

Jul 2018 picks

Retired US army colonel implies that a war with Iran could start with a Vietnam-type false flag operation Corporate media begin typical operations to make progressives comply with the establishment WikiLeaks paper shows France & UK pioneers behind Libya breakup Twitter under fire on European Commission hypocrisy to 'stand with the Greek people' IMF mafia ready to repeat the big crime in Argentina The financial system of chaos: no one can tell the 'when', 'where' and ‘how’ of the next financial meltdown Standard and Poor's 'coincidentally' upgrades the Greek economy after Greece expels two Russian diplomats Jill Stein, Jeremy Corbyn, Bernie Sanders: a continuously rising political triplet proves that Socialism unites generations The idiotic circus of terror leads us to the final collapse WikiLeaks paper reveals Ecuadorian private business elites declared war on Rafael Correa right after his election and asked for US support Ho...

Norman Finkelstein & Jeremy Corbyn: THE INTERVIEW ISRAEL WANT TO BAN

Double Down News In a powerful and deeply personal conversation, political scientist Dr. Norman Finkelstein sits down with MP and former UK Labour Leader Jeremy Corbyn to analyse the ongoing crisis in Gaza, Western diplomatic inaction, and the media's framing of the conflict. From evaluating ICJ proceedings to dismantling mainstream media "gatekeeper" tactics, Finkelstein and Corbyn provide an unsparing critique of current geopolitical realities and explain why Gaza has become a defining moral touchstone for a new generation. Beyond foreign policy, the pair explore the broader societal shifts shaping world politics today. Drawing on four decades of political activism, they compare today's student movement to historical anti-Apartheid and anti-Vietnam War struggles, while examining the decline of social mobility, the commercialisation of higher education, and the impact of digital media on critical thinking and long-term political engagement.

Houthis Have Inflicted "Astronomical" Damage On U.S. & Israel

Katie Halper Katie Halper talks to Ashok Kumar about how the Houthis are making history: "this is the first time in history that you had the maintenance of a blockade from a force with no navy," Trump "doesn't know what to do about it" and they're inflicting "astronomical liabilities" on Israel and the U.S.  Ashok Kumar is a University of London Professor and a Green Party activist in the U.K.

CNN Host COMPLETELY DESTROYED By RFK For Lying About COVID & Vaxx!

The Jimmy Dore Show   In this video, Jimmy Dore offers a scathing critique of CNN's Dana Bash and her colleagues in the legacy media for their COVID-19 coverage, accusing them of being paid mouthpieces for pharmaceutical companies rather than skeptical journalists. He argues that Anthony Fauci systematically lied about masks, social distancing, natural immunity, and the virus's origin, while CNN and other networks censored dissenting scientists like Dr. Robert Malone and Dr. Peter McCullough. Dore points to documented financial ties between Pfizer and CNN, as well as statements from former medical journal editors confirming widespread industry corruption, to support claims that the pandemic response was manufactured for profit. The segment defends RFK Jr.'s questioning of vaccine science and measles narratives, concluding that mainstream media journalists who ridicule truth-tellers are cowardly accessories to a deadly medical fraud.

Trump PANICS As US BOMBS WEDDING & Iran GETS REVENGE!!

Secular Talk  /  Breaking Points

Προβλέψεις ...

GR elections Update (15/9): Αναθεωρημένες προβλέψεις (μετά το δεύτερο debate): ΣΥΡΙΖΑ 28-30% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 2,5-3% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (11/9): Αναθεωρημένες προβλέψεις (μετά το πρώτο debate): ΣΥΡΙΖΑ 25-28% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (04/9): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update (29/8): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 4-4,5% ΠΟΤΑΜΙ 4-4,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update : Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 26-27% ...

Frenzy celebrations by the Wall Street mafia for achieving primary target, thanks to Donald Trump!

Banksters must be drowning in champagne right now! globinfo freexchange With Trump administration taken over by Goldman Sachs , nothing can surprise us, anymore. The fairy tale of the 'anti-establishment' Trump who would supposedly fight for the interests of the forgotten - by the system - Americans, was collapsed even before Trump election. What's quite surprising, is how fast the new US president - buddy of the plutocrats, is offering 'earth and water' to the top 1% of the American society, as if they had not already enough at the expense of the 99%. His recent 'achievement', was to sign for more deregulation in favor of the banking mafia that ruined the economy in 2008, destroyed millions of working class Americans and sent waves of financial destruction all over the world. Europe is still on its knees because of the neoliberal destruction and cruel austerity. From thehill : President Trump Friday signed a pair of executive orde...