Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Zionists pushed Trump into the war with Iran but this was not the primary reason for this catastrophic decision

by system failure     It is widely reported by various analysts that Trump's catastrophic decision to start a war with Iran, came as a result of the pressure from Netanyahu regime and the Zionist lobby in US. While we can't ignore the strong influence of the Zionist factor on Trump and its significant role on dragging him into such a catastrophe, this was probably not the primary reason for the latest US-Iran war.  One has to look first at Venezuela and the unprecedented and rather bizarre operation there to remove Nicolas Maduro from power, in order to understand the deeper reasoning behind such a risky decision by Trump against Iran. The uniqueness of the operation in Venezuela by the US imperialist beast, has to do not only with the blatant violation of international law with almost zero pretexts, but also with the fact that the rest of the Maduro administration was left untouched and permitted to remain in power. This shows that the primary goal of this operation was ...

Israel CAUGHT Spying On Trump & HERE’S WHY!

The Jimmy Dore Show   What does Donald Trump do to stop Netanyahu, or punish Netanyahu, after he openly defies him and after Donald Trump knows that Israel's intelligence services are spying on him? It appears that he has done nothing.  

It's official: Iran won the war, and the US lost - This is how

Geopolitical Economy Report  The US government has signed an agreement to end its war on Iran. It is now widely admitted that Washington lost, and Tehran won. Ben Norton explains why Donald Trump failed, and how this has massive geopolitical implications for the Global South.

Trump CAVES On Uranium & Ballistic Missiles!

The Jimmy Dore Show   Jimmy Dore and Glenn Greenwald argue that President Trump is engaging in a stark retreat from earlier hardline positions on Iran by signaling acceptance of both Iranian uranium enrichment for civilian energy purposes and allowing Iran to possess conventional ballistic missiles. The two contend that these comments amount to major concessions, with Jimmy describing them as “another big win for Iran” and evidence that the administration has abandoned key objectives it previously promoted. Greenwald cites the Nuclear Non-Proliferation Treaty, arguing that Iran has the same right as other signatory nations to enrich uranium for peaceful purposes and notes that previous agreements imposed unusually strict inspections on Iran’s program. The segment emphasizes Trump’s remarks that “it’s a little bit unfair for them not to have some” ballistic missiles and that restrictions on civilian nuclear energy require “a little common sense.” 

‘SHEER EVIL’: MASS PANIC As Israel BOMBS HOSPITAL & RESORT, ‘FLATTENS’ BEIRUT!!

Secular Talk    

IRAN WAR: How Israel HIJACKED Trump & Lost the Middle East

Double Down News  

Προβλέψεις ...

GR elections Update (15/9): Αναθεωρημένες προβλέψεις (μετά το δεύτερο debate): ΣΥΡΙΖΑ 28-30% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 2,5-3% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (11/9): Αναθεωρημένες προβλέψεις (μετά το πρώτο debate): ΣΥΡΙΖΑ 25-28% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (04/9): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update (29/8): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 4-4,5% ΠΟΤΑΜΙ 4-4,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update : Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 26-27% ...

Iranian Professor Vali Nasr Reveals the TRUTH of Iran War

Cyrus Janssen  Professor Vali Nasr is one of the world’s leading experts on Iran, the Middle East, and U.S. foreign policy. In this exclusive interview, Nasr explains why the recent conflict may have strengthened Iran rather than weakened it, what Washington continues to misunderstand about Tehran, and whether the region has entered a new geopolitical era. They discuss Iran’s nuclear ambitions, the country’s relationship with China, America’s changing position in the world, and why 2026 could become a turning point for the Middle East.   

How Western societies lost their faith in Vision

Why people don't rise up massively today? Why there are no real revolutions? How we tolerate all things that have been imposed to us? These questions come up in people's minds more and more often today in Greece and abroad, due to the economic crisis. Some theories are circulated as an answer, among these, explanations which include, for example, the psychosynthesis of modern Greeks, but the truth is that there is something more fundamental behind this passive behaviour and concerns not only Greece, but the entire Western world. by system failure Prior to the beginning of the 20th century, Friedrich Nietzsche declares God's death and Western world will put all its hopes in science. Laplace's Determinism leads to the almighty man, who through science, can find all the answers for the world. Technology, which naturally comes from scientific discoveries, promises prosperity and a better life for the majority. Science becomes the central "pylon...

Israeli Military Analyst: IDF "Lost & D*ing In Great Numbers" in Lebanon

Katie Halper   Haim Bresheeth Zabner, ex Israeli military analyst explains why Hezbollah is so superior to the IDF. He says, "the IDF are lost and dying in great numbers in Lebanon. He also notes that Hezbollah are "amazing fighters". Haim Bresheeth Zabnner was Professor of Media and Cultural Studies at University of East London and then a Professorial Research Associate at the School of Oriental and African Studies (SOAS).He is Filmmaker, photographer, film studies scholar, and historian. His films include “A State of Danger,” a documentary on the first Palestinian Intifada. His books include "An Army Like No Other: How the Israel Defense Force Made a Nation."    Haim is the son of two Holocaust survivors and was raised in Israel. He is a member of Holocaust survivors and Descendents Against the Genocide and a founding member of Jewish Network for Palestine. On November 4, Haim was arrested over a speech he gave at a pro Palestine demonstration outside the res...