Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Trump Talks COLLAPSE SPECTACULARLY As Iran REFUSES DEMANDS & HUMILIATES HIM Again & Again!!

Secular Talk    

Προβλέψεις ...

GR elections Update (15/9): Αναθεωρημένες προβλέψεις (μετά το δεύτερο debate): ΣΥΡΙΖΑ 28-30% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 2,5-3% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (11/9): Αναθεωρημένες προβλέψεις (μετά το πρώτο debate): ΣΥΡΙΖΑ 25-28% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 11-13% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ + ΔΗΜΑΡ 3-4% ΑΝΕΛ 2,5-3,5% Update (04/9): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 3,5-4% ΠΟΤΑΜΙ 2,5-3,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update (29/8): Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 23-25% ΛΑΕ + ΣΧΕΔΙΟ Β' κ.λ.π. 20-23% ΝΔ 12-15% ΧΑ 6-8% ΚΚΕ 5-5,5% ΕΝΩΣΗ ΚΕΝΤΡΩΩΝ 4-4,5% ΠΟΤΑΜΙ 4-4,5% ΠΑΣΟΚ 3-4% ΑΝΕΛ 2,5-3,5% Update : Αναθεωρημένες προβλέψεις: ΣΥΡΙΖΑ 26-27% ...

The West's hypocrisy has been exposed: This is how

Geopolitical Economy Report   Donald Trump's attacks on longtime US "allies" have forced Western leaders to admit their warmongering foreign policy was hypocritical. Canada's Prime Minister Mark Carney said the truth in his speech at the World Economic Forum in Davos: the "rules-based order" was "false". Ben Norton explains how the global balance of power is shifting.

Iranian Women Resist Invasion, Hospitals Targeted & Petrodollar Collapse

MintPress News   MintPress News founder Mnar Adley, this essential interview with University of Tehran professor Dr. Setareh Sadeghi reveals the devastating reality of US-Israeli aggression against Iran that corporate media refuses to report. With over 307 medical facilities destroyed in one month, schools bombed, and universities targeted, Iran faces what officials describe as a genocidal campaign. Dr. Sadeghi exposes: • How BBC journalists calling for Iran to be "nuked" are tied to CIA-backed regime change networks • Why Iranian women are leading mass rallies in defense of their nation—not against it • The collapse of Western propaganda as independent Iranian creators go viral worldwide • How Iran's regulation of the Strait of Hormuz is accelerating the petrodollar's decline • UAE's covert complicity in war crimes while positioning itself as a neutral party • Why Russia and China are aligning with Iran against unipolar imperial domination As Trump threatens to ...

Greeks BLOCK Israelis From Entering Their Country

Revolutionary Change   In a continuing worldwide trend, Greeks are now attempting to block Israelis from entering their country amid them attempting to flee the consequences of their actions. Peter Hager delves into this recent trend.

Stephen Hawking confirms: The problem is Capitalism, not robots!

globinfo freexchange According to world famous physicist Stephen Hawking, the rising use of automated machines may mean the end of human rights – not just jobs. But he’s not talking about robots with artificial intelligence taking over the world, he’s talking about the current capitalist political system and its major players. On Reddit, Hawking said that the economic gap between the rich and the poor will continue to grow as more jobs are automated by machines, and the owners of said machines hoard them to create more wealth for themselves. The insatiable thirst for capitalist accumulation bestowed upon humans by years of lies and terrible economic policy has affected technology in such a way that one of its major goals has become to replace human jobs. If we do not take this warning seriously, we may face unfathomable corporate domination. If we let the same people who buy and sell our political system and resources maintain control of automated technology, the...

The dominant elite ready to break the "social contract"

Hyper-automation will allow the super-rich to “get rid” of the rest by system failure Since the French revolution and the new form of the urban states-democracies, the ruling class had to make the so-called "social contract" with the majority. From the moment that the dominant urban class took the power from feudalism and monarchy, should had to find a way to protect the means of production and the labor force. Therefore, the ethnic consciousness in each state served to bound the majority in order to shape national armies to protect the ruling class interests. In exchange, the ruling urban class had given the so-called social state, labor rights, etc., through the nation-state as a carrier and guarantor for all these benefits for the middle and lower classes. Since then, there have been a lot of battles and the majority managed to conquer some benefits. At the start of 20th century, the technology progress had brought the mass production. Western s...

Project Mythos: Too Dangerous to Release — So the U S Got It First

GVS Deep Dive   In the middle of rising geopolitical tensions and the Iran–U.S. conflict, a powerful new AI model quietly emerged—one that may reshape cybersecurity, financial systems, and the global economy. Built by Anthropic, the model—Claude Mythos—was reportedly considered too dangerous to release publicly. Instead, it is being tested under Project Glasswing by major tech companies like Amazon, Apple, Microsoft, and cybersecurity leaders like CrowdStrike and Palo Alto Networks. The model has demonstrated the ability to detect and exploit software vulnerabilities across operating systems, web infrastructure, and critical digital systems—raising serious questions about cyber warfare, financial security, and national defense. With involvement from U.S. institutions like the U.S. Department of the Treasury and the Federal Reserve, this may represent a major shift in how governments approach artificial intelligence, cybersecurity, and global power competition. As AI capabilities a...

First predictions for the snap elections in Greece

Greek elections globinfo freexchange First predictions for the snap elections in Greece have started already. According to the German newspaper Bild, SYRIZA appears with heavy losses with a percentage of 28%. Close to SYRIZA is the right-Wing New Democracy with 25% (little less than 3% lower than in previous elections) and the new Popular Unity party that came from the split of SYRIZA, appears to gather 8% of the votes. All first polls show significant losses for Alexis Tsipras and SYRIZA. In the last few days, many members of the party have resigned and Tsipras has to deal also with the internal crisis in his party after the split according to the plan B of the Brussels bureaufascists. Most of the early predictions give Lafazanis' Popular Unity a percentage of 7-8%, while SYRIZA's partners in the coalition government, Independent Greeks, struggle to reach the crucial 3% to enter the new parliament. In any case, the split of SYRIZA creates an even...

Billionaires are social distancing in super yachts as tens of millions lose jobs

Everyday, it becomes clearer: the COVID-19 pandemic is hitting poor, working, and marginalized communities the hardest. Millions of workers – especially low-wage retail, food service, hospitality, and care workers – have faced the terrible choice daily between going to work and risking their health, or staying home and risking their paychecks. Many other workers don’t even have that choice, with around 30 million people in the US filing for unemployment in the past six weeks. But billionaires don’t face these same problems. As tens of millions have lost their jobs over the past two months, billionaire wealth soared by a whopping $282 billion between March 18 and April 10, according to a new study from the Institute for Policy Studies.  And while finding enough space to wait out the pandemic is something many struggle with, billionaires have been escaping to their second (or third, or fourth) homes to ride it out in luxury – all while they position themselves to ...