Skip to main content

Monitoring hyper-automatization: The self-destruction of scientists and all kinds of researchers?

Arguments, questions and philosophical extensions from the possibility of super intelligent Artificial Intelligence

globinfo freexchange

Nick Bostrom reveals the potential dangers of the super intelligent Artificial Intelligence (AI) deployment, and another occupation to be threatened in the not so distant future by the machines: Scientists and researchers responsible for this deployment!

Nick Bostrom’s job is to dream up increasingly lurid scenarios that could wipe out the human race: Asteroid strikes; high-energy physics experiments that go wrong; global plagues of genetically-modified superbugs; the emergence of all-powerful computers with scant regard for human life—that sort of thing. In the hierarchy of risk categories, Bostrom’s specialty stands above mere catastrophic risks like climate change, financial market collapse and conventional warfare. As the Director of the Future of Humanity Institute at the University of Oxford, Bostrom is part of a small but growing network of snappily-named academic institutions tackling these "existential risks": the Centre for the Study of Existential Risk at the University of Cambridge; the Future of Life Institute at MIT and the Machine Intelligence Research Institute at Berkeley. Their tools are philosophy, physics and lots and lots of hard math.”

"... developments in artificial intelligence will gather apace so that within this century it’s conceivable that we will be able to artificially replicate human level machine intelligence (HLMI). Once HLMI is reached, things move pretty quickly: Intelligent machines will be able to design even more intelligent machines, leading to what mathematician I.J. Good called back in 1965 an 'intelligence explosion' that will leave human capabilities far behind.

... once a super intelligence is reached, present and future humanity become the gorillas; stalked by a more powerful, more capable agent that sees nothing wrong with imprisoning these docile creatures or wrecking their natural environments as part of a means of achieving its aims.”

Bostrom gives the example of a super intelligent AI located in a paperclip factory whose top-level goal is to maximize the production of paperclips, and whose intelligence would enable it to acquire different resources to increase its capabilities. 'If your goal is to make as many paperclips as possible and you are a super-intelligent machine you may predict that human beings might want to switch off this paperclip machine after a certain amount of paperclips have been made,' he says. 'So for this agent, it may be desirable to get rid of humans. It also would be desirable ultimately to use the material that humans use, including our bodies, our homes and our food to make paperclips.' 'Some of those arbitrary actions that improve paperclip production may involve the destruction of everything that we care about. The point that is actually quite difficult is specifying goals that would not have those consequences.'”

It is questionable whether we can characterize a machine as super-intelligent in case that it seeks to survive just to produce paper clips! It would be more probable to understand the production necessity limit by itself based on pure, simple logic: no consumption = no need for production and therefore, self-evolve to a more advanced machine, producing more sophisticated products which would still have value. Besides, 3D printers already produce various products through various materials. It is unlikely that the super-intelligent machines of the future will have a mission to build only one product, even if it would not be that simple as paper clips.

The threat of superintelligence is to Matheny far worse than any epidemic we have ever experienced. 'Some risks that are especially difficult to control have three characteristics: autonomy, self-replication and self-modification. Infectious diseases have these characteristics, and have killed more people than any other class of events, including war. Some computer malware has these characteristics, and can do a lot of damage. But microbes and malware cannot intelligently self-modify, so countermeasures can catch up. A superintelligent system [as outlined by Bostrom] would be much harder to control if it were able to intelligently self-modify.'”

Maybe self-modification is not he big issue here. In any case, whether we are talking about humans, machines, viruses, computers, or any other kind of biological entity, or machine, one thing is common to all these: Energy consumption. Therefore, assuming that there will be a battle for survival, the winner will probably be the one who will manage to cut energy supply to the "enemy" and maintain its own.

Meanwhile, the quiet work of these half dozen researchers in labs and study rooms across the globe continues. As Matheny puts it: 'existential risk [and superintelligence] is a neglected topic in both the scientific and governmental communities, but it's hard to think of a topic more important than human survival.' He quotes Carl Sagan, writing about the costs of nuclear war: 'We are talking about [the loss of life of] some 500 trillion people yet to come. There are many other possible measures of the potential loss—including culture and science, the evolutionary history of the planet and the significance of the lives of all of our ancestors who contributed to the future of their descendants. Extinction is the undoing of the human enterprise.'”

Nevertheless, another question emerge: What if AI is meant to be the next step of human evolution itself? What difference does it make when we progressively abolishing human conquered concepts, like morality, from our culture?

If we want truly evolve, as humanity, we need to bring back morality. We need to develop concepts like solidarity, altruism, collectivity and put them in the core of our civilization. Otherwise, it would make no difference - and probably would be better - to be replaced by super-intelligent machines.


Probably AI has already started, after all:

At last count, Twitter had 271 million monthly active users, or less than a third of big brother Facebook’s billion-strong base. After five straight quarters of decelerating growth, the rate at which Twitter is picking up new users has finally bounced back a bit. The company has also said it will start reporting usage metrics in ways that better reflect the true reach of the platform — after all, many of the people who saw some of Twitter’s most iconic tweets, like Obama’s victory photo and Ellen’s Oscar selfie, are not registered users.”

The company says that up to 8.5 percent of its users or 23 million 'used third party applications that may have automatically contacted our servers for regular updates without any discernable [sic] additional user-initiated action.' In other words? Robots.”


Previous:

Comments

Popular posts from this blog

Netanyahu Is Getting His War Between The U.S. & Iran!

The Jimmy Dore Show   Little progress is being made in negotiations between the United States and Iran over the latter’s nuclear program, and that may be by design. The U.S. is demanding a complete dismantling of Iran’s nuclear enrichment program, which is a non-starter for the Iranians. Meanwhile, the U.S. appears to have reneged on a promise to get a ceasefire and humanitarian aid into Gaza in exchange for the release of the last American hostage, so Hamas — and by extension Iran — feel the U.S. cannot be trusted in negotiations. Jimmy Dore and Americans’ Comedian Kurt Metzger discuss how Israel appears to be orchestrating a U.S. attack on Iran that few Americans have any interest in.    Related: Trump makes key move to beat Biden in their race to start a war with Iran

Trump in SHOCK: Putin & China FLIP His Grave Mistake into STUNNING Victory

Danny Haiphong   Putin & China just gave Trump a rude BRICS awakening, and this bombshell will change everything for generations to come. Geopolitical analyst Ben Norton details the truth about Trump's biggest failure against the rising power of BRICS led by Russia and China, and why the US's role as super power is now in serious question.     Related: Trump's tariffs: A unique opportunity for BRICS and the Global South to fully escape from dollar tyranny

Trump's attempt to divide Russia & China is failing, badly

Geopolitical Economy Report   Donald Trump claimed he would "un-unite" Russia and China, but the US divide-and-conquer strategy is failing. In a meeting in Moscow celebrating the 80th anniversary of their nations' victory in World War Two, Presidents Xi Jinping and Vladimir Putin reaffirmed that "China-Russia relations have reached the highest level in history" and will "jointly resist any attempts to interfere with and disrupt the traditional friendship and deep mutual trust between China and Russia". Ben Norton explains.     Related:   Why China supports Russia

Inside Iran's Savak torture museum

The Grayzone   Caution: This report contains depictions of simulated violence that may upset some viewers. Max Blumenthal tours one of the most disturbing museums on the planet. Set in Tehran's former Ebrat Prison run by the anti-sabotage unit of Shah Reza Pahlavi's Savak intelligence services, the museum is filled with shockingly graphic exhibits featuring lifelike mannequins recreating the hideous torture tactics deployed to repress dissidents rebelling against Iran's monarchy. Many mannequins on display represent notorious torturers who either fled or were executed after the Islamic revolution in 1979, while others are modeled after famous prisoners locked away in Ebrat like the current Leader of Iran, Ayatollah Khamanei.  

14,000 babies could die if aid doesn’t enter Gaza in 48 hours, UN warns

Some 14,000 babies could die in Gaza in 48 hours if aid does not reach them in time, the UN’s humanitarian chief, Tom Fletcher, told the BBC today. Though Israel said it would allow “basic aid” into Gaza, only five trucks entered the enclave yesterday, two carrying shrouds to help bury Palestinians killed in Israel’s bombs. Others were in Gaza, but were being held by occupation forces and had not reached Palestinians. This was the first delivery of aid since 2 March, when Israel completely sealed the enclave. This, Fletcher explained, is a “drop in the ocean” and totally inadequate for a population of over 2.3 million, and for which no aid has been allowed to enter for 80 days.    “Tonnes of food is blocked at the [Gaza] border” by Israel, Director General of the World Health Organisation (WHO), Tedros Adhanom Ghebreyesus, said yesterday. This comes just weeks after the UN agency of Palestinian refugees (UNRWA) warned that hundreds of thousands of Palestinians eat only one mea...

"Kidnapped in Int'l Waters": Israel Intercepts Gaza-Bound Aid Ship, Detains Greta Thunberg & Others

Democracy Now!   Eleven peace activists and one journalist on board the Gaza Freedom Flotilla ship, the "Madleen," were detained by Israeli soldiers as their ship carrying vital humanitarian aid for starving Palestinians approached Gaza.    The ship was intercepted by Israeli forces in the middle of the night in international waters. Its supplies were seized and communications jammed. The unarmed activists will likely be transported to Israeli detention or "immediately deported," says Ann Wright, a U.S. military veteran who has participated in four Freedom Flotilla journeys and now serves on the steering committee of the Freedom Flotilla Coalition. She calls on citizens of countries around the world to push for the activists' release and an end to Israel's war on Gaza. 

Latest on Los Angeles anti-ICE protests in US

CGTN     Views of downtown Los Angeles where protests against immigration raids entered their third day on Sunday local time.   Protesters clashed with National Guard troops in downtown Los Angeles during the latest wave of demonstrations against statewide immigration enforcement operations that swept across California over the weekend.  

Never, Ever Let Anyone Forget What They Did To Gaza

by Caitlin Johnstone   I will never forget the Gaza holocaust. I will never let anyone else forget about the Gaza holocaust. No matter what happens or how this thing turns out, I will never let anyone my voice touches forget that our rulers did the most evil things imaginable right in front of us and lied to us about it the entire time. I will never stop doing everything I can with my own small platform to help ensure that the perpetrators of this mass atrocity are brought to justice. I will never stop doing everything I can to help bring down the western empire and to help free Palestine from the Zionist entity. I will never forget those shaking children. Those tiny shredded bodies. Those starved, skeletal forms. The explosions followed by screams. The atrocities followed by western media silence.   I will never forget, and I will never forgive. I will never forgive our leaders. I will never forgive the western press. I will never forgive Israel. I will never forgive the main...

They Will Starve You In A Killing Cage Too

by Nate Bear   Starvation is taking hold in Gaza. Twenty-nine people have starved to death in the last few days.  Death by starvation is horrific, the body feeding on itself, first consuming carbohydrates and fats, and then moving on to the protein parts of tissue. Once these are used up, vital organs and tissues start to fail as they aren’t being nourished by essential nutrients. The heart, lungs, muscles, ovaries, testes and brain physically shrink and shrivel. The kidneys start to fail. Eventually the body begins scavenging muscle, including the heart muscle. When this starts to happen, death is hours away, preceded by hallucinations, severe mental disturbances and convulsions. With less stored fat and higher metabolic needs, children die first. Starving parents hold their dying children, at this point nothing but skin and bone, in their arms. Adults can survive anywhere between twenty and forty days without food. Those already weak, chronically ill or immuno-compromised di...