Artificial Intelligence as dangerous as Nukes
Sunday, 19 July 2015

 

Artificial intelligence has the potential to be as dangerous to mankind as nuclear weapons, a leading pioneer of the technology has claimed.

Professor Stuart Russell, a computer scientist who has lead research on artificial intelligence, fears humanity might be 'driving off a cliff' with the rapid development of AI.

He fears the technology could too easily be exploited for use by the military in weapons, putting them under the control of AI systems.

Professor Russell, who is a researcher at the University of California in Berkeley and the Centre for the study of Existential Risk at Cambridge University, compared the development of AI to the work that was done to develop nuclear weapons.

His views echo those of people like Elon Musk who have warned recently about the dangers of artificial intelligence.

Professor Stephen Hawking also joined a group of leading experts to sign an open letter warning of the need for safeguards to ensure AI has a positive impact on mankind.

In an interview with the journal Science for a special edition on Artificial Intelligence, he said: 'From the beginning, the primary interest in nuclear technology was the "inexhaustible supply of energy".

'The possibility of weapons was also obvious. I think there is a reasonable analogy between unlimited amounts of energy and unlimited amounts of intelligence.

'Both seem wonderful until one thinks of the possible risks. In neither case will anyone regulate the mathematics.

'The regulation of nuclear weapons deals with objects and materials, whereas with AI it will be a bewildering variety of software that we cannot yet describe.

'I'm not aware of any large movement calling for regulation either inside or outside AI, because we don't know how to write such regulation.'

This week Science published a series of papers highlighting the progress that has been made in artificial intelligence recently.

In one, researchers describe the pursuit of a computer that is able to make rational economic decisions away from humans while another outlines how machines are learning from 'big data'.

Professor Russell, however, cautions that this unchecked development of technology can be dangerous if the consequences are not fully explored and regulation put in place.

He said: 'Here's what Leo Szilard wrote in 1939 after demonstrating a [nuclear] chain reaction: 'We switched everything off and went home. That night, there was very little doubt in my mind that the world was headed for grief.'

'To those who say, well, we may never get to human-level or superintelligent AI, I would reply: It's like driving straight toward a cliff and saying, 'Let's hope I run out of gas soon!'


In April Professor Russell raised concerns at a United Nations meeting in Geneva over the dangers of putting military drones and weapons under the control of AI systems.

He joins a growning number of experts who have warned that scenarios like those seen in films from Terminator, AI and 2001: A Space Odyssey are not beyond the realms of possibility.

He: 'The basic scenario is explicit or implicit value misalignment - AI systems [that are] given objectives that don't take into account all the elements that humans care about.

'The routes could be varied and complex—corporations seeking a supertechnological advantage, countries trying to build [AI systems] before their enemies, or a slow-boiled frog kind of evolution leading to dependency and enfeeblement not unlike EM Forster's The Machine Stops.'

EM Forster's short story tells of a post-apocalyptic world where humanity lives underground and relies on a giant machine to survive, which then begins to malfunction.

Professor Russell said computer scienitsts needed to modify the goals of their research to ensure human values and objectives remain central to the development of AI technology.

He said students needed to be trained to treat these objectives much in the same way 'as containment is central to the goals of fusion research'.

In an editorial in Science, editors Jelena Stajic, Richard Stone, Gilbert Chin and Brad Wible, said: 'Triumphs in the field of AI are bringing to the fore questions that, until recently, seemed better left to science fiction than to science.

'How will we ensure that the rise of the machines is entirely under human control? And what will the world be like if truly intelligent computers come to coexist with humankind?'

 

HTML Comment Box is loading comments...
  

Latest News

VISITS TO MINA 10/15/16
122,188 PAST 24 HOURS
1,921,133 PAST 31 DAYS
18,518,572 PAST YEAR

 



Refresh MINA | Contact | Twitter | Forex & Currency Exchange | Fitness | Mina Health | Cuisine & Recipes | Games | TradePongo | Balkan Weather

© Macedonian International News Agency 2016