AI pioneer Yoshua Bengio, seen here in 2017, told the journal Nature that "we have to raise flags before bad things happen" in terms of irresponsible use of artificial intelligence.(Photo: Ecole polytechnique/flickr/cc)
Pioneer in Field Warns Dangers Posed by Artificial Intelligence 'Very Real'
"What is most concerning is not happening in broad daylight"
A pioneer in the field of artificial intelligence warned that "dangers of abuse" of AI "are very real."
The warning from Canadian computer science professor and leading AI researcher Yoshua Bengio came in a Q&A with the journal Nature published Thursday.
The interview was conducted back in January, before Bengio was named along with two others the latest recipients of the Turing Award, a prize dubbed the "Nobel Prize of Computing."
Bengio told Nature that "we have to raise flags before bad things happen" in terms of irresponsible use of AI.
Unfortunately, "what is most concerning is not happening in broad daylight" but "in military labs, in security organizations, in private companies providing services to governments or the police," he said.
In particular, Bengio said, he is concerned with so-called killer drones--lethal autonomous weapons--and surveillance, which can be abused by authoritarian governments.
AI "can be used by those in power to keep that power, and to increase it," said Bengio, and be used "to worsen gender or racial discrimination."
Some sort of government or international regulatory framework needs to be in place to put a check on AI, added Bengio: "Self-regulation is not going to work."
It's not the first time Bengio expressed concerns about possible abuse of AI. This week he joined over two dozen other AI researchers in calling on Amazon to stop selling its facial-recognition software Rekognition to police departments.
The group of "concerned researchers" wrote in a post on Medium that "legislation and safeguards to prevent misuse are not in place."
Bengio also served on the steering committee for the recently-unveiled Montreal Declaration for Responsible Development of Artificial Intelligence. Among the declaration's 10 principles are that the "development and use of [artificial intelligence systems] AIS must contribute to the creation of a just and equitable society."
"Generally speaking," he wrote at The Conversation highlighting the need for the declaration, "scientists tend to avoid getting too involved in politics. But when there are issues that concern them and that will have a major impact on society, they must assume their responsibility and become part of the debate."
"And in this debate, I have come to realize that society has given me a voice--that governments and the media were interested in what I had to say on these topics because of my role as a pioneer in the scientific development of AI."
"So, for me, it is now more than a responsibility," he said. "It is my duty. I have no choice."
Urgent. It's never been this bad.
Dear Common Dreams reader, It’s been nearly 30 years since I co-founded Common Dreams with my late wife, Lina Newhouser. We had the radical notion that journalism should serve the public good, not corporate profits. It was clear to us from the outset what it would take to build such a project. No paid advertisements. No corporate sponsors. No millionaire publisher telling us what to think or do. Many people said we wouldn't last a year, but we proved those doubters wrong. Together with a tremendous team of journalists and dedicated staff, we built an independent media outlet free from the constraints of profits and corporate control. Our mission from the outset was simple. To inform. To inspire. To ignite change for the common good. Building Common Dreams was not easy. Our survival was never guaranteed. When you take on the most powerful forces—Wall Street greed, fossil fuel industry destruction, Big Tech lobbyists, and uber-rich oligarchs who have spent billions upon billions rigging the economy and democracy in their favor—the only bulwark you have is supporters who believe in your work. But here’s the urgent message from me today. It’s never been this bad out there. And it’s never been this hard to keep us going. At the very moment Common Dreams is most needed and doing some of its best and most important work, the threats we face are intensifying. Right now, with just four days to go in our Spring Campaign, we are not even halfway to our goal. When everyone does the little they can afford, we are strong. But if that support retreats or dries up, so do we. Can you make a gift right now to make sure Common Dreams not only survives but thrives? There is no backup plan or rainy day fund. There is only you. —Craig Brown, Co-founder |
A pioneer in the field of artificial intelligence warned that "dangers of abuse" of AI "are very real."
The warning from Canadian computer science professor and leading AI researcher Yoshua Bengio came in a Q&A with the journal Nature published Thursday.
The interview was conducted back in January, before Bengio was named along with two others the latest recipients of the Turing Award, a prize dubbed the "Nobel Prize of Computing."
Bengio told Nature that "we have to raise flags before bad things happen" in terms of irresponsible use of AI.
Unfortunately, "what is most concerning is not happening in broad daylight" but "in military labs, in security organizations, in private companies providing services to governments or the police," he said.
In particular, Bengio said, he is concerned with so-called killer drones--lethal autonomous weapons--and surveillance, which can be abused by authoritarian governments.
AI "can be used by those in power to keep that power, and to increase it," said Bengio, and be used "to worsen gender or racial discrimination."
Some sort of government or international regulatory framework needs to be in place to put a check on AI, added Bengio: "Self-regulation is not going to work."
It's not the first time Bengio expressed concerns about possible abuse of AI. This week he joined over two dozen other AI researchers in calling on Amazon to stop selling its facial-recognition software Rekognition to police departments.
The group of "concerned researchers" wrote in a post on Medium that "legislation and safeguards to prevent misuse are not in place."
Bengio also served on the steering committee for the recently-unveiled Montreal Declaration for Responsible Development of Artificial Intelligence. Among the declaration's 10 principles are that the "development and use of [artificial intelligence systems] AIS must contribute to the creation of a just and equitable society."
"Generally speaking," he wrote at The Conversation highlighting the need for the declaration, "scientists tend to avoid getting too involved in politics. But when there are issues that concern them and that will have a major impact on society, they must assume their responsibility and become part of the debate."
"And in this debate, I have come to realize that society has given me a voice--that governments and the media were interested in what I had to say on these topics because of my role as a pioneer in the scientific development of AI."
"So, for me, it is now more than a responsibility," he said. "It is my duty. I have no choice."
A pioneer in the field of artificial intelligence warned that "dangers of abuse" of AI "are very real."
The warning from Canadian computer science professor and leading AI researcher Yoshua Bengio came in a Q&A with the journal Nature published Thursday.
The interview was conducted back in January, before Bengio was named along with two others the latest recipients of the Turing Award, a prize dubbed the "Nobel Prize of Computing."
Bengio told Nature that "we have to raise flags before bad things happen" in terms of irresponsible use of AI.
Unfortunately, "what is most concerning is not happening in broad daylight" but "in military labs, in security organizations, in private companies providing services to governments or the police," he said.
In particular, Bengio said, he is concerned with so-called killer drones--lethal autonomous weapons--and surveillance, which can be abused by authoritarian governments.
AI "can be used by those in power to keep that power, and to increase it," said Bengio, and be used "to worsen gender or racial discrimination."
Some sort of government or international regulatory framework needs to be in place to put a check on AI, added Bengio: "Self-regulation is not going to work."
It's not the first time Bengio expressed concerns about possible abuse of AI. This week he joined over two dozen other AI researchers in calling on Amazon to stop selling its facial-recognition software Rekognition to police departments.
The group of "concerned researchers" wrote in a post on Medium that "legislation and safeguards to prevent misuse are not in place."
Bengio also served on the steering committee for the recently-unveiled Montreal Declaration for Responsible Development of Artificial Intelligence. Among the declaration's 10 principles are that the "development and use of [artificial intelligence systems] AIS must contribute to the creation of a just and equitable society."
"Generally speaking," he wrote at The Conversation highlighting the need for the declaration, "scientists tend to avoid getting too involved in politics. But when there are issues that concern them and that will have a major impact on society, they must assume their responsibility and become part of the debate."
"And in this debate, I have come to realize that society has given me a voice--that governments and the media were interested in what I had to say on these topics because of my role as a pioneer in the scientific development of AI."
"So, for me, it is now more than a responsibility," he said. "It is my duty. I have no choice."