How can we control intelligent systems no one fully understands?
— May 16, 2016
By Vasant Dhar
This controversy, on the heels of the Feb. 14, 2016, accident of Google’s self-driving robot car, has ignited a new debate over artificial intelligence. How should we design intelligent learning machines that minimize undesirable behavior?
While both of the aforementioned incidents were relatively minor, they highlight a broader concern, namely, that it is very difficult to control adaptive learning machines in complex environments. The famous cybernetician Norbert Wiener warned us about this dilemma more than 50 years ago: “If we use, to achieve our purposes, a mechanical agency with whose operation we cannot interfere effectively … we had better be quite sure that the purpose put into the machine is the purpose we really desire and not merely a colorful imitation of it.”
Read the full article as published in TechCrunch.
Vasant Dhar is a Professor of Information Systems.