The Turing Test Has Begun to Be Regarded Inadequate to Measure Artificial Intelligence

The Turing Test Has Begun to Be Regarded Inadequate to Measure Artificial Intelligence

Rohit Prasad, stated that the Turing test is no longer sufficient to measure the success of artificial intelligence. Stating that artificial intelligence is much more advanced than a technology that tries to imitate humans; Prasad added that a new test protocol is a must. According to Prasad, while artificial intelligence is far superior to technology that can only mimic a human; people are more satisfied with a technology that performs its duties rather than an artificial intelligence close to them.

A real test of wits

The purpose of the Turing test is to detect whether the person with whom a person is chatting; is an artificial intelligence. In the test process, an artificial intelligence and a real person sat in front of the person; talking to them. Then, by asking certain questions, the speaker tries to determine answer on the computer screen belongs to artificial intelligence; and which belongs to a real person. British mathematician and computer scientist Alan Turing predicted that by 2000; humans would have less than 70% chance of distinguishing artificial intelligence from humans thanks to the Turing test. However, the technology industry has yet to achieve such success in artificial intelligence.

Rohit Prasad, Head of Alexa Artificial Intelligence Assistant Division at Amazon, wrote in a magazine article that the Turing test is full of limitations and that this test does not provide any benefit in the researches scientists are working on. According to Prasad, people have already lost interest in differentiating artificial intelligence. Instead, they expect the AIs found in their homes, cars, and even smartphones to be functional and transparent.

Prasad stated that in 2016, with a competition called Alexa Prize Socialbot Grand Challenge; the best social assistant competition was organized. Thanks to this competition, artificial intelligence received evaluation not only with the Turing test, but with a much wider scope. The aim of this competition was to find social assistants who could have fun and pleasant conversations; rather than convince people that artificial intelligence is a human being.

Artificial intelligence will be evaluated with wider scope

During the competition, each social bot chat with the jury for 20 minutes on many different topics such as sports, technology, and politics. The juries voted for the social bots they deemed worth chatting again, allowing the bots to go to the final round. Thanks to this competition, researchers found out that artificial intelligence can develop their sense of humor without the need to pretend to be human wherever necessary.

Prasad gave an example of this feature that artificial intelligence should have with the following words; “After setting the alarm, if you go to the bedroom without turning off the lights downstairs, Alexa can warn you that you have to turn the lights off. The same happens when Alexa detects a breaking sound. Alexa notices that a broken glass inside the house, and advises you to take action by warning.