Facebook Has a New Test for Artificial Intelligence

Alan Turing was a brilliant mathematician whose codebreaking machine helped save millions of lives in the Second World War. The Turing machine is regarded as the world’s first model of a computer, and its inventor as the father of artificial intelligence.

In 1950 Turing published a paper “Computer Machinery and Intelligence” containing the “Imitation Game” that would later become known as the famous Turing test. Proposed “game” is meant to demonstrate machine’s ability to “think” in a way that could be indistinguishable from human’s thinking. An isolated human interrogator poses series of questions to candidates, one of which is an intelligent machine, and tries to determine which of the offered answers belongs to a human and which one to a machine.For 65 years Turing test was a point of reference for the advancements in the evolution of artificial intelligence.

Now, Facebook’s Artificial Intelligence Lab, one of the best AI Labs in the world, proposes a new way to test machine’s intelligence. The test consists of 20 tasks and any potential human-like artificial intelligence should pass all of them in order to be considered a truly intelligent.

Facebook’s team of researchers believes they have devised an exam that is easily solvable by humans, yet rather challenging for AI. Jason Weston, a researcher at Facebook, in charge of this research, said to New Scientist that they wanted to design tasks “that any human who can read can answer.”

However, none of the learning algorithms Facebook’s AI Lab team has tested so far did not manage to get full marks. So far, the best performance was shown by one model of neural network that had access to an external memory. This is the kind of system on which Google’s Deep Mind operates.

The ultimate goal for Facebook is a development of machine intelligence that could understand both – the content and people, to paraphrase Yann LeCun, Facebook’s director of AI research, an AI which could one day serve as a digital assistant, capable of communicating with customers without additional human support.

If you’re curious about types of questions Facebook’s test is composed of, check out some of them at http://www.newscientist.com/article/dn27076-test-yourself-on-facebooks-intelligence-questions.html#.VPdTPiwgyeI .