Published in AI

DeepMind co-founder calls for a better Turing test for AI

by on21 June 2023

The old Turing test is not meaningful enough it needs to make money

DeepMind co-founder Mustafa Suleyman suggests chatbots like ChatGPT and Google Bard should be put through a "modern Turing test" where their ability to turn $100,000 into $1 million is evaluated to measure human-like intelligence.

Writing in his book, The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma, Suleyman said that the traditional Turing test was pointless because it doesn't say anything about what the system can do or understand anything about whether it has established complex inner monologues or can engage in planning over abstract time horizons, which is a key to human intelligence.

For those who came in late, the Turing test was introduced by Alan Turing in the 1950s to examine whether a machine has human-level intelligence. During the test, human evaluators determine whether they're speaking to a human or a machine. If the machine can pass for a human, then it passes the test. Instead of comparing AI's intelligence to humans, Suleyman proposes tasking a bot with short-term goals and tasks that it can complete with little human input in a process known as "artificial capable intelligence," or ACI.

To achieve ACI, Suleyman says AI bots should pass a new Turing test in which it receives a $100,000 seed investment and has to turn it into $1 million. As part of the test, the bot must research an e-commerce business idea, develop a plan for the product, find a manufacturer, and then sell the item. He expects AI to achieve this milestone in the next two years.

"We don't just care about what a machine can say; we also care about what it can do," he wrote.


Last modified on 21 June 2023
Rate this item
(0 votes)