Writing in his book, The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma, Suleyman said that the traditional Turing test was pointless because it doesn't say anything about what the system can do or understand anything about whether it has established complex inner monologues or can engage in planning over abstract time horizons, which is a key to human intelligence.
For those who came in late, the Turing test was introduced by Alan Turing in the 1950s to examine whether a machine has human-level intelligence. During the test, human evaluators determine whether they're speaking to a human or a machine. If the machine can pass for a human, then it passes the test. Instead of comparing AI's intelligence to humans, Suleyman proposes tasking a bot with short-term goals and tasks that it can complete with little human input in a process known as "artificial capable intelligence," or ACI.
To achieve ACI, Suleyman says AI bots should pass a new Turing test in which it receives a $100,000 seed investment and has to turn it into $1 million. As part of the test, the bot must research an e-commerce business idea, develop a plan for the product, find a manufacturer, and then sell the item. He expects AI to achieve this milestone in the next two years.
"We don't just care about what a machine can say; we also care about what it can do," he wrote.