Effects of lying in practical Turing tests
Interpretation of utterances affects an interrogator’s determination of human from machine during live Turing tests. Here, we consider transcripts realised as a result of a series of practical Turing tests that were held on 23 June 2012 at Bletchley Park, England. The focus in this paper is to consider the effects of lying and truth-telling on the human judges by the hidden entities, whether human or a machine. Turing test transcripts provide a glimpse into short text communication, the type that occurs in emails: how does the reader determine truth from the content of a stranger’s textual message? Different types of lying in the conversations are explored, and the judge’s attribution of human or machine is investigated in each test.
KeywordsDeception detection Hidden human interviewer Lying Machine Truth Turing test
The authors would like to thank those whose financial support made the Bletchley Park tests possible: William Beer, Director of Information and Cyber Security at Price Waterhouse Coopers; Clare McFarlane at Artificial Solutions; Maggie Berry of Women in Technology; David Burden of Daden Ltd; Phil Hall, CEO of Elzware Conversation Systems; Keith Harrison of Existor Ltd; Raspberry Pi Computers for the best child judge award; and last but not least, The Colonnade Hotel (birthplace of Alan Turing) for the winning machine trophy. We thank the developers for accepting our invitation allowing their machines to participate in this experiment: Rollo Carpenter and Existor for Cleverbot, Fred Roberts and AI Solutions for Elbot, Robert Medeksza and Zabaware for Ultra Hal, Robby Garner and the Turing Hub for JFred, and lastly, the winner of the best machine Eugene Goostman from Vladimir Veselov and his team.
- 16th Loebner Prize for Artificial Intelligence (2006). Home of the Loebner prize: http://loebner.net/Prizef/2006_Contest/loebner-prize-2006.html. Accessed 4 Nov 2013
- Copeland B (2004) The essential Turing—the ideas that gave birth to the computer age. Clarendon Press, OxfordGoogle Scholar
- Eugene Goostman Transcript (2008). 18th Loebner prize for artificial intelligence contest. University of Reading: http://www.loebner.net/Prizef/2008_Contest/Eugene.pdf. Accessed 4 Nov 2013
- Freitas-Magalhães A (2013) The face of lies. FEELab Science Books, PortoGoogle Scholar
- Leslie I (2011) Born liars. Quercus, LondonGoogle Scholar
- Shah H (2010) Deception detection and machine intelligence in practical Turing tests. PhD thesis, University of Reading, UKGoogle Scholar
- Shah H (2013) Conversation, deception and intelligence: Turing’s question-answer game. In: Cooper SB, van Leeuwen J (eds) Part III: Building a brain, intelligent machines, practice and theory. Alan Turing: his work and impact. Elsevier ISBN: 9780123869807Google Scholar
- Shah H, Warwick K (2009) Emotion in the Turing test: a downward trend for machines in recent Loebner Prizes. In: Vallverdú J, Casacuberta D (eds), Handbook of research in synthetic emotions and sociable robotics: new applications in affective computing and artificial intelligence, pp 325–349. IGI Global: doi: 10.4018/978-1-60566-354-8
- Warwick K (2011) Artificial intelligence: the basics. London, RoutledgeGoogle Scholar
- Warwick K, Shah H (2013) Good machine performance in Turing’s imitation game. IEEE transactions on computational intelligence and AI in games. doi: 10.1109/TCIAIG.2013.2283538