Ugail

Insights

Reading Deception Through Facial and Thermal Cues

Published on 29/08/2009

One of the more intriguing possibilities in behavioural computing is that deception may leave measurable traces in the face. Visible video can capture changes in expression, gaze, blinking, lip movement and other small behavioural cues, while thermal imaging may reveal physiological responses such as changes in blood flow and temperature around the eyes and other regions of the face. No single cue can be regarded as proof of lying, but the combination of many weak signals may provide a richer picture of how a person responds under questioning.

The important step is to move beyond looking for one supposed sign of deceit and instead analyse patterns over time. A system could track multiple facial and thermal measurements simultaneously and compare how they change before, during and after a response. Statistical pattern recognition and emerging machine learning techniques could help identify combinations of features that are difficult for a human observer to detect consistently. Methods such as support vector machines, neural networks and temporal models may allow the system to learn from labelled examples rather than relying entirely on hand written rules.

The real potential is not to build a machine that simply declares whether someone is telling the truth, but to create an intelligent decision support tool that highlights unusual behavioural and physiological responses for further examination. If visible and thermal information can be combined reliably, such systems could have applications in interviewing, security and behavioural research. The challenge will be ensuring that the technology measures uncertainty carefully, since stress, fear and discomfort can produce many of the same signals as deception.