Social Engineering Blogs

When you recognize a friend’s face, how do you know? Do you make a careful study of their nose and cheekbones? Are you thrown off if they don’t wear the usual expression?

The vast majority of people probably scoffed at those questions. Facial recognition isn’t a matter of careful study, but instead it is an instantaneous process. Your brain just knows whose face you are seeing. As Tim Newman pointed out in Medical News Today, this underscores how incredible the process of facial recognition is, given the complexity of and similarities between the thousands of faces we see on a regular basis.

Not only is facial recognition itself a remarkable ability, but it is closely tied with crucial cognitive functions.

Facial recognition is a key part of understanding emotional expressions. Humans use facial recognition skills to detect deviations from normal or prototypical expressions. This process involves noticing when brows are furrowed or eyes are squinted, instantly comparing those expressions with what is expected upon seeing a face.

Because the recognition of a face is instantaneous, it is only a small cognitive step towards noticing when the face appears differently than expected, and this difference is then analyzed as displaying a certain emotion.

The ability to perceive emotions in this fashion appears to be a basic human feature. The same sort of basic human expressions, such as anger, revulsion, and sadness are found across the world, from Japan to Borneo to the United States. Even emotions displayed in ancient cave paintings show similar expressions!

Similarly, by recognizing faces in this sense, humans also make quick judgments as to the attractiveness of an unfamiliar face. They may often be unable to explain why a face seems attractive or not, just as we are unable to describe exactly how we recognize familiar faces or emotions. We immediately process many factors, including facial symmetry, to develop these impressions.

In fact, the ability to recognize and process faces in this fashion is deeply rooted in our species. Human babies can even differentiate between human and, for example, gorilla faces at an incredibly early age. While 3-month olds can tell human and gorilla bodies apart, even newborn babies can distinguish faces.

And it isn’t just humans! Other primates have a similar ability. Chimpanzees, who have the most similar recognition skills to humans, quickly identify familiar faces, and they can even distinguish familiar family characteristics in unfamiliar faces. This is similar to when we meet someone and notice that they look like a cousin or a sibling.

Understanding this incredible ability has many practical implications, even if they may not seem immediately obvious. Most intuitively, the ability to recognize faces is important for law enforcement work and eyewitness testimony. Witnesses must be able to correctly recognize the faces of criminal suspects, and law enforcement officers must recognize faces from security footage or photo IDs.

These important applications are complicated by the fact that people range considerably in their ability to recognize faces.

Some individuals, called super-recognizers, are incredibly good at matching unfamiliar faces, and they mark the high end of a spectrum that includes all levels of ability. This also includes those suffering from face-blindness, or prosopagnosia. These individuals are not only unable to match unfamiliar faces but can be unable to recognize close friends of family members. Instead, they must rely on other cues, like voices or hair color.

Brad Duchaine, who studies facial recognition at Dartmouth College, wrote in 2015 about the impact that these variations have on law enforcement practices. If a witness cannot successfully recognize faces or mistakenly identifies the defendant, their testimony will be severely compromised. Similarly, if law enforcement officials have trouble recognizing faces, they may be unable to complete basic tasks like ensuring that a photo ID matches its owner.

Facial recognition is a critical part of human interaction, comprising the ability to notice emotions of facial similarities, but it is a skill like many others. While some people are naturally better at it, it is something that can be taught and better understood.

For more information about universal emotions, see our article on the Seven Basic Emotions, and click here to find out how you can strengthen this skill.

Who are Hillary Clinton and Donald Trump really?

The second presidential debate was held last night. After watching the first presidential debate on September 26, Humintell’s own Dr. David Matsumoto offered his expert opinion on how each candidate’s mannerisms could be perceived by voters.

He urged us to imagine watching these debates without sound, stripping away the policy discussions, the jokes, and the not so subtle jabs. How would the candidates appear then? Would you change your preference based on what you saw?

Believe it or not, but you are watching it that way, even if you don’t realize it. As we watch these debates, we are picking up on mannerisms, gestures, and body language that we might not even consciously notice.

Anybody watching Trump can pick up on some of his not-so-subtle behavior, as he frequently looked away from his opponent and repeatedly rolled his eyes. While many voters may accuse Trump of rudeness, this sort of unmoderated behavior gave off what Dr. Matsumoto called a “perception of genuineness.” Trump was not hiding his feelings, even his impatience. Instead, there was no question that he was a human with emotions, just like everybody else.

Clinton, on the other hand, presented a much more controlled but standoffish persona. Clinton rarely allowed her expression to change as she reacted to her opponent or the moderator’s questions. For example, she maintained almost the same “pasted expression” throughout the evening: presenting an asymmetrical smile with pursed lips. Many voters likely interpreted that as a self-satisfied or arrogant smirk. She also regularly laughed off responses, feeding into this perception of arrogance.

While the notion that Trump seemed genuine and Clinton seemed standoffish may sound like Trump came out of the debate ahead, this may not actually be the case. In fact, Dr. Matsumoto predicted that Clinton’s performance could lead many voters to envision her as a calm president who would be “above immediate, transient reactions on the spur of the moment.” These same people would then view Trump as being impulsive or unreliable. However, those that picked up on Trump’s genuine displays of emotion may get the impression that he could relate to everyday Americans in a way that the out of touch Clinton could not.

Dr. Matsumoto also focused on what may have seemed like a very minor exchange to many viewers. At one point during the debate, Clinton was asked if she would support the outcome of the election and the will of the people. Her response was to initially shrug before insisting that she would. While this was probably unintentional, these sort of unintentional gestures are often very meaningful. “A shoulder shrug raises doubts about the credibility of what she’s saying,” Dr. Matsumoto explained, and could easily be “interpreted as doubt or uncertainty.”

It is interesting to see how these impressions fit with public perception of both candidates. In April, the leading polling service Gallup reported that the public had already developed pretty firm impressions of the candidates’ personalities. Trump was perceived as caring very little about the common people, while Clinton was seen as highly prepared and analytical. The latter impression was certainly supported by a cold, standoffish demeanor during the debate, but it remains to be seen if Trump can manage to convince voters that he is genuine and caring.

This article was paraphrased from a previous interview with Dr. Matsumoto. For the original interview and further commentary on political body language visit Douglas Quan’s National Post article.

For some information on detecting deception in politics, listen to this NPR story or follow Dr. Matsumoto’s blog series: “Politics and Deception.”