Engineers
develop new way to know liars' intent
Thayer
School of Engineering at Dartmouth
The black Sharpie kinda makes intent pretty clear |
The approach's framework, which could be developed to extract opinion from "fake news," among other uses, was recently published as part of a paper in Journal of Experimental & Theoretical Artificial Intelligence.
Although
previous studies have examined deception, this is possibly the first study to
look at a speaker's intent. The researchers posit that while a true story can
be manipulated into various deceiving forms, the intent, rather than the
content of the communication, determines whether the communication is deceptive
or not.
For example, the speaker could be misinformed or make a wrong assumption, meaning the speaker made an unintentional error but did not attempt to deceive.
For example, the speaker could be misinformed or make a wrong assumption, meaning the speaker made an unintentional error but did not attempt to deceive.
"Deceptive
intent to mislead listeners on purpose poses a much larger threat than
unintentional mistakes," said Eugene Santos Jr., co-author and professor
of engineering at Thayer School of Engineering at Dartmouth.
"To the best of our knowledge, our algorithm is the only method that detects deception and at the same time discriminates malicious acts from benign acts."
"To the best of our knowledge, our algorithm is the only method that detects deception and at the same time discriminates malicious acts from benign acts."
The
researchers developed a unique approach and resulting algorithm that can tell
deception apart from all benign communications by retrieving the universal
features of deceptive reasoning.
However, the framework is currently limited by the amount of data needed to measure a speaker's deviation from their past arguments; the study used data from a 2009 survey of 100 participants on their opinions on controversial topics, as well as a 2011 dataset of 800 real and 400 fictitious reviews of the same 20 hotels.
However, the framework is currently limited by the amount of data needed to measure a speaker's deviation from their past arguments; the study used data from a 2009 survey of 100 participants on their opinions on controversial topics, as well as a 2011 dataset of 800 real and 400 fictitious reviews of the same 20 hotels.
Santos
believes the framework could be further developed to help readers distinguish
and closely examine the intent of "fake news," allowing the reader to
determine if a reasonable, logical argument is used or if opinion plays a
strong role. In further studies, Santos hopes to examine the ripple effect of
misinformation, including its impacts.
In
the study, the researchers use the popular 2001 film Ocean's Eleven to
illustrate how the framework can be used to examine a deceiver's arguments,
which in reality may go against his true beliefs, resulting in a falsified
final expectation.
For example, in the movie, a group of thieves break into a bank vault while simultaneously revealing to the owner that he is being robbed in order to negotiate. The thieves supply the owner with false information, namely that they will only take half the money if the owner doesn't call police.
However, the thieves expect the owner to call police, which he does, so the thieves then disguise themselves as police to steal the entirety of the vault contents.
For example, in the movie, a group of thieves break into a bank vault while simultaneously revealing to the owner that he is being robbed in order to negotiate. The thieves supply the owner with false information, namely that they will only take half the money if the owner doesn't call police.
However, the thieves expect the owner to call police, which he does, so the thieves then disguise themselves as police to steal the entirety of the vault contents.
Because
Ocean's Eleven is a scripted film, viewers can be sure of the thieves' intent
-- to steal all of the money -- and how it conflicts with what they tell the
owner -- that they will only take half. This illustrates how the thieves were
able to deceive the owner and anticipate his actions due to the fact that the
thieves and owner had different information and therefore perceived the scene
differently.
"People expect things to work in a certain way," said Santos, "just like the thieves knew that the owner would call police when he found out he was being robbed. So, in this scenario, the thieves used that knowledge to convince the owner to come to a certain conclusion and follow the standard path of expectations. They forced their deception intent so the owner would reach the conclusions the thieves desired."
In
popular culture, verbal and non-verbal behaviors such as facial expressions are
often used to determine if someone is lying, but the co-authors note that those
cues are not always reliable.
"We have found that models based on reasoning intent are more reliable than verbal changes and personal differences, and thus are better at distinguishing intentional lies from other types of information distortion," said co-author Deqing Li, who worked on the paper as part of her PhD thesis at Thayer.