Users tend to trust artificial intelligence (AI)-powered fact-checkers as much as human fact-checkers, but for different reasons, according to a new study led by Penn State researchers. The researchers said there is no definitive "winner" when comparing the two fact-checking systems, because users see distinct strengths and weaknesses in each.
In their study published in Media Psychology, participants tended to trust AI more for large-scale scanning tasks, like identifying "red flags" in social media posts. They trusted humans for more nuanced fact-checking that requires piecing together evidence or interpreting complicated situations.
"There's a very clear distinction that emerges from the study that AI is considered good at low-level linguistic features, like identifying telltale signs that something is not credible," said author S. Shyam Sundar, Evan Pugh University Professor and James P. Jimirro Professor of Media Effects at Penn State. "Humans are seen as being better at corroborating evidence from multiple sources."
The research team first conducted a pretest to identify six news headlines that varied in credibility. Two hundred and ninety-one participants residing in the United States were then shown those headlines in simulated social media posts via an application created for this study called FactDeck. Some posts were labeled as fact-checked by an AI system and others by human fact-checkers. Participants saw one of three types of explanations:
- Evidence-based: The system labeled the post false with a reference to the information that contradicted the post.
- Feature-based: The system flagged suspicious wording or unusual phrasing.
- "Black box": No explanation was given for why the post was marked false.
The researchers focused on "machine heuristics" - mental shortcuts people use when evaluating AI, based on stereotypes about machines. They found that while participants assumed AI systems were objective and accurate, they also distrusted AI for lacking human judgment. When it came to determining which system garnered the most trust, first author Mengqi Liao said the two opposite perspectives offset each other.
"Some studies only compare AI versus human fact-checkers, to find out which is trusted more," said Liao, assistant professor at the University of Georgia, who completed her doctoral studies with Sundar at Penn State. "They get a lot of inconsistent results. That's why we proposed a competing hypothesis that showed how positive and negative views of both can coexist and cancel each other out."
