IAES International Journal of Artificial Intelligence (IJ-AI)
Vol 15, No 4: August 2026

Social news factuality verification using large language models

Tran Duc Duong (Posts and Telecommunications Institute of Technology)
Hai Hoan Do (Posts and Telecommunications Institute of Technology)



Article Info

Publish Date
01 Aug 2026

Abstract

Social media platforms have greatly accelerated the spread of news, but this rapid information flow also amplifies the risk of misinformation. Traditional automatic detection methods that rely solely on textual features often struggle with nuanced, emerging content. This paper present a novel pipeline that verifies the factuality of social news by clustering related articles into events and using large language models (LLMs) to extract and verify claims against trusted news sources. The approach groups social-media posts and mainstream reports on the same event, extracts atomic claims with a model like GPT-4, and checks each claim’s truthfulness by comparing it to the cluster’s reliable news. This pipeline was evaluated on a newly constructed Vietnamese news dataset of 1,765 articles (including 723 social-media items), manually annotating claims as true or false. The LLM-based method achieved high accuracy (≈88.9% F1-score on claim verification and 92.1% F1-score on overall news verification). These results demonstrate that carefully prompted LLMs, combined with event-level clustering of evidence, can outperform traditional methods (e.g., bidirectional encoder representations from transformers (BERT)-based classifiers) in verifying news. The paper discusses advantages of clustering over simple retrieval, scalability considerations for LLMs, and prospects for multilingual and knowledge-enhanced verification.

Copyrights © 2026






Journal Info

Abbrev

IJAI

Publisher

Subject

Computer Science & IT Engineering

Description

IAES International Journal of Artificial Intelligence (IJ-AI) publishes articles in the field of artificial intelligence (AI). The scope covers all artificial intelligence area and its application in the following topics: neural networks; fuzzy logic; simulated biological evolution algorithms (like ...