Evaluation data and prototype system WISDOM for information credibility analysis

The purpose of this paper is to describe evaluation data and a prototype system named WISDOM used for analyzing information credibility based on natural language processing.

The authors started the Information Credibility Criteria project in April, 2007, mainly to analyze the credibility of information (text) on the web. The project proposes to capture information credibility based on four criteria (content, sender, appearance, and social valuation) and aims to analyze and organize them logically using natural language processing based on predicate argument structure.

The evaluation data described in this paper were developed as learning and verifying data for these various analysis modules and are composed of manually‐annotated data based on each evaluation criteria about several pre‐selected topics such as current events and medical issues. The prototype system WISDOM was developed to provide information credibility from different perspectives.

Users will be able to find credible information more reliably by browsing information using different evaluation criteria and conditions provided by the system.