News Monitor: A Framework for Exploring News in Real-Time

News articles generated by online media are a major source of information. In this work, we present News Monitor, a framework that automatically collects news articles from a wide variety of online news portals and performs various analysis tasks. The framework initially identifies fresh news (first...

Full description

Bibliographic Details
Main Authors: Nikolaos Panagiotou, Antonia Saravanou, Dimitrios Gunopulos
Format: Article
Language:English
Published: MDPI AG 2021-12-01
Series:Data
Subjects:
Online Access:https://www.mdpi.com/2306-5729/7/1/3
_version_ 1827666038358016000
author Nikolaos Panagiotou
Antonia Saravanou
Dimitrios Gunopulos
author_facet Nikolaos Panagiotou
Antonia Saravanou
Dimitrios Gunopulos
author_sort Nikolaos Panagiotou
collection DOAJ
description News articles generated by online media are a major source of information. In this work, we present News Monitor, a framework that automatically collects news articles from a wide variety of online news portals and performs various analysis tasks. The framework initially identifies fresh news (first stories) and clusters articles about the same incidents. For every story, at first, it extracts all of the corresponding triples and, then, it creates a knowledge base (KB) using open information extraction techniques. This knowledge base is then used to create a summary for the user. News Monitor allows for the users to use it as a search engine, ask their questions in their natural language and receive answers that have been created by the state-of-the-art framework BERT. In addition, News Monitor crawls the Twitter stream using a dynamic set of “trending” keywords in order to retrieve all messages relevant to the news. The framework is distributed, online and performs analysis in real-time. According to the evaluation results, the fake news detection techniques utilized by News Monitor allow for a F-measure of 82% in the rumor identification task and an accuracy of 92% in the stance detection tasks. The major contribution of this work can be summarized as a novel real-time and scalable architecture that combines various effective techniques under a news analysis framework.
first_indexed 2024-03-10T01:39:23Z
format Article
id doaj.art-63d5fec2f6e14945aa6bb83d22b4d3ef
institution Directory Open Access Journal
issn 2306-5729
language English
last_indexed 2024-03-10T01:39:23Z
publishDate 2021-12-01
publisher MDPI AG
record_format Article
series Data
spelling doaj.art-63d5fec2f6e14945aa6bb83d22b4d3ef2023-11-23T13:26:14ZengMDPI AGData2306-57292021-12-0171310.3390/data7010003News Monitor: A Framework for Exploring News in Real-TimeNikolaos Panagiotou0Antonia Saravanou1Dimitrios Gunopulos2Department of Informatics and Telecommunications, National and Kapodistrian University of Athens, Panepistimioupolis, Ilissia, 15784 Athens, GreeceDepartment of Informatics and Telecommunications, National and Kapodistrian University of Athens, Panepistimioupolis, Ilissia, 15784 Athens, GreeceDepartment of Informatics and Telecommunications, National and Kapodistrian University of Athens, Panepistimioupolis, Ilissia, 15784 Athens, GreeceNews articles generated by online media are a major source of information. In this work, we present News Monitor, a framework that automatically collects news articles from a wide variety of online news portals and performs various analysis tasks. The framework initially identifies fresh news (first stories) and clusters articles about the same incidents. For every story, at first, it extracts all of the corresponding triples and, then, it creates a knowledge base (KB) using open information extraction techniques. This knowledge base is then used to create a summary for the user. News Monitor allows for the users to use it as a search engine, ask their questions in their natural language and receive answers that have been created by the state-of-the-art framework BERT. In addition, News Monitor crawls the Twitter stream using a dynamic set of “trending” keywords in order to retrieve all messages relevant to the news. The framework is distributed, online and performs analysis in real-time. According to the evaluation results, the fake news detection techniques utilized by News Monitor allow for a F-measure of 82% in the rumor identification task and an accuracy of 92% in the stance detection tasks. The major contribution of this work can be summarized as a novel real-time and scalable architecture that combines various effective techniques under a news analysis framework.https://www.mdpi.com/2306-5729/7/1/3news monitoringnews articles analysisevent detectionquestion answering
spellingShingle Nikolaos Panagiotou
Antonia Saravanou
Dimitrios Gunopulos
News Monitor: A Framework for Exploring News in Real-Time
Data
news monitoring
news articles analysis
event detection
question answering
title News Monitor: A Framework for Exploring News in Real-Time
title_full News Monitor: A Framework for Exploring News in Real-Time
title_fullStr News Monitor: A Framework for Exploring News in Real-Time
title_full_unstemmed News Monitor: A Framework for Exploring News in Real-Time
title_short News Monitor: A Framework for Exploring News in Real-Time
title_sort news monitor a framework for exploring news in real time
topic news monitoring
news articles analysis
event detection
question answering
url https://www.mdpi.com/2306-5729/7/1/3
work_keys_str_mv AT nikolaospanagiotou newsmonitoraframeworkforexploringnewsinrealtime
AT antoniasaravanou newsmonitoraframeworkforexploringnewsinrealtime
AT dimitriosgunopulos newsmonitoraframeworkforexploringnewsinrealtime