Web Scraping and Review Analytics. Extracting Insights from Commercial Data

Web scraping has numerous applications. It can be used complementary with APIs to extract useful data from web pages. For instance, commercial data is abundant, but not always relevant as it is presented on websites. In this paper, we propose the usage of web scraping techniques (namely, two popu...

Full description

Bibliographic Details
Main Authors: Andreea-Maria Tanasa, Simona-Vasilica Oprea, Adela Bara
Format: Article
Language:English
Published: Ovidius University Press 2024-02-01
Series:Ovidius University Annals: Economic Sciences Series
Subjects:
Online Access:https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdf
_version_ 1797316509722214400
author Andreea-Maria Tanasa
Simona-Vasilica Oprea
Adela Bara
author_facet Andreea-Maria Tanasa
Simona-Vasilica Oprea
Adela Bara
author_sort Andreea-Maria Tanasa
collection DOAJ
description Web scraping has numerous applications. It can be used complementary with APIs to extract useful data from web pages. For instance, commercial data is abundant, but not always relevant as it is presented on websites. In this paper, we propose the usage of web scraping techniques (namely, two popular libraries – BeautifulSoup and Selenium) to extract data from web and other Python libraries and techniques (vaderSentiment, SentimentIntensityAnalyzer, nltk, n consecutive words) to analyze the reviews and obtain useful insights from this data. A web scraper is built in which prices are extracted and variations are tracked. Furthermore, the reviews are extracted and analyzed in order to identify the relevant opinions, including complaints of the customers.
first_indexed 2024-03-08T03:20:23Z
format Article
id doaj.art-2d3c2aa090dd4ac39404bb7d3f9d78d3
institution Directory Open Access Journal
issn 2393-3127
language English
last_indexed 2024-03-08T03:20:23Z
publishDate 2024-02-01
publisher Ovidius University Press
record_format Article
series Ovidius University Annals: Economic Sciences Series
spelling doaj.art-2d3c2aa090dd4ac39404bb7d3f9d78d32024-02-12T09:44:08ZengOvidius University PressOvidius University Annals: Economic Sciences Series2393-31272024-02-01XXIII2370379Web Scraping and Review Analytics. Extracting Insights from Commercial DataAndreea-Maria Tanasa 0Simona-Vasilica Oprea 1Adela Bara 2The Bucharest University of Economic Studies, Romania The Bucharest University of Economic Studies, Romania The Bucharest University of Economic Studies, Romania Web scraping has numerous applications. It can be used complementary with APIs to extract useful data from web pages. For instance, commercial data is abundant, but not always relevant as it is presented on websites. In this paper, we propose the usage of web scraping techniques (namely, two popular libraries – BeautifulSoup and Selenium) to extract data from web and other Python libraries and techniques (vaderSentiment, SentimentIntensityAnalyzer, nltk, n consecutive words) to analyze the reviews and obtain useful insights from this data. A web scraper is built in which prices are extracted and variations are tracked. Furthermore, the reviews are extracted and analyzed in order to identify the relevant opinions, including complaints of the customers. https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdfweb scrapingprice trackingsentiment analysisalerts
spellingShingle Andreea-Maria Tanasa
Simona-Vasilica Oprea
Adela Bara
Web Scraping and Review Analytics. Extracting Insights from Commercial Data
Ovidius University Annals: Economic Sciences Series
web scraping
price tracking
sentiment analysis
alerts
title Web Scraping and Review Analytics. Extracting Insights from Commercial Data
title_full Web Scraping and Review Analytics. Extracting Insights from Commercial Data
title_fullStr Web Scraping and Review Analytics. Extracting Insights from Commercial Data
title_full_unstemmed Web Scraping and Review Analytics. Extracting Insights from Commercial Data
title_short Web Scraping and Review Analytics. Extracting Insights from Commercial Data
title_sort web scraping and review analytics extracting insights from commercial data
topic web scraping
price tracking
sentiment analysis
alerts
url https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdf
work_keys_str_mv AT andreeamariatanasa webscrapingandreviewanalyticsextractinginsightsfromcommercialdata
AT simonavasilicaoprea webscrapingandreviewanalyticsextractinginsightsfromcommercialdata
AT adelabara webscrapingandreviewanalyticsextractinginsightsfromcommercialdata