Web Scraping and Review Analytics. Extracting Insights from Commercial Data
Web scraping has numerous applications. It can be used complementary with APIs to extract useful data from web pages. For instance, commercial data is abundant, but not always relevant as it is presented on websites. In this paper, we propose the usage of web scraping techniques (namely, two popu...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Ovidius University Press
2024-02-01
|
Series: | Ovidius University Annals: Economic Sciences Series |
Subjects: | |
Online Access: | https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdf |
_version_ | 1797316509722214400 |
---|---|
author | Andreea-Maria Tanasa Simona-Vasilica Oprea Adela Bara |
author_facet | Andreea-Maria Tanasa Simona-Vasilica Oprea Adela Bara |
author_sort | Andreea-Maria Tanasa |
collection | DOAJ |
description | Web scraping has numerous applications. It can be used complementary with APIs to extract
useful data from web pages. For instance, commercial data is abundant, but not always relevant as
it is presented on websites. In this paper, we propose the usage of web scraping techniques
(namely, two popular libraries – BeautifulSoup and Selenium) to extract data from web and other
Python libraries and techniques (vaderSentiment, SentimentIntensityAnalyzer, nltk, n consecutive
words) to analyze the reviews and obtain useful insights from this data. A web scraper is built in
which prices are extracted and variations are tracked. Furthermore, the reviews are extracted and
analyzed in order to identify the relevant opinions, including complaints of the customers. |
first_indexed | 2024-03-08T03:20:23Z |
format | Article |
id | doaj.art-2d3c2aa090dd4ac39404bb7d3f9d78d3 |
institution | Directory Open Access Journal |
issn | 2393-3127 |
language | English |
last_indexed | 2024-03-08T03:20:23Z |
publishDate | 2024-02-01 |
publisher | Ovidius University Press |
record_format | Article |
series | Ovidius University Annals: Economic Sciences Series |
spelling | doaj.art-2d3c2aa090dd4ac39404bb7d3f9d78d32024-02-12T09:44:08ZengOvidius University PressOvidius University Annals: Economic Sciences Series2393-31272024-02-01XXIII2370379Web Scraping and Review Analytics. Extracting Insights from Commercial DataAndreea-Maria Tanasa 0Simona-Vasilica Oprea 1Adela Bara 2The Bucharest University of Economic Studies, Romania The Bucharest University of Economic Studies, Romania The Bucharest University of Economic Studies, Romania Web scraping has numerous applications. It can be used complementary with APIs to extract useful data from web pages. For instance, commercial data is abundant, but not always relevant as it is presented on websites. In this paper, we propose the usage of web scraping techniques (namely, two popular libraries – BeautifulSoup and Selenium) to extract data from web and other Python libraries and techniques (vaderSentiment, SentimentIntensityAnalyzer, nltk, n consecutive words) to analyze the reviews and obtain useful insights from this data. A web scraper is built in which prices are extracted and variations are tracked. Furthermore, the reviews are extracted and analyzed in order to identify the relevant opinions, including complaints of the customers. https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdfweb scrapingprice trackingsentiment analysisalerts |
spellingShingle | Andreea-Maria Tanasa Simona-Vasilica Oprea Adela Bara Web Scraping and Review Analytics. Extracting Insights from Commercial Data Ovidius University Annals: Economic Sciences Series web scraping price tracking sentiment analysis alerts |
title | Web Scraping and Review Analytics. Extracting Insights from Commercial Data |
title_full | Web Scraping and Review Analytics. Extracting Insights from Commercial Data |
title_fullStr | Web Scraping and Review Analytics. Extracting Insights from Commercial Data |
title_full_unstemmed | Web Scraping and Review Analytics. Extracting Insights from Commercial Data |
title_short | Web Scraping and Review Analytics. Extracting Insights from Commercial Data |
title_sort | web scraping and review analytics extracting insights from commercial data |
topic | web scraping price tracking sentiment analysis alerts |
url | https://stec.univ-ovidius.ro/html/anale/ENG/wp-content/uploads/2024/02/24.pdf |
work_keys_str_mv | AT andreeamariatanasa webscrapingandreviewanalyticsextractinginsightsfromcommercialdata AT simonavasilicaoprea webscrapingandreviewanalyticsextractinginsightsfromcommercialdata AT adelabara webscrapingandreviewanalyticsextractinginsightsfromcommercialdata |