A Scalable, Research Oriented, Generic, Sensor Data Platform

Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity-representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing....

Full description

Bibliographic Details
Main Authors: Joseph Rafferty, Jonathan Synnott, Chris D. Nugent, Andrew Ennis, Philip A. Catherwood, Ian Mcchesney, Ian Cleland, Sally Mcclean
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8405517/
_version_ 1818415437197606912
author Joseph Rafferty
Jonathan Synnott
Chris D. Nugent
Andrew Ennis
Philip A. Catherwood
Ian Mcchesney
Ian Cleland
Sally Mcclean
author_facet Joseph Rafferty
Jonathan Synnott
Chris D. Nugent
Andrew Ennis
Philip A. Catherwood
Ian Mcchesney
Ian Cleland
Sally Mcclean
author_sort Joseph Rafferty
collection DOAJ
description Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity-representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This domain increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive analytics and activity recognition. Several current big data platforms exist; however, they have a range of deficiencies including lack of generic interoperability with agnostic sensors and an absence of features supporting academic research. Due to these deficiencies a custom, research oriented, high performance, and big data platform was devised and implemented. This platform is called SensorCentral and is presented within this paper. SensorCentral provides a framework which enables interoperability with a large range of agnostic sensor devices whilst simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classification and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the open data initiative enabling collaboration with the international community of researchers.
first_indexed 2024-12-14T11:34:58Z
format Article
id doaj.art-50a31f1b76c0443cb8b55a7db8624073
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-14T11:34:58Z
publishDate 2018-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-50a31f1b76c0443cb8b55a7db86240732022-12-21T23:03:06ZengIEEEIEEE Access2169-35362018-01-016454734548410.1109/ACCESS.2018.28526568405517A Scalable, Research Oriented, Generic, Sensor Data PlatformJoseph Rafferty0https://orcid.org/0000-0002-6318-8456Jonathan Synnott1Chris D. Nugent2Andrew Ennis3Philip A. Catherwood4Ian Mcchesney5Ian Cleland6Sally Mcclean7School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Engineering, Ulster University, Newtownabbey, U.K.School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Computing and Mathematics, Ulster University, Newtownabbey, U.K.School of Computing, Ulster University, Coleraine, U.K.Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity-representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This domain increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive analytics and activity recognition. Several current big data platforms exist; however, they have a range of deficiencies including lack of generic interoperability with agnostic sensors and an absence of features supporting academic research. Due to these deficiencies a custom, research oriented, high performance, and big data platform was devised and implemented. This platform is called SensorCentral and is presented within this paper. SensorCentral provides a framework which enables interoperability with a large range of agnostic sensor devices whilst simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classification and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the open data initiative enabling collaboration with the international community of researchers.https://ieeexplore.ieee.org/document/8405517/Data analysisdata storage systemsdatabase systemsInternet of Thingsmachine learningsensor systems
spellingShingle Joseph Rafferty
Jonathan Synnott
Chris D. Nugent
Andrew Ennis
Philip A. Catherwood
Ian Mcchesney
Ian Cleland
Sally Mcclean
A Scalable, Research Oriented, Generic, Sensor Data Platform
IEEE Access
Data analysis
data storage systems
database systems
Internet of Things
machine learning
sensor systems
title A Scalable, Research Oriented, Generic, Sensor Data Platform
title_full A Scalable, Research Oriented, Generic, Sensor Data Platform
title_fullStr A Scalable, Research Oriented, Generic, Sensor Data Platform
title_full_unstemmed A Scalable, Research Oriented, Generic, Sensor Data Platform
title_short A Scalable, Research Oriented, Generic, Sensor Data Platform
title_sort scalable research oriented generic sensor data platform
topic Data analysis
data storage systems
database systems
Internet of Things
machine learning
sensor systems
url https://ieeexplore.ieee.org/document/8405517/
work_keys_str_mv AT josephrafferty ascalableresearchorientedgenericsensordataplatform
AT jonathansynnott ascalableresearchorientedgenericsensordataplatform
AT chrisdnugent ascalableresearchorientedgenericsensordataplatform
AT andrewennis ascalableresearchorientedgenericsensordataplatform
AT philipacatherwood ascalableresearchorientedgenericsensordataplatform
AT ianmcchesney ascalableresearchorientedgenericsensordataplatform
AT iancleland ascalableresearchorientedgenericsensordataplatform
AT sallymcclean ascalableresearchorientedgenericsensordataplatform
AT josephrafferty scalableresearchorientedgenericsensordataplatform
AT jonathansynnott scalableresearchorientedgenericsensordataplatform
AT chrisdnugent scalableresearchorientedgenericsensordataplatform
AT andrewennis scalableresearchorientedgenericsensordataplatform
AT philipacatherwood scalableresearchorientedgenericsensordataplatform
AT ianmcchesney scalableresearchorientedgenericsensordataplatform
AT iancleland scalableresearchorientedgenericsensordataplatform
AT sallymcclean scalableresearchorientedgenericsensordataplatform