Appliances interaction activities recognition using smartphones

In this endeavour, the primary focus is on detecting the activation of energy-related devices by users, coupled with the recognition of human activities to enhance the former. The project entails an exploration into the activation patterns of various household appliances such as televisions, washing...

Full description

Bibliographic Details
Main Author: Soh, Rynard Jun Yang
Other Authors: Soh Yeng Chai
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2024
Subjects:
Online Access:https://hdl.handle.net/10356/176927
_version_ 1826112765046030336
author Soh, Rynard Jun Yang
author2 Soh Yeng Chai
author_facet Soh Yeng Chai
Soh, Rynard Jun Yang
author_sort Soh, Rynard Jun Yang
collection NTU
description In this endeavour, the primary focus is on detecting the activation of energy-related devices by users, coupled with the recognition of human activities to enhance the former. The project entails an exploration into the activation patterns of various household appliances such as televisions, washing machines, vacuum cleaners, and more, utilising their distinctive audio signatures. Leveraging machine learning algorithms, specifically convolutional neural networks for event recognition, the project aims to process and differentiate these signatures, enabling the identification of both individual and combined activities and events. Furthermore, the project will incorporate gyrometers and accelerometers to discern user motion, facilitating the deduction of associated activities. Additionally, the project will leverage the smartphone camera, employing transfer learning techniques to enhance image recognition capabilities. This approach will contribute to the identification and categorisation of objects or activities captured by the camera within the project's defined scope. This comprehensive approach underscores the project's commitment to robustly identifying energy device activation, user activities, and object recognition for a more nuanced understanding of user interactions.
first_indexed 2024-10-01T03:12:08Z
format Final Year Project (FYP)
id ntu-10356/176927
institution Nanyang Technological University
language English
last_indexed 2024-10-01T03:12:08Z
publishDate 2024
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1769272024-05-24T15:44:04Z Appliances interaction activities recognition using smartphones Soh, Rynard Jun Yang Soh Yeng Chai School of Electrical and Electronic Engineering EYCSOH@ntu.edu.sg Computer and Information Science Engineering In this endeavour, the primary focus is on detecting the activation of energy-related devices by users, coupled with the recognition of human activities to enhance the former. The project entails an exploration into the activation patterns of various household appliances such as televisions, washing machines, vacuum cleaners, and more, utilising their distinctive audio signatures. Leveraging machine learning algorithms, specifically convolutional neural networks for event recognition, the project aims to process and differentiate these signatures, enabling the identification of both individual and combined activities and events. Furthermore, the project will incorporate gyrometers and accelerometers to discern user motion, facilitating the deduction of associated activities. Additionally, the project will leverage the smartphone camera, employing transfer learning techniques to enhance image recognition capabilities. This approach will contribute to the identification and categorisation of objects or activities captured by the camera within the project's defined scope. This comprehensive approach underscores the project's commitment to robustly identifying energy device activation, user activities, and object recognition for a more nuanced understanding of user interactions. Bachelor's degree 2024-05-21T04:24:50Z 2024-05-21T04:24:50Z 2024 Final Year Project (FYP) Soh, R. J. Y. (2024). Appliances interaction activities recognition using smartphones. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/176927 https://hdl.handle.net/10356/176927 en application/pdf Nanyang Technological University
spellingShingle Computer and Information Science
Engineering
Soh, Rynard Jun Yang
Appliances interaction activities recognition using smartphones
title Appliances interaction activities recognition using smartphones
title_full Appliances interaction activities recognition using smartphones
title_fullStr Appliances interaction activities recognition using smartphones
title_full_unstemmed Appliances interaction activities recognition using smartphones
title_short Appliances interaction activities recognition using smartphones
title_sort appliances interaction activities recognition using smartphones
topic Computer and Information Science
Engineering
url https://hdl.handle.net/10356/176927
work_keys_str_mv AT sohrynardjunyang appliancesinteractionactivitiesrecognitionusingsmartphones