Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture
The Internet of Things (IoT) is an emerging Internet-based architecture, enabling the exchange of data and services in a global network. With the advent of the Internet of Things, more and more devices are connecting to the Internet in order to help people get and share data or program actions. In t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-07-01
|
| Series: | Designs |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2411-9660/3/3/32 |
| _version_ | 1811294947543875584 |
|---|---|
| author | George Alexakis Spyros Panagiotakis Alexander Fragkakis Evangelos Markakis Kostas Vassilakis |
| author_facet | George Alexakis Spyros Panagiotakis Alexander Fragkakis Evangelos Markakis Kostas Vassilakis |
| author_sort | George Alexakis |
| collection | DOAJ |
| description | The Internet of Things (IoT) is an emerging Internet-based architecture, enabling the exchange of data and services in a global network. With the advent of the Internet of Things, more and more devices are connecting to the Internet in order to help people get and share data or program actions. In this paper, we introduce an IoT Agent, a Web application for monitoring and controlling a smart home remotely. The IoT Agent integrates a chat bot that can understand text or voice commands using natural language processing (NLP). With the use of NLP, home devices are more user-friendly and controlling them is easier, since even when a command or question/command is different from the presets, the system understands the user’s wishes and responds accordingly. Our solution exploits several available Application Programming Interfaces (APIs), namely: the Dialogflow API for the efficient integration of NLP to our IoT system, the Web Speech API for enriching user experience with voice recognition and synthesis features, MQTT (Message Queuing Telemetry Transport) for the lightweight control of actuators and Firebase for dynamic data storage. This is the most significant innovation it brings: the integration of several third-party APIs and open source technologies into one mash-up, highlighting how a new IoT application can be built today using a multi-tier architecture. We believe that such a tiered architecture can be very useful for the rapid development of smart home applications. |
| first_indexed | 2024-04-13T05:25:04Z |
| format | Article |
| id | doaj.art-cb8e0653c49e41148d8c0af0ed488e63 |
| institution | Directory Open Access Journal |
| issn | 2411-9660 |
| language | English |
| last_indexed | 2024-04-13T05:25:04Z |
| publishDate | 2019-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Designs |
| spelling | doaj.art-cb8e0653c49e41148d8c0af0ed488e632022-12-22T03:00:37ZengMDPI AGDesigns2411-96602019-07-01333210.3390/designs3030032designs3030032Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier ArchitectureGeorge Alexakis0Spyros Panagiotakis1Alexander Fragkakis2Evangelos Markakis3Kostas Vassilakis4Department of Electrical and Computer Engineering, Hellenic Mediterranean University, GR71004 Heraklion, GreeceDepartment of Electrical and Computer Engineering, Hellenic Mediterranean University, GR71004 Heraklion, GreeceDepartment of Electrical and Computer Engineering, Hellenic Mediterranean University, GR71004 Heraklion, GreeceDepartment of Electrical and Computer Engineering, Hellenic Mediterranean University, GR71004 Heraklion, GreeceDepartment of Electrical and Computer Engineering, Hellenic Mediterranean University, GR71004 Heraklion, GreeceThe Internet of Things (IoT) is an emerging Internet-based architecture, enabling the exchange of data and services in a global network. With the advent of the Internet of Things, more and more devices are connecting to the Internet in order to help people get and share data or program actions. In this paper, we introduce an IoT Agent, a Web application for monitoring and controlling a smart home remotely. The IoT Agent integrates a chat bot that can understand text or voice commands using natural language processing (NLP). With the use of NLP, home devices are more user-friendly and controlling them is easier, since even when a command or question/command is different from the presets, the system understands the user’s wishes and responds accordingly. Our solution exploits several available Application Programming Interfaces (APIs), namely: the Dialogflow API for the efficient integration of NLP to our IoT system, the Web Speech API for enriching user experience with voice recognition and synthesis features, MQTT (Message Queuing Telemetry Transport) for the lightweight control of actuators and Firebase for dynamic data storage. This is the most significant innovation it brings: the integration of several third-party APIs and open source technologies into one mash-up, highlighting how a new IoT application can be built today using a multi-tier architecture. We believe that such a tiered architecture can be very useful for the rapid development of smart home applications.https://www.mdpi.com/2411-9660/3/3/32Internet of ThingsIoTsmart homechatbotnatural language processingNLPWeb Speech APIDialogflow APIMQTTmulti-tier architecture |
| spellingShingle | George Alexakis Spyros Panagiotakis Alexander Fragkakis Evangelos Markakis Kostas Vassilakis Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture Designs Internet of Things IoT smart home chatbot natural language processing NLP Web Speech API Dialogflow API MQTT multi-tier architecture |
| title | Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture |
| title_full | Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture |
| title_fullStr | Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture |
| title_full_unstemmed | Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture |
| title_short | Control of Smart Home Operations Using Natural Language Processing, Voice Recognition and IoT Technologies in a Multi-Tier Architecture |
| title_sort | control of smart home operations using natural language processing voice recognition and iot technologies in a multi tier architecture |
| topic | Internet of Things IoT smart home chatbot natural language processing NLP Web Speech API Dialogflow API MQTT multi-tier architecture |
| url | https://www.mdpi.com/2411-9660/3/3/32 |
| work_keys_str_mv | AT georgealexakis controlofsmarthomeoperationsusingnaturallanguageprocessingvoicerecognitionandiottechnologiesinamultitierarchitecture AT spyrospanagiotakis controlofsmarthomeoperationsusingnaturallanguageprocessingvoicerecognitionandiottechnologiesinamultitierarchitecture AT alexanderfragkakis controlofsmarthomeoperationsusingnaturallanguageprocessingvoicerecognitionandiottechnologiesinamultitierarchitecture AT evangelosmarkakis controlofsmarthomeoperationsusingnaturallanguageprocessingvoicerecognitionandiottechnologiesinamultitierarchitecture AT kostasvassilakis controlofsmarthomeoperationsusingnaturallanguageprocessingvoicerecognitionandiottechnologiesinamultitierarchitecture |