Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction

In this work, a large-scale tactile detection system is proposed, whose development is based on a soft structure using Machine Learning and Computer Vision algorithms to map the surface of a forearm sleeve. The current application has a cylindrical design, whose dimensions intend to be like a human...

Full description

Bibliographic Details
Main Authors: Fábio Cunha, Tiago Ribeiro, Gil Lopes, A. Fernando Ribeiro
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/2/825
_version_ 1797437216573620224
author Fábio Cunha
Tiago Ribeiro
Gil Lopes
A. Fernando Ribeiro
author_facet Fábio Cunha
Tiago Ribeiro
Gil Lopes
A. Fernando Ribeiro
author_sort Fábio Cunha
collection DOAJ
description In this work, a large-scale tactile detection system is proposed, whose development is based on a soft structure using Machine Learning and Computer Vision algorithms to map the surface of a forearm sleeve. The current application has a cylindrical design, whose dimensions intend to be like a human forearm or bicep. The model was developed assuming that deformations occur only at one section at a time. The goal for this system is to be coupled with the CHARMIE robot, a collaborative robot for domestic and medical environments. This system allows the contact detection of the entire forearm surface enabling interaction between a Human Being and a robot. A matrix with sections can be configured to present certain functionalities, allowing CHARMIE to detect contact in a particular section, and thus perform a specific behaviour. After building the dataset, an Artificial Neural Network (ANN) was created. This network was called Section Detection Network (SDN), and through Supervised Learning, a model was created to predict the contact location. Furthermore, Stratified K-Fold Cross Validation (SKFCV) was used to divide the dataset. All these steps resulted in Neural Network with a test data accuracy higher than 80%. Regarding the real-time evaluation, a graphical interface was structured to demonstrate the predicted class and the corresponding probability. This research concluded that the method described has enormous potential to be used as a tool for service robots allowing enhanced human-robot interaction.
first_indexed 2024-03-09T11:16:40Z
format Article
id doaj.art-2e0a96ecbf0e44a7b1dcd4e7c0158be7
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T11:16:40Z
publishDate 2023-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-2e0a96ecbf0e44a7b1dcd4e7c0158be72023-12-01T00:28:15ZengMDPI AGSensors1424-82202023-01-0123282510.3390/s23020825Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human InteractionFábio Cunha0Tiago Ribeiro1Gil Lopes2A. Fernando Ribeiro3Industrial Electronics Department, University of Minho, 4800-058 Guimarães, PortugalIndustrial Electronics Department, University of Minho, 4800-058 Guimarães, PortugalINESCTEC, University of Maia—ISMAI, 4475-690 Maia, PortugalIndustrial Electronics Department, University of Minho, 4800-058 Guimarães, PortugalIn this work, a large-scale tactile detection system is proposed, whose development is based on a soft structure using Machine Learning and Computer Vision algorithms to map the surface of a forearm sleeve. The current application has a cylindrical design, whose dimensions intend to be like a human forearm or bicep. The model was developed assuming that deformations occur only at one section at a time. The goal for this system is to be coupled with the CHARMIE robot, a collaborative robot for domestic and medical environments. This system allows the contact detection of the entire forearm surface enabling interaction between a Human Being and a robot. A matrix with sections can be configured to present certain functionalities, allowing CHARMIE to detect contact in a particular section, and thus perform a specific behaviour. After building the dataset, an Artificial Neural Network (ANN) was created. This network was called Section Detection Network (SDN), and through Supervised Learning, a model was created to predict the contact location. Furthermore, Stratified K-Fold Cross Validation (SKFCV) was used to divide the dataset. All these steps resulted in Neural Network with a test data accuracy higher than 80%. Regarding the real-time evaluation, a graphical interface was structured to demonstrate the predicted class and the corresponding probability. This research concluded that the method described has enormous potential to be used as a tool for service robots allowing enhanced human-robot interaction.https://www.mdpi.com/1424-8220/23/2/825roboticsservice robotshuman-machine interfacetouch sensorMachine LearningArtificial Neural Networks
spellingShingle Fábio Cunha
Tiago Ribeiro
Gil Lopes
A. Fernando Ribeiro
Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
Sensors
robotics
service robots
human-machine interface
touch sensor
Machine Learning
Artificial Neural Networks
title Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
title_full Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
title_fullStr Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
title_full_unstemmed Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
title_short Large-Scale Tactile Detection System Based on Supervised Learning for Service Robots Human Interaction
title_sort large scale tactile detection system based on supervised learning for service robots human interaction
topic robotics
service robots
human-machine interface
touch sensor
Machine Learning
Artificial Neural Networks
url https://www.mdpi.com/1424-8220/23/2/825
work_keys_str_mv AT fabiocunha largescaletactiledetectionsystembasedonsupervisedlearningforservicerobotshumaninteraction
AT tiagoribeiro largescaletactiledetectionsystembasedonsupervisedlearningforservicerobotshumaninteraction
AT gillopes largescaletactiledetectionsystembasedonsupervisedlearningforservicerobotshumaninteraction
AT afernandoribeiro largescaletactiledetectionsystembasedonsupervisedlearningforservicerobotshumaninteraction