An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs

In a society with aging population, the demand for electric wheelchairs is growing with the advancement of automation. However, many accidents have occurred due to the misjudgment of the slope angle and wheelchair speed while the wheelchair is traveling on ramps. This research employs the light elec...

Full description

Bibliographic Details
Main Authors: Bing-Fei Wu, Yung-Shin Chen, Ching-Wei Huang, Po-Ju Chang
Format: Article
Language:English
Published: IEEE 2018-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8364538/
_version_ 1818641650660933632
author Bing-Fei Wu
Yung-Shin Chen
Ching-Wei Huang
Po-Ju Chang
author_facet Bing-Fei Wu
Yung-Shin Chen
Ching-Wei Huang
Po-Ju Chang
author_sort Bing-Fei Wu
collection DOAJ
description In a society with aging population, the demand for electric wheelchairs is growing with the advancement of automation. However, many accidents have occurred due to the misjudgment of the slope angle and wheelchair speed while the wheelchair is traveling on ramps. This research employs the light electronic assistance pal compact motor package to reduce the weight and size of conventional electric wheelchairs. The modular design of proposed uphill controller and ramp detection functions allows users to easily select and incorporate only the functions they need. This paper proposes a ramp detection model implemented using the deep learning algorithm with CNN-4 structure to analyze depth image data. The model's recognition time of each video frame is 11 times faster than that of the AlexNet and GoogleNet. The uphill safety controller is designed as an adaptive network-based fuzzy inference system with Q-learning. The safe speed is automatically calculated according to the angle obtained from slope classification and revised in real-time during the slope driving to prevent the user from moving towards the dangerous ramp or rolling back due to inadequate speed. The accuracy of ramp detection is further increased by 5% to 97.1% due to assistance from the voting system processing and the gyroscope output data. The 5° ramp experiment of our uphill controller with ramp classification takes 20 s to complete the slope driving which is 23% faster than the controller without ramp detection. The energy consumption is also one half less than the experiment without uphill detection.
first_indexed 2024-12-16T23:30:32Z
format Article
id doaj.art-b119f8f30fea4e518d4b5555ca03e90b
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-16T23:30:32Z
publishDate 2018-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-b119f8f30fea4e518d4b5555ca03e90b2022-12-21T22:11:54ZengIEEEIEEE Access2169-35362018-01-016283562837110.1109/ACCESS.2018.28397298364538An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent WheelchairsBing-Fei Wu0Yung-Shin Chen1https://orcid.org/0000-0002-7104-3732Ching-Wei Huang2Po-Ju Chang3Institute of Electrical and Control Engineering, National Chiao Tung University, Hsinchu, TaiwanInstitute of Electrical and Control Engineering, National Chiao Tung University, Hsinchu, TaiwanInstitute of Electrical and Control Engineering, National Chiao Tung University, Hsinchu, TaiwanInstitute of Electrical and Control Engineering, National Chiao Tung University, Hsinchu, TaiwanIn a society with aging population, the demand for electric wheelchairs is growing with the advancement of automation. However, many accidents have occurred due to the misjudgment of the slope angle and wheelchair speed while the wheelchair is traveling on ramps. This research employs the light electronic assistance pal compact motor package to reduce the weight and size of conventional electric wheelchairs. The modular design of proposed uphill controller and ramp detection functions allows users to easily select and incorporate only the functions they need. This paper proposes a ramp detection model implemented using the deep learning algorithm with CNN-4 structure to analyze depth image data. The model's recognition time of each video frame is 11 times faster than that of the AlexNet and GoogleNet. The uphill safety controller is designed as an adaptive network-based fuzzy inference system with Q-learning. The safe speed is automatically calculated according to the angle obtained from slope classification and revised in real-time during the slope driving to prevent the user from moving towards the dangerous ramp or rolling back due to inadequate speed. The accuracy of ramp detection is further increased by 5% to 97.1% due to assistance from the voting system processing and the gyroscope output data. The 5° ramp experiment of our uphill controller with ramp classification takes 20 s to complete the slope driving which is 23% faster than the controller without ramp detection. The energy consumption is also one half less than the experiment without uphill detection.https://ieeexplore.ieee.org/document/8364538/Command and control systemslearningintelligent wheelchairdeep learningadaptive network-based fuzzy inference system (ANFIS)Q-learning
spellingShingle Bing-Fei Wu
Yung-Shin Chen
Ching-Wei Huang
Po-Ju Chang
An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
IEEE Access
Command and control systems
learning
intelligent wheelchair
deep learning
adaptive network-based fuzzy inference system (ANFIS)
Q-learning
title An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
title_full An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
title_fullStr An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
title_full_unstemmed An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
title_short An Uphill Safety Controller With Deep Learning-Based Ramp Detection for Intelligent Wheelchairs
title_sort uphill safety controller with deep learning based ramp detection for intelligent wheelchairs
topic Command and control systems
learning
intelligent wheelchair
deep learning
adaptive network-based fuzzy inference system (ANFIS)
Q-learning
url https://ieeexplore.ieee.org/document/8364538/
work_keys_str_mv AT bingfeiwu anuphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT yungshinchen anuphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT chingweihuang anuphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT pojuchang anuphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT bingfeiwu uphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT yungshinchen uphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT chingweihuang uphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs
AT pojuchang uphillsafetycontrollerwithdeeplearningbasedrampdetectionforintelligentwheelchairs