Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors
Fall accidents can cause severe impacts on the physical health and the quality of life of those who suffer limb diseases or injuries, the elderly, and their caregivers. Moreover, the later the accident is discovered, the lower the chance of recovery of the injured one. In order to detect accidents e...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-05-01
|
| Series: | Micromachines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-666X/12/5/508 |
| _version_ | 1797535443245334528 |
|---|---|
| author | Feng-Shuo Hsu Tang-Chen Chang Zi-Jun Su Shin-Jhe Huang Chien-Chang Chen |
| author_facet | Feng-Shuo Hsu Tang-Chen Chang Zi-Jun Su Shin-Jhe Huang Chien-Chang Chen |
| author_sort | Feng-Shuo Hsu |
| collection | DOAJ |
| description | Fall accidents can cause severe impacts on the physical health and the quality of life of those who suffer limb diseases or injuries, the elderly, and their caregivers. Moreover, the later the accident is discovered, the lower the chance of recovery of the injured one. In order to detect accidents earlier, we propose a data-driven human fall detection framework. By combining the sensing mechanism of a commercialized webcam and an ultrasonic sensor array, we develop a probability model for automatic human fall monitoring. The webcam and ultrasonic array respectively collect the transverse and longitudinal time-series signals from a moving subject, and then these signals are assembled as a three-dimensional (3D) movement trajectory map. We also use two different detection-tracking algorithms for recognizing the tracked subjects. The mean height of the subjects is 164.2 ± 12 cm. Based on the data density functional theory (DDFT), we use the 3D motion data to estimate the cluster numbers and their cluster boundaries. We also employ the Gaussian mixture model as the DDFT kernel. Then, we utilize those features to build a probabilistic model of human falling. The model visually exhibits three possible states of human motions: normal motion, transition, and falling. The acceptable detection accuracy and the small model size reveals the feasibility of the proposed hybridized platform. The time from starting the alarm to an actual fall is on average about 0.7 s in our platform. The proposed sensing mechanisms offer 90% accuracy, 90% sensitivity, and 95% precision in the data validation. Then these vital results validate that the proposed framework has comparable performance to the contemporary methods. |
| first_indexed | 2024-03-10T11:45:31Z |
| format | Article |
| id | doaj.art-b31afa92a9f24cf7bb15c8e4d0f43b46 |
| institution | Directory Open Access Journal |
| issn | 2072-666X |
| language | English |
| last_indexed | 2024-03-10T11:45:31Z |
| publishDate | 2021-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Micromachines |
| spelling | doaj.art-b31afa92a9f24cf7bb15c8e4d0f43b462023-11-21T18:08:59ZengMDPI AGMicromachines2072-666X2021-05-0112550810.3390/mi12050508Smart Fall Detection Framework Using Hybridized Video and Ultrasonic SensorsFeng-Shuo Hsu0Tang-Chen Chang1Zi-Jun Su2Shin-Jhe Huang3Chien-Chang Chen4Department of Psychiatry, Taichung Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, Taichung 42743, TaiwanBio-Microsystems Integration Laboratory, Department of Biomedical Sciences and Engineering, National Central University, Taoyuan City 32001, TaiwanBio-Microsystems Integration Laboratory, Department of Biomedical Sciences and Engineering, National Central University, Taoyuan City 32001, TaiwanBio-Microsystems Integration Laboratory, Department of Biomedical Sciences and Engineering, National Central University, Taoyuan City 32001, TaiwanBio-Microsystems Integration Laboratory, Department of Biomedical Sciences and Engineering, National Central University, Taoyuan City 32001, TaiwanFall accidents can cause severe impacts on the physical health and the quality of life of those who suffer limb diseases or injuries, the elderly, and their caregivers. Moreover, the later the accident is discovered, the lower the chance of recovery of the injured one. In order to detect accidents earlier, we propose a data-driven human fall detection framework. By combining the sensing mechanism of a commercialized webcam and an ultrasonic sensor array, we develop a probability model for automatic human fall monitoring. The webcam and ultrasonic array respectively collect the transverse and longitudinal time-series signals from a moving subject, and then these signals are assembled as a three-dimensional (3D) movement trajectory map. We also use two different detection-tracking algorithms for recognizing the tracked subjects. The mean height of the subjects is 164.2 ± 12 cm. Based on the data density functional theory (DDFT), we use the 3D motion data to estimate the cluster numbers and their cluster boundaries. We also employ the Gaussian mixture model as the DDFT kernel. Then, we utilize those features to build a probabilistic model of human falling. The model visually exhibits three possible states of human motions: normal motion, transition, and falling. The acceptable detection accuracy and the small model size reveals the feasibility of the proposed hybridized platform. The time from starting the alarm to an actual fall is on average about 0.7 s in our platform. The proposed sensing mechanisms offer 90% accuracy, 90% sensitivity, and 95% precision in the data validation. Then these vital results validate that the proposed framework has comparable performance to the contemporary methods.https://www.mdpi.com/2072-666X/12/5/508data density functional theoryfall detectionmachine learningposture detectionsensor fusionultrasonic sensors |
| spellingShingle | Feng-Shuo Hsu Tang-Chen Chang Zi-Jun Su Shin-Jhe Huang Chien-Chang Chen Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors Micromachines data density functional theory fall detection machine learning posture detection sensor fusion ultrasonic sensors |
| title | Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors |
| title_full | Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors |
| title_fullStr | Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors |
| title_full_unstemmed | Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors |
| title_short | Smart Fall Detection Framework Using Hybridized Video and Ultrasonic Sensors |
| title_sort | smart fall detection framework using hybridized video and ultrasonic sensors |
| topic | data density functional theory fall detection machine learning posture detection sensor fusion ultrasonic sensors |
| url | https://www.mdpi.com/2072-666X/12/5/508 |
| work_keys_str_mv | AT fengshuohsu smartfalldetectionframeworkusinghybridizedvideoandultrasonicsensors AT tangchenchang smartfalldetectionframeworkusinghybridizedvideoandultrasonicsensors AT zijunsu smartfalldetectionframeworkusinghybridizedvideoandultrasonicsensors AT shinjhehuang smartfalldetectionframeworkusinghybridizedvideoandultrasonicsensors AT chienchangchen smartfalldetectionframeworkusinghybridizedvideoandultrasonicsensors |