Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors
With the rapid development of artificial intelligence technology, the exploration and application in the field of intelligent education has become a research hotspot of increasing concern. In the actual classroom scenarios, students’ classroom behavior is an important factor that directly affects th...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-01-01
|
| Series: | Bioengineering |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2306-5354/10/2/127 |
| _version_ | 1797622327773495296 |
|---|---|
| author | Hongmin Wang Chi Gao Hong Fu Christina Zong-Hao Ma Quan Wang Ziyu He Maojun Li |
| author_facet | Hongmin Wang Chi Gao Hong Fu Christina Zong-Hao Ma Quan Wang Ziyu He Maojun Li |
| author_sort | Hongmin Wang |
| collection | DOAJ |
| description | With the rapid development of artificial intelligence technology, the exploration and application in the field of intelligent education has become a research hotspot of increasing concern. In the actual classroom scenarios, students’ classroom behavior is an important factor that directly affects their learning performance. Specifically, students with poor self-management abilities, particularly specific developmental disorders, may face educational and academic difficulties owing to physical or psychological factors. Therefore, the intelligent perception and identification of school-aged children’s classroom behaviors are extremely valuable and significant. The traditional method for identifying students’ classroom behavior relies on statistical surveys conducted by teachers, which incurs problems such as being time-consuming, labor-intensive, privacy-violating, and an inaccurate manual intervention. To address the above-mentioned issues, we constructed a motion sensor-based intelligent system to realize the perception and identification of classroom behavior in the current study. For the acquired sensor signal, we proposed a Voting-Based Dynamic Time Warping algorithm (VB-DTW) in which a voting mechanism is used to compare the similarities between adjacent clips and extract valid action segments. Subsequent experiments have verified that effective signal segments can help improve the accuracy of behavior identification. Furthermore, upon combining with the classroom motion data acquisition system, through the powerful feature extraction ability of the deep learning algorithms, the effectiveness and feasibility are verified from the perspectives of the dimensional signal characteristics and time series separately so as to realize the accurate, non-invasive and intelligent children’s behavior detection. To verify the feasibility of the proposed method, a self-constructed dataset (SCB-13) was collected. Thirteen participants were invited to perform 14 common class behaviors, wearing motion sensors whose data were recorded by a program. In SCB-13, the proposed method achieved 100% identification accuracy. Based on the proposed algorithms, it is possible to provide immediate feedback on students’ classroom performance and help them improve their learning performance while providing an essential reference basis and data support for constructing an intelligent digital education platform. |
| first_indexed | 2024-03-11T09:08:38Z |
| format | Article |
| id | doaj.art-1bf17428758d4b72842103620067955a |
| institution | Directory Open Access Journal |
| issn | 2306-5354 |
| language | English |
| last_indexed | 2024-03-11T09:08:38Z |
| publishDate | 2023-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Bioengineering |
| spelling | doaj.art-1bf17428758d4b72842103620067955a2023-11-16T19:09:57ZengMDPI AGBioengineering2306-53542023-01-0110212710.3390/bioengineering10020127Automated Student Classroom Behaviors’ Perception and Identification Using Motion SensorsHongmin Wang0Chi Gao1Hong Fu2Christina Zong-Hao Ma3Quan Wang4Ziyu He5Maojun Li6Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong 999077, ChinaThe Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics of the Chinese Academy of Sciences, Xi’an 710119, ChinaDepartment of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong 999077, ChinaDepartment of Biomedical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, ChinaThe Key Laboratory of Spectral Imaging Technology, Xi’an Institute of Optics and Precision Mechanics of the Chinese Academy of Sciences, Xi’an 710119, ChinaDepartment of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong 999077, ChinaDepartment of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong 999077, ChinaWith the rapid development of artificial intelligence technology, the exploration and application in the field of intelligent education has become a research hotspot of increasing concern. In the actual classroom scenarios, students’ classroom behavior is an important factor that directly affects their learning performance. Specifically, students with poor self-management abilities, particularly specific developmental disorders, may face educational and academic difficulties owing to physical or psychological factors. Therefore, the intelligent perception and identification of school-aged children’s classroom behaviors are extremely valuable and significant. The traditional method for identifying students’ classroom behavior relies on statistical surveys conducted by teachers, which incurs problems such as being time-consuming, labor-intensive, privacy-violating, and an inaccurate manual intervention. To address the above-mentioned issues, we constructed a motion sensor-based intelligent system to realize the perception and identification of classroom behavior in the current study. For the acquired sensor signal, we proposed a Voting-Based Dynamic Time Warping algorithm (VB-DTW) in which a voting mechanism is used to compare the similarities between adjacent clips and extract valid action segments. Subsequent experiments have verified that effective signal segments can help improve the accuracy of behavior identification. Furthermore, upon combining with the classroom motion data acquisition system, through the powerful feature extraction ability of the deep learning algorithms, the effectiveness and feasibility are verified from the perspectives of the dimensional signal characteristics and time series separately so as to realize the accurate, non-invasive and intelligent children’s behavior detection. To verify the feasibility of the proposed method, a self-constructed dataset (SCB-13) was collected. Thirteen participants were invited to perform 14 common class behaviors, wearing motion sensors whose data were recorded by a program. In SCB-13, the proposed method achieved 100% identification accuracy. Based on the proposed algorithms, it is possible to provide immediate feedback on students’ classroom performance and help them improve their learning performance while providing an essential reference basis and data support for constructing an intelligent digital education platform.https://www.mdpi.com/2306-5354/10/2/127intelligent systemdeep learningclassroom behaviormotion identification |
| spellingShingle | Hongmin Wang Chi Gao Hong Fu Christina Zong-Hao Ma Quan Wang Ziyu He Maojun Li Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors Bioengineering intelligent system deep learning classroom behavior motion identification |
| title | Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors |
| title_full | Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors |
| title_fullStr | Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors |
| title_full_unstemmed | Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors |
| title_short | Automated Student Classroom Behaviors’ Perception and Identification Using Motion Sensors |
| title_sort | automated student classroom behaviors perception and identification using motion sensors |
| topic | intelligent system deep learning classroom behavior motion identification |
| url | https://www.mdpi.com/2306-5354/10/2/127 |
| work_keys_str_mv | AT hongminwang automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT chigao automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT hongfu automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT christinazonghaoma automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT quanwang automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT ziyuhe automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors AT maojunli automatedstudentclassroombehaviorsperceptionandidentificationusingmotionsensors |