An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network
Abstract For eye state recognition (closed or open), a mechanism based on deep convolutional neural network (DCNN) using the Zhejiang University (ZJU) and Closed Eyes in the Wild (CEW) dataset, has been proposed in this paper. In instances where blinking is consequential, eye state recognition plays...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer
2022-07-01
|
| Series: | International Journal of Computational Intelligence Systems |
| Subjects: | |
| Online Access: | https://doi.org/10.1007/s44196-022-00108-2 |
| _version_ | 1828259807672401920 |
|---|---|
| author | Ismail Kayadibi Gür Emre Güraksın Uçman Ergün Nurgül Özmen Süzme |
| author_facet | Ismail Kayadibi Gür Emre Güraksın Uçman Ergün Nurgül Özmen Süzme |
| author_sort | Ismail Kayadibi |
| collection | DOAJ |
| description | Abstract For eye state recognition (closed or open), a mechanism based on deep convolutional neural network (DCNN) using the Zhejiang University (ZJU) and Closed Eyes in the Wild (CEW) dataset, has been proposed in this paper. In instances where blinking is consequential, eye state recognition plays a critical part for the development of human–machine interaction (HMI) solutions. To accomplish this objective, pre-trained CNN architectures on ImageNet were first trained on the both dataset, which included both open and closed-eye states, and then they were tested, and their performance was quantified. The AlexNet design has proven to be more successful owing to these assessments. The ZJU and CEW datasets were leveraged to train the DCNN architecture, which was constructed employing AlexNet modifications for performance enhancement. On the both datasets, the suggested DCNN architecture was tested for performance. The achieved DCNN design was found to have 97.32% accuracy, 95.37% sensitivity, 97.97% specificity, 93.99% precision, 94.67% F1 score, and 99.37% AUC values in the ZJU dataset, while it was found to have 97.93% accuracy, 98.74% sensitivity, 97.15% specificity, 97.11% precision, 97.92% F1 score, and 99.69% AUC values in the CEW dataset. Accordingly, when compared to CNN architectures, it scored the maximum performance. At the same time, the DCNN architecture proposed on the ZJU and CEW datasets has been confirmed to be an acceptable and productive solution for eye state recognition depending on the outcomes compared to the studies in the literature. This method may contribute to the development of HMI systems by adding to the literature on eye state recognition. |
| first_indexed | 2024-04-13T03:15:25Z |
| format | Article |
| id | doaj.art-8c1755baf0f745a583d4b824a487be04 |
| institution | Directory Open Access Journal |
| issn | 1875-6883 |
| language | English |
| last_indexed | 2024-04-13T03:15:25Z |
| publishDate | 2022-07-01 |
| publisher | Springer |
| record_format | Article |
| series | International Journal of Computational Intelligence Systems |
| spelling | doaj.art-8c1755baf0f745a583d4b824a487be042022-12-22T03:04:56ZengSpringerInternational Journal of Computational Intelligence Systems1875-68832022-07-0115111910.1007/s44196-022-00108-2An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural NetworkIsmail Kayadibi0Gür Emre Güraksın1Uçman Ergün2Nurgül Özmen Süzme3Department of Biomedical Engineering, Afyon Kocatepe UniversityDepartment of Computer Engineering, Afyon Kocatepe UniversityDepartment of Biomedical Engineering, Afyon Kocatepe UniversityDepartment of Biomedical Engineering, Afyon Kocatepe UniversityAbstract For eye state recognition (closed or open), a mechanism based on deep convolutional neural network (DCNN) using the Zhejiang University (ZJU) and Closed Eyes in the Wild (CEW) dataset, has been proposed in this paper. In instances where blinking is consequential, eye state recognition plays a critical part for the development of human–machine interaction (HMI) solutions. To accomplish this objective, pre-trained CNN architectures on ImageNet were first trained on the both dataset, which included both open and closed-eye states, and then they were tested, and their performance was quantified. The AlexNet design has proven to be more successful owing to these assessments. The ZJU and CEW datasets were leveraged to train the DCNN architecture, which was constructed employing AlexNet modifications for performance enhancement. On the both datasets, the suggested DCNN architecture was tested for performance. The achieved DCNN design was found to have 97.32% accuracy, 95.37% sensitivity, 97.97% specificity, 93.99% precision, 94.67% F1 score, and 99.37% AUC values in the ZJU dataset, while it was found to have 97.93% accuracy, 98.74% sensitivity, 97.15% specificity, 97.11% precision, 97.92% F1 score, and 99.69% AUC values in the CEW dataset. Accordingly, when compared to CNN architectures, it scored the maximum performance. At the same time, the DCNN architecture proposed on the ZJU and CEW datasets has been confirmed to be an acceptable and productive solution for eye state recognition depending on the outcomes compared to the studies in the literature. This method may contribute to the development of HMI systems by adding to the literature on eye state recognition.https://doi.org/10.1007/s44196-022-00108-2Eye state recognitionHuman–machine interactionDeep learningDeep convolutional neural networkTransfer learning |
| spellingShingle | Ismail Kayadibi Gür Emre Güraksın Uçman Ergün Nurgül Özmen Süzme An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network International Journal of Computational Intelligence Systems Eye state recognition Human–machine interaction Deep learning Deep convolutional neural network Transfer learning |
| title | An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network |
| title_full | An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network |
| title_fullStr | An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network |
| title_full_unstemmed | An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network |
| title_short | An Eye State Recognition System Using Transfer Learning: AlexNet-Based Deep Convolutional Neural Network |
| title_sort | eye state recognition system using transfer learning alexnet based deep convolutional neural network |
| topic | Eye state recognition Human–machine interaction Deep learning Deep convolutional neural network Transfer learning |
| url | https://doi.org/10.1007/s44196-022-00108-2 |
| work_keys_str_mv | AT ismailkayadibi aneyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT guremreguraksın aneyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT ucmanergun aneyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT nurgulozmensuzme aneyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT ismailkayadibi eyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT guremreguraksın eyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT ucmanergun eyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork AT nurgulozmensuzme eyestaterecognitionsystemusingtransferlearningalexnetbaseddeepconvolutionalneuralnetwork |