Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model
Objective: Epilepsy prediction algorithms offer patients with drug-resistant epilepsy a way to reduce unintended harm from sudden seizures. The purpose of this study is to investigate the applicability of transfer learning (TL) technique and model inputs for different deep learning (DL) model struct...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10046136/ |
| _version_ | 1797805092647206912 |
|---|---|
| author | Shuaicong Hu Jian Liu Rui Yang Ya'Nan Wang Aiguo Wang Kuanzheng Li Wenxin Liu Cuiwei Yang |
| author_facet | Shuaicong Hu Jian Liu Rui Yang Ya'Nan Wang Aiguo Wang Kuanzheng Li Wenxin Liu Cuiwei Yang |
| author_sort | Shuaicong Hu |
| collection | DOAJ |
| description | Objective: Epilepsy prediction algorithms offer patients with drug-resistant epilepsy a way to reduce unintended harm from sudden seizures. The purpose of this study is to investigate the applicability of transfer learning (TL) technique and model inputs for different deep learning (DL) model structures, which may provide a reference for researchers to design algorithms. Moreover, we also attempt to provide a novel and precise Transformer-based algorithm. Methods: Two classical feature engineering methods and the proposed method which consists of various EEG rhythms are explored, then a hybrid Transformer model is designed to evaluate the advantages over pure convolutional neural networks (CNN)-based models. Finally, the performances of two model structures are analyzed utilizing patient-independent approach and two TL strategies. Results: We tested our method on the CHB-MIT scalp EEG database, the results showed that our feature engineering method gains a significant improvement in model performance and is more suitable for Transformer-based model. In addition, the performance improvement of Transformer-based model utilizing fine-tuning strategies is more robust than that of pure CNN-based model, and our model achieved an optimal sensitivity of 91.7% with false positive rate (FPR) of 0.00/h. Conclusion: Our epilepsy prediction method achieves excellent performance and demonstrates its advantage over pure CNN-based structure in TL. Moreover, we find that the information contained in the gamma (<inline-formula> <tex-math notation="LaTeX">$\gamma$ </tex-math></inline-formula>) rhythm is helpful for epilepsy prediction. Significance: We propose a precise hybrid Transformer model for epilepsy prediction. The applicability of TL and model inputs is also explored for customizing personalized models in clinical application scenarios. |
| first_indexed | 2024-03-13T05:45:51Z |
| format | Article |
| id | doaj.art-7c2aca96b3714bf6afc2b5b257bc1966 |
| institution | Directory Open Access Journal |
| issn | 1558-0210 |
| language | English |
| last_indexed | 2024-03-13T05:45:51Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| spelling | doaj.art-7c2aca96b3714bf6afc2b5b257bc19662023-06-13T20:09:52ZengIEEEIEEE Transactions on Neural Systems and Rehabilitation Engineering1558-02102023-01-01311321133210.1109/TNSRE.2023.324404510046136Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer ModelShuaicong Hu0https://orcid.org/0000-0001-5458-0416Jian Liu1https://orcid.org/0000-0001-5791-7221Rui Yang2Ya'Nan Wang3https://orcid.org/0000-0001-5599-3423Aiguo Wang4Kuanzheng Li5Wenxin Liu6Cuiwei Yang7https://orcid.org/0000-0003-3338-5835Center for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai, ChinaCenter for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai, ChinaCenter for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai, ChinaCenter for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai, ChinaXinghua City People’s Hospital, Jiangsu, ChinaXinghua City People’s Hospital, Jiangsu, ChinaXinghua City People’s Hospital, Jiangsu, ChinaCenter for Biomedical Engineering, School of Information Science and Technology, Fudan University, Shanghai, ChinaObjective: Epilepsy prediction algorithms offer patients with drug-resistant epilepsy a way to reduce unintended harm from sudden seizures. The purpose of this study is to investigate the applicability of transfer learning (TL) technique and model inputs for different deep learning (DL) model structures, which may provide a reference for researchers to design algorithms. Moreover, we also attempt to provide a novel and precise Transformer-based algorithm. Methods: Two classical feature engineering methods and the proposed method which consists of various EEG rhythms are explored, then a hybrid Transformer model is designed to evaluate the advantages over pure convolutional neural networks (CNN)-based models. Finally, the performances of two model structures are analyzed utilizing patient-independent approach and two TL strategies. Results: We tested our method on the CHB-MIT scalp EEG database, the results showed that our feature engineering method gains a significant improvement in model performance and is more suitable for Transformer-based model. In addition, the performance improvement of Transformer-based model utilizing fine-tuning strategies is more robust than that of pure CNN-based model, and our model achieved an optimal sensitivity of 91.7% with false positive rate (FPR) of 0.00/h. Conclusion: Our epilepsy prediction method achieves excellent performance and demonstrates its advantage over pure CNN-based structure in TL. Moreover, we find that the information contained in the gamma (<inline-formula> <tex-math notation="LaTeX">$\gamma$ </tex-math></inline-formula>) rhythm is helpful for epilepsy prediction. Significance: We propose a precise hybrid Transformer model for epilepsy prediction. The applicability of TL and model inputs is also explored for customizing personalized models in clinical application scenarios.https://ieeexplore.ieee.org/document/10046136/Epilepsy predictionfeature engineeringscalp electroencephalogram (sEEG)hybrid transformertransfer learning (TL) |
| spellingShingle | Shuaicong Hu Jian Liu Rui Yang Ya'Nan Wang Aiguo Wang Kuanzheng Li Wenxin Liu Cuiwei Yang Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model IEEE Transactions on Neural Systems and Rehabilitation Engineering Epilepsy prediction feature engineering scalp electroencephalogram (sEEG) hybrid transformer transfer learning (TL) |
| title | Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model |
| title_full | Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model |
| title_fullStr | Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model |
| title_full_unstemmed | Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model |
| title_short | Exploring the Applicability of Transfer Learning and Feature Engineering in Epilepsy Prediction Using Hybrid Transformer Model |
| title_sort | exploring the applicability of transfer learning and feature engineering in epilepsy prediction using hybrid transformer model |
| topic | Epilepsy prediction feature engineering scalp electroencephalogram (sEEG) hybrid transformer transfer learning (TL) |
| url | https://ieeexplore.ieee.org/document/10046136/ |
| work_keys_str_mv | AT shuaiconghu exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT jianliu exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT ruiyang exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT yananwang exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT aiguowang exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT kuanzhengli exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT wenxinliu exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel AT cuiweiyang exploringtheapplicabilityoftransferlearningandfeatureengineeringinepilepsypredictionusinghybridtransformermodel |