Deep learning regularization techniques to genomics data
Deep Learning algorithms have achieved a great success in many domains where large scale datasets are used. However, training these algorithms on high dimensional data requires the adjustment of many parameters. Avoiding overfitting problem is difficult. Regularization techniques such as L1 and L2 a...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2021-09-01
|
| Series: | Array |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2590005621000163 |
| _version_ | 1819294001451237376 |
|---|---|
| author | Harouna Soumare Alia Benkahla Nabil Gmati |
| author_facet | Harouna Soumare Alia Benkahla Nabil Gmati |
| author_sort | Harouna Soumare |
| collection | DOAJ |
| description | Deep Learning algorithms have achieved a great success in many domains where large scale datasets are used. However, training these algorithms on high dimensional data requires the adjustment of many parameters. Avoiding overfitting problem is difficult. Regularization techniques such as L1 and L2 are used to prevent the parameters of training model from being large. Another commonly used regularization method called Dropout randomly removes some hidden units during the training phase. In this work, we describe some architectures of Deep Learning algorithms, we explain optimization process for training them and attempt to establish a theoretical relationship between L2-regularization and Dropout. We experimentally compare the effect of these techniques on the learning model using genomics datasets. |
| first_indexed | 2024-12-24T04:19:23Z |
| format | Article |
| id | doaj.art-45ec03f579dc48569c5d8c5bef0b6251 |
| institution | Directory Open Access Journal |
| issn | 2590-0056 |
| language | English |
| last_indexed | 2024-12-24T04:19:23Z |
| publishDate | 2021-09-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Array |
| spelling | doaj.art-45ec03f579dc48569c5d8c5bef0b62512022-12-21T17:15:50ZengElsevierArray2590-00562021-09-0111100068Deep learning regularization techniques to genomics dataHarouna Soumare0Alia Benkahla1Nabil Gmati2The Laboratory of Mathematical Modelling and Numeric in Engineering Sciences, National Engineering School of Tunis, University of Tunis El Manar, Rue Béchir Salem Belkhiria Campus Universitaire, B.P. 37, 1002, Tunis Belvédère, Tunisia; Laboratory of BioInformatics, BioMathematics, and BioStatistics, Institut Pasteur de Tunis, 13 Place Pasteur, B.P. 74 1002, Tunis, Belvédère, Tunisia; Corresponding author. The Laboratory of Mathematical Modelling and Numeric in Engineering Sciences, National Engineering School of Tunis, University of Tunis El Manar, Rue Béchir Salem Belkhiria Campus Universitaire, B.P. 37, 1002, Tunis Belvédère, Tunisia.Laboratory of BioInformatics, BioMathematics, and BioStatistics, Institut Pasteur de Tunis, 13 Place Pasteur, B.P. 74 1002, Tunis, Belvédère, TunisiaCollege of Sciences & Basic and Applied Scientific Research Center, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, 31441, Dammam, Saudi ArabiaDeep Learning algorithms have achieved a great success in many domains where large scale datasets are used. However, training these algorithms on high dimensional data requires the adjustment of many parameters. Avoiding overfitting problem is difficult. Regularization techniques such as L1 and L2 are used to prevent the parameters of training model from being large. Another commonly used regularization method called Dropout randomly removes some hidden units during the training phase. In this work, we describe some architectures of Deep Learning algorithms, we explain optimization process for training them and attempt to establish a theoretical relationship between L2-regularization and Dropout. We experimentally compare the effect of these techniques on the learning model using genomics datasets.http://www.sciencedirect.com/science/article/pii/S2590005621000163Deep learningOverfittingRegularization techniquesDropoutGenomics |
| spellingShingle | Harouna Soumare Alia Benkahla Nabil Gmati Deep learning regularization techniques to genomics data Array Deep learning Overfitting Regularization techniques Dropout Genomics |
| title | Deep learning regularization techniques to genomics data |
| title_full | Deep learning regularization techniques to genomics data |
| title_fullStr | Deep learning regularization techniques to genomics data |
| title_full_unstemmed | Deep learning regularization techniques to genomics data |
| title_short | Deep learning regularization techniques to genomics data |
| title_sort | deep learning regularization techniques to genomics data |
| topic | Deep learning Overfitting Regularization techniques Dropout Genomics |
| url | http://www.sciencedirect.com/science/article/pii/S2590005621000163 |
| work_keys_str_mv | AT harounasoumare deeplearningregularizationtechniquestogenomicsdata AT aliabenkahla deeplearningregularizationtechniquestogenomicsdata AT nabilgmati deeplearningregularizationtechniquestogenomicsdata |