Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms
In this paper, we propose element-wise adaptive threshold methods for learned iterative shrinkage thresholding algorithms. The threshold for each element is adapted in such a way that it is set to be smaller when the previously recovered estimate or the current one-step gradient descent at that elem...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2020-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9023989/ |
| _version_ | 1818616871581122560 |
|---|---|
| author | Dohyun Kim Daeyoung Park |
| author_facet | Dohyun Kim Daeyoung Park |
| author_sort | Dohyun Kim |
| collection | DOAJ |
| description | In this paper, we propose element-wise adaptive threshold methods for learned iterative shrinkage thresholding algorithms. The threshold for each element is adapted in such a way that it is set to be smaller when the previously recovered estimate or the current one-step gradient descent at that element has a larger value. This adaptive threshold gives a lower misdetection probability of the true support, which speedups the convergence to the optimal solution. We show that the proposed element-wise threshold adaption method has better convergence rate than the existing non-adaptive threshold methods. Numerical results show that the proposed neural network has the best recovery performance among the tested algorithms. In addition, it is robust to the sparsity mismatch, which is very desirable in the case of unknown signal sparsity. |
| first_indexed | 2024-12-16T16:56:41Z |
| format | Article |
| id | doaj.art-0357b6901257418dbecb3c0922afbccd |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-16T16:56:41Z |
| publishDate | 2020-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-0357b6901257418dbecb3c0922afbccd2022-12-21T22:23:51ZengIEEEIEEE Access2169-35362020-01-018458744588610.1109/ACCESS.2020.29782379023989Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding AlgorithmsDohyun Kim0Daeyoung Park1https://orcid.org/0000-0001-8573-3526Department of Information and Communication Engineering, Inha University, Incheon, South KoreaDepartment of Information and Communication Engineering, Inha University, Incheon, South KoreaIn this paper, we propose element-wise adaptive threshold methods for learned iterative shrinkage thresholding algorithms. The threshold for each element is adapted in such a way that it is set to be smaller when the previously recovered estimate or the current one-step gradient descent at that element has a larger value. This adaptive threshold gives a lower misdetection probability of the true support, which speedups the convergence to the optimal solution. We show that the proposed element-wise threshold adaption method has better convergence rate than the existing non-adaptive threshold methods. Numerical results show that the proposed neural network has the best recovery performance among the tested algorithms. In addition, it is robust to the sparsity mismatch, which is very desirable in the case of unknown signal sparsity.https://ieeexplore.ieee.org/document/9023989/Compressive sensingdeep unfoldingiterative soft thresholding |
| spellingShingle | Dohyun Kim Daeyoung Park Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms IEEE Access Compressive sensing deep unfolding iterative soft thresholding |
| title | Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms |
| title_full | Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms |
| title_fullStr | Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms |
| title_full_unstemmed | Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms |
| title_short | Element-Wise Adaptive Thresholds for Learned Iterative Shrinkage Thresholding Algorithms |
| title_sort | element wise adaptive thresholds for learned iterative shrinkage thresholding algorithms |
| topic | Compressive sensing deep unfolding iterative soft thresholding |
| url | https://ieeexplore.ieee.org/document/9023989/ |
| work_keys_str_mv | AT dohyunkim elementwiseadaptivethresholdsforlearnediterativeshrinkagethresholdingalgorithms AT daeyoungpark elementwiseadaptivethresholdsforlearnediterativeshrinkagethresholdingalgorithms |