BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses
Deep neural network (DNN)-based research on image scaling has mostly focused on super-resolution (SR) rather than image downscaling. Specifically, most existing DNN-based methods for image downscaling are used as auxiliary modules to improve the quality of super-resolved images. In rare cases, DNN-b...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9780200/ |
| _version_ | 1811336983164747776 |
|---|---|
| author | Eun Su Kang Jung Eun Kwon Hae Ju Park Moon Ju Chae Sung In Cho |
| author_facet | Eun Su Kang Jung Eun Kwon Hae Ju Park Moon Ju Chae Sung In Cho |
| author_sort | Eun Su Kang |
| collection | DOAJ |
| description | Deep neural network (DNN)-based research on image scaling has mostly focused on super-resolution (SR) rather than image downscaling. Specifically, most existing DNN-based methods for image downscaling are used as auxiliary modules to improve the quality of super-resolved images. In rare cases, DNN-based methods consider the image downscaling as an important task as SR to increase the quality of downscaled images. In these methods, when setting the loss function for the training of the downscaling, the downscaled images generated by bicubic or bilinear interpolation are used as the ground-truth. As a result, the downscaled image by these methods cannot significantly differ from that by simple interpolation. In addition, these DNN-based methods with SR and downscaling modules have an imbalanced training architecture, which leads to biased training. To resolve these problems, we propose a novel DNN that includes a balanced dual image scaler (BDIS) for SR and downscaling. The main contribution of the proposed BDIS is the proposal of an origin referenceable loss (ORL) for downscaling and the balanced training architecture. The proposed ORL is designed to observe the difference between the original and the downscaled images so that the downscaling module directly exploits the information of the original image for its training. However, this ORL can lead to the training imbalance where the downscaling module is relatively overtrained. Therefore, we construct the balanced training architecture by adding the symmetric ORL for SR. The simulation results showed that the proposed BDIS greatly improves the quality of the downscaled images while providing the comparable quality of the super-resolved images compared with the benchmark methods. |
| first_indexed | 2024-04-13T17:47:27Z |
| format | Article |
| id | doaj.art-ee56f82afcac434a81fb2e62eedebcec |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-13T17:47:27Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ee56f82afcac434a81fb2e62eedebcec2022-12-22T02:36:53ZengIEEEIEEE Access2169-35362022-01-0110564695648110.1109/ACCESS.2022.31771989780200BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable LossesEun Su Kang0Jung Eun Kwon1Hae Ju Park2Moon Ju Chae3Sung In Cho4https://orcid.org/0000-0003-4251-7131Department of Multimedia Engineering, Dongguk University, Seoul, South KoreaDepartment of Multimedia Engineering, Dongguk University, Seoul, South KoreaDepartment of Multimedia Engineering, Dongguk University, Seoul, South KoreaDepartment of Multimedia Engineering, Dongguk University, Seoul, South KoreaDepartment of Multimedia Engineering, Dongguk University, Seoul, South KoreaDeep neural network (DNN)-based research on image scaling has mostly focused on super-resolution (SR) rather than image downscaling. Specifically, most existing DNN-based methods for image downscaling are used as auxiliary modules to improve the quality of super-resolved images. In rare cases, DNN-based methods consider the image downscaling as an important task as SR to increase the quality of downscaled images. In these methods, when setting the loss function for the training of the downscaling, the downscaled images generated by bicubic or bilinear interpolation are used as the ground-truth. As a result, the downscaled image by these methods cannot significantly differ from that by simple interpolation. In addition, these DNN-based methods with SR and downscaling modules have an imbalanced training architecture, which leads to biased training. To resolve these problems, we propose a novel DNN that includes a balanced dual image scaler (BDIS) for SR and downscaling. The main contribution of the proposed BDIS is the proposal of an origin referenceable loss (ORL) for downscaling and the balanced training architecture. The proposed ORL is designed to observe the difference between the original and the downscaled images so that the downscaling module directly exploits the information of the original image for its training. However, this ORL can lead to the training imbalance where the downscaling module is relatively overtrained. Therefore, we construct the balanced training architecture by adding the symmetric ORL for SR. The simulation results showed that the proposed BDIS greatly improves the quality of the downscaled images while providing the comparable quality of the super-resolved images compared with the benchmark methods.https://ieeexplore.ieee.org/document/9780200/Balanced architecturedeep neural networkimage downscalingimage upscalingimage super-resolutiondual scaler |
| spellingShingle | Eun Su Kang Jung Eun Kwon Hae Ju Park Moon Ju Chae Sung In Cho BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses IEEE Access Balanced architecture deep neural network image downscaling image upscaling image super-resolution dual scaler |
| title | BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses |
| title_full | BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses |
| title_fullStr | BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses |
| title_full_unstemmed | BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses |
| title_short | BDIS: Balanced Training Architecture for Dual Image Scaler Using Origin Referenceable Losses |
| title_sort | bdis balanced training architecture for dual image scaler using origin referenceable losses |
| topic | Balanced architecture deep neural network image downscaling image upscaling image super-resolution dual scaler |
| url | https://ieeexplore.ieee.org/document/9780200/ |
| work_keys_str_mv | AT eunsukang bdisbalancedtrainingarchitecturefordualimagescalerusingoriginreferenceablelosses AT jungeunkwon bdisbalancedtrainingarchitecturefordualimagescalerusingoriginreferenceablelosses AT haejupark bdisbalancedtrainingarchitecturefordualimagescalerusingoriginreferenceablelosses AT moonjuchae bdisbalancedtrainingarchitecturefordualimagescalerusingoriginreferenceablelosses AT sungincho bdisbalancedtrainingarchitecturefordualimagescalerusingoriginreferenceablelosses |