A New Framework for Evaluating Image Quality Including Deep Learning Task Performances as a Proxy

<sc>iquaflow</sc> is a framework that provides a set of tools to assess image quality. The user can add custom metrics that can be easily integrated and a set of unsupervised methods is offered by default. Furthermore, <sc>iquaflow</sc> measures quality by using the performan...

Full description

Bibliographic Details
Main Authors: Pau Galles, Katalin Takats, Miguel Hernandez-Cabronero, David Berga, Luciano Pega, Laura Riordan-Chen, Clara Garcia, Guillermo Becker, Adan Garriga, Anica Bukva, Joan Serra-Sagrista, David Vilaseca, Javier Marin
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10356628/
Description
Summary:<sc>iquaflow</sc> is a framework that provides a set of tools to assess image quality. The user can add custom metrics that can be easily integrated and a set of unsupervised methods is offered by default. Furthermore, <sc>iquaflow</sc> measures quality by using the performance of AI models trained on the images as a proxy. This also helps to easily make studies of performance degradation of several modifications of the original dataset, for instance, with images reconstructed after different levels of lossy compression; satellite images would be a use case example, since they are commonly compressed before downloading to the ground. In this situation, the optimization problem involves finding images that, while being compressed to their smallest possible file size, still maintain sufficient quality to meet the required performance of the deep learning algorithms. Thus, a study with <sc>iquaflow</sc> is suitable for such case. All this development is wrapped in <sc>Mlflow</sc>: an interactive tool used to visualize and summarize the results. This document describes different use cases and provides links to their respective repositories. To ease the creation of new studies, we include a cookiecutter repository. The source code, issue tracker and aforementioned repositories are all hosted on GitHub.
ISSN:2151-1535