Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting

We assess the benefit of including an image inpainting filter before passing damaged images into a classification neural network. We employ an appropriately modified Cahn–Hilliard equation as an image inpainting filter which is solved numerically with a finite-volume scheme exhibiting reduced comput...

Descrizione completa

Dettagli Bibliografici
Autori principali: Carrillo, JA, Kalliadasis, S, Liang, F, Perez, SP
Natura: Journal article
Lingua:English
Pubblicazione: Royal Society 2021
_version_ 1826257743661498368
author Carrillo, JA
Kalliadasis, S
Liang, F
Perez, SP
author_facet Carrillo, JA
Kalliadasis, S
Liang, F
Perez, SP
author_sort Carrillo, JA
collection OXFORD
description We assess the benefit of including an image inpainting filter before passing damaged images into a classification neural network. We employ an appropriately modified Cahn–Hilliard equation as an image inpainting filter which is solved numerically with a finite-volume scheme exhibiting reduced computational cost and the properties of energy stability and boundedness. The benchmark dataset employed is Modified National Institute of Standards and Technology (MNIST) dataset, which consists of binary images of handwritten digits and is a standard dataset to validate image-processing methodologies. We train a neural network based on dense layers with MNIST, and subsequently we contaminate the test set with damages of different types and intensities. We then compare the prediction accuracy of the neural network with and without applying the Cahn–Hilliard filter to the damaged images test. Our results quantify the significant improvement of damaged-image prediction by applying the Cahn–Hilliard filter, which for specific damages can increase up to 50% and is advantageous for low to moderate damage.
first_indexed 2024-03-06T18:23:00Z
format Journal article
id oxford-uuid:06f30f87-62f7-4dc3-b51c-a67ab7a90913
institution University of Oxford
language English
last_indexed 2024-03-06T18:23:00Z
publishDate 2021
publisher Royal Society
record_format dspace
spelling oxford-uuid:06f30f87-62f7-4dc3-b51c-a67ab7a909132022-03-26T09:05:05ZEnhancement of damaged-image prediction through Cahn–Hilliard image inpaintingJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:06f30f87-62f7-4dc3-b51c-a67ab7a90913EnglishSymplectic ElementsRoyal Society2021Carrillo, JAKalliadasis, SLiang, FPerez, SPWe assess the benefit of including an image inpainting filter before passing damaged images into a classification neural network. We employ an appropriately modified Cahn–Hilliard equation as an image inpainting filter which is solved numerically with a finite-volume scheme exhibiting reduced computational cost and the properties of energy stability and boundedness. The benchmark dataset employed is Modified National Institute of Standards and Technology (MNIST) dataset, which consists of binary images of handwritten digits and is a standard dataset to validate image-processing methodologies. We train a neural network based on dense layers with MNIST, and subsequently we contaminate the test set with damages of different types and intensities. We then compare the prediction accuracy of the neural network with and without applying the Cahn–Hilliard filter to the damaged images test. Our results quantify the significant improvement of damaged-image prediction by applying the Cahn–Hilliard filter, which for specific damages can increase up to 50% and is advantageous for low to moderate damage.
spellingShingle Carrillo, JA
Kalliadasis, S
Liang, F
Perez, SP
Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title_full Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title_fullStr Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title_full_unstemmed Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title_short Enhancement of damaged-image prediction through Cahn–Hilliard image inpainting
title_sort enhancement of damaged image prediction through cahn hilliard image inpainting
work_keys_str_mv AT carrilloja enhancementofdamagedimagepredictionthroughcahnhilliardimageinpainting
AT kalliadasiss enhancementofdamagedimagepredictionthroughcahnhilliardimageinpainting
AT liangf enhancementofdamagedimagepredictionthroughcahnhilliardimageinpainting
AT perezsp enhancementofdamagedimagepredictionthroughcahnhilliardimageinpainting