What Makes a Photograph Memorable?

When glancing at a magazine, or browsing the Internet, we are continuously exposed to photographs. Despite this overflow of visual information, humans are extremely good at remembering thousands of pictures along with some of their visual details. But not all images are equal in memory. Some stick i...

Full description

Bibliographic Details
Main Authors: Isola, Phillip John, Xiao, Jianxiong, Parikh, Devi, Torralba, Antonio, Oliva, Aude
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2014
Online Access:http://hdl.handle.net/1721.1/90984
https://orcid.org/0000-0002-1411-6704
https://orcid.org/0000-0003-4915-0256
_version_ 1826188529334484992
author Isola, Phillip John
Xiao, Jianxiong
Parikh, Devi
Torralba, Antonio
Oliva, Aude
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Isola, Phillip John
Xiao, Jianxiong
Parikh, Devi
Torralba, Antonio
Oliva, Aude
author_sort Isola, Phillip John
collection MIT
description When glancing at a magazine, or browsing the Internet, we are continuously exposed to photographs. Despite this overflow of visual information, humans are extremely good at remembering thousands of pictures along with some of their visual details. But not all images are equal in memory. Some stick in our minds while others are quickly forgotten. In this paper, we focus on the problem of predicting how memorable an image will be. We show that memorability is an intrinsic and stable property of an image that is shared across different viewers, and remains stable across delays. We introduce a database for which we have measured the probability that each picture will be recognized after a single view. We analyze a collection of image features, labels, and attributes that contribute to making an image memorable, and we train a predictor based on global image descriptors. We find that predicting image memorability is a task that can be addressed with current computer vision techniques. While making memorable images is a challenging task in visualization, photography, and education, this work is a first attempt to quantify this useful property of images.
first_indexed 2024-09-23T08:01:03Z
format Article
id mit-1721.1/90984
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T08:01:03Z
publishDate 2014
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/909842022-09-23T10:18:34Z What Makes a Photograph Memorable? Isola, Phillip John Xiao, Jianxiong Parikh, Devi Torralba, Antonio Oliva, Aude Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Isola, Phillip John Xiao, Jianxiong Torralba, Antonio Oliva, Aude When glancing at a magazine, or browsing the Internet, we are continuously exposed to photographs. Despite this overflow of visual information, humans are extremely good at remembering thousands of pictures along with some of their visual details. But not all images are equal in memory. Some stick in our minds while others are quickly forgotten. In this paper, we focus on the problem of predicting how memorable an image will be. We show that memorability is an intrinsic and stable property of an image that is shared across different viewers, and remains stable across delays. We introduce a database for which we have measured the probability that each picture will be recognized after a single view. We analyze a collection of image features, labels, and attributes that contribute to making an image memorable, and we train a predictor based on global image descriptors. We find that predicting image memorability is a task that can be addressed with current computer vision techniques. While making memorable images is a challenging task in visualization, photography, and education, this work is a first attempt to quantify this useful property of images. National Science Foundation (U.S.) (Grant 1016862) National Science Foundation (U.S.) (CAREER Award 0747120) United States. Intelligence Advanced Research Projects Activity (Department of the Interior Contract D10PC20023) United States. Office of Naval Research. Multidisciplinary University Research Initiative (N000141010933) Google (Firm) Xerox (Firm) National Science Foundation (U.S.). Graduate Research Fellowship 2014-10-20T14:29:09Z 2014-10-20T14:29:09Z 2014-06 2013-05 Article http://purl.org/eprint/type/JournalArticle 0162-8828 2160-9292 http://hdl.handle.net/1721.1/90984 Isola, Phillip, Jianxiong Xiao, Devi Parikh, Antonio Torralba, and Aude Oliva. “What Makes a Photograph Memorable?” IEEE Trans. Pattern Anal. Mach. Intell. 36, no. 7 (July 2014): 1469–1482. https://orcid.org/0000-0002-1411-6704 https://orcid.org/0000-0003-4915-0256 en_US http://dx.doi.org/10.1109/TPAMI.2013.200 IEEE Transactions on Pattern Analysis and Machine Intelligence Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) MIT web domain
spellingShingle Isola, Phillip John
Xiao, Jianxiong
Parikh, Devi
Torralba, Antonio
Oliva, Aude
What Makes a Photograph Memorable?
title What Makes a Photograph Memorable?
title_full What Makes a Photograph Memorable?
title_fullStr What Makes a Photograph Memorable?
title_full_unstemmed What Makes a Photograph Memorable?
title_short What Makes a Photograph Memorable?
title_sort what makes a photograph memorable
url http://hdl.handle.net/1721.1/90984
https://orcid.org/0000-0002-1411-6704
https://orcid.org/0000-0003-4915-0256
work_keys_str_mv AT isolaphillipjohn whatmakesaphotographmemorable
AT xiaojianxiong whatmakesaphotographmemorable
AT parikhdevi whatmakesaphotographmemorable
AT torralbaantonio whatmakesaphotographmemorable
AT olivaaude whatmakesaphotographmemorable