Image Appeal Revisited: Analysis, New Dataset, and Prediction Models
There are more and more photographic images uploaded to social media platforms such as Instagram, Flickr, or Facebook on a daily basis. At the same time, attention and consumption for such images is high, with image views and liking as one of the success factors for users and driving forces for soci...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10173515/ |
| _version_ | 1797780104684765184 |
|---|---|
| author | Steve Goring Alexander Raake |
| author_facet | Steve Goring Alexander Raake |
| author_sort | Steve Goring |
| collection | DOAJ |
| description | There are more and more photographic images uploaded to social media platforms such as Instagram, Flickr, or Facebook on a daily basis. At the same time, attention and consumption for such images is high, with image views and liking as one of the success factors for users and driving forces for social media algorithms. Here, “liking” can be assumed to be driven by image appeal and further factors such as who is posting the images and what they may show and reveal about the posting person. It is therefore of high research interest to evaluate the appeal of such images in the context of social media platforms. Such an appeal evaluation may help to improve image quality or could be used as an additional filter criterion to select good images. To analyze image appeal, various datasets have been established over the past years. However, not all datasets contain high-resolution images, are up to date, or include additional data, such as meta-data or social-media-type data such as likes and views. We created our own dataset “AVT-ImageAppeal-Dataset”, which includes images from different photo-sharing platforms. The dataset also includes a subset of other state-of-the-art datasets and is extended by social-media-type data, meta-data, and additional images. In this paper, we describe the dataset and a series of laboratory- and crowd-tests we conducted to evaluate image appeal. These tests indicate that there is only a small influence when likes and views are included in the presentation of the images in comparison to when these are not shown, and also the appeal ratings are only a little correlated to likes and views. Furthermore, it is shown that lab and crowd tests are highly similar considering the collected appeal ratings. In addition to the dataset, we also describe various machine learning models for the prediction of image appeal, using only the photo itself as input. The models have a similar or slightly better performance than state-of-the-art models. The evaluation indicates that there is still an improvement in image appeal prediction and furthermore, other aspects, such as the presentation context could be evaluated. |
| first_indexed | 2024-03-12T23:39:45Z |
| format | Article |
| id | doaj.art-79e272b79390456082e3f625c0f973ec |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T23:39:45Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-79e272b79390456082e3f625c0f973ec2023-07-14T23:00:27ZengIEEEIEEE Access2169-35362023-01-0111695636958510.1109/ACCESS.2023.329258810173515Image Appeal Revisited: Analysis, New Dataset, and Prediction ModelsSteve Goring0https://orcid.org/0000-0001-6810-6969Alexander Raake1https://orcid.org/0000-0002-9357-1763Audiovisual Technology Group, Technische Universität Ilmenau, Ilmenau, GermanyAudiovisual Technology Group, Technische Universität Ilmenau, Ilmenau, GermanyThere are more and more photographic images uploaded to social media platforms such as Instagram, Flickr, or Facebook on a daily basis. At the same time, attention and consumption for such images is high, with image views and liking as one of the success factors for users and driving forces for social media algorithms. Here, “liking” can be assumed to be driven by image appeal and further factors such as who is posting the images and what they may show and reveal about the posting person. It is therefore of high research interest to evaluate the appeal of such images in the context of social media platforms. Such an appeal evaluation may help to improve image quality or could be used as an additional filter criterion to select good images. To analyze image appeal, various datasets have been established over the past years. However, not all datasets contain high-resolution images, are up to date, or include additional data, such as meta-data or social-media-type data such as likes and views. We created our own dataset “AVT-ImageAppeal-Dataset”, which includes images from different photo-sharing platforms. The dataset also includes a subset of other state-of-the-art datasets and is extended by social-media-type data, meta-data, and additional images. In this paper, we describe the dataset and a series of laboratory- and crowd-tests we conducted to evaluate image appeal. These tests indicate that there is only a small influence when likes and views are included in the presentation of the images in comparison to when these are not shown, and also the appeal ratings are only a little correlated to likes and views. Furthermore, it is shown that lab and crowd tests are highly similar considering the collected appeal ratings. In addition to the dataset, we also describe various machine learning models for the prediction of image appeal, using only the photo itself as input. The models have a similar or slightly better performance than state-of-the-art models. The evaluation indicates that there is still an improvement in image appeal prediction and furthermore, other aspects, such as the presentation context could be evaluated.https://ieeexplore.ieee.org/document/10173515/Image appealimage aestheticimage popularitymachine learningimage dataset |
| spellingShingle | Steve Goring Alexander Raake Image Appeal Revisited: Analysis, New Dataset, and Prediction Models IEEE Access Image appeal image aesthetic image popularity machine learning image dataset |
| title | Image Appeal Revisited: Analysis, New Dataset, and Prediction Models |
| title_full | Image Appeal Revisited: Analysis, New Dataset, and Prediction Models |
| title_fullStr | Image Appeal Revisited: Analysis, New Dataset, and Prediction Models |
| title_full_unstemmed | Image Appeal Revisited: Analysis, New Dataset, and Prediction Models |
| title_short | Image Appeal Revisited: Analysis, New Dataset, and Prediction Models |
| title_sort | image appeal revisited analysis new dataset and prediction models |
| topic | Image appeal image aesthetic image popularity machine learning image dataset |
| url | https://ieeexplore.ieee.org/document/10173515/ |
| work_keys_str_mv | AT stevegoring imageappealrevisitedanalysisnewdatasetandpredictionmodels AT alexanderraake imageappealrevisitedanalysisnewdatasetandpredictionmodels |