Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments

The recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to ach...

Full description

Bibliographic Details
Main Authors: Jun Dong Cho, Jaeho Jeong, Ji Hye Kim, Hoonsuk Lee
Format: Article
Language:English
Published: MDPI AG 2020-11-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/9/11/1981
_version_ 1797547106550939648
author Jun Dong Cho
Jaeho Jeong
Ji Hye Kim
Hoonsuk Lee
author_facet Jun Dong Cho
Jaeho Jeong
Ji Hye Kim
Hoonsuk Lee
author_sort Jun Dong Cho
collection DOAJ
description The recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to achieve with just a tactile stimulus. Sound coding colors (SCCs) can replicate three characteristics of colors, i.e., hue, chroma, and value, by matching them with three characteristics of sound, i.e., timbre, intensity, and pitch. This paper examines relationships between sound (melody) and color mediated by tactile pattern color coding and provides sound coding for hue, chroma, and value to help PVI deepen their relationship with visual art. Our two proposed SCC sets use melody to improve upon most SCC sets currently in use by adding more colors (18 colors in 6 hues). User experience and identification tests were conducted with 12 visually impaired and 8 sighted adults, and the results suggest that the SCC sets were helpful for the participants.
first_indexed 2024-03-10T14:39:32Z
format Article
id doaj.art-fea70f7aa6df4ea885128691f6168711
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-10T14:39:32Z
publishDate 2020-11-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-fea70f7aa6df4ea885128691f61687112023-11-20T21:58:43ZengMDPI AGElectronics2079-92922020-11-01911198110.3390/electronics9111981Sound Coding Color to Improve Artwork Appreciation by People with Visual ImpairmentsJun Dong Cho0Jaeho Jeong1Ji Hye Kim2Hoonsuk Lee3Department of Human Information and Cognition Technology Convergence, SungkyunKwan University, Suwon, Gyeonggi-do 16419, KoreaSound Plan, Seoul 06974, KoreaGangbuk Braille Library, Seoul 06974, KoreaCenter for Human Information and Cognition Technology Convergence, SungkyunKwan University, Suwon, Gyeonggi-do 16419, KoreaThe recent development of color coding in tactile pictograms helps people with visual impairments (PVI) appreciate the visual arts. The auditory sense, in conjunction with (or possibly as an alternative to) the tactile sense, would allow PVI to perceive colors in a way that would be difficult to achieve with just a tactile stimulus. Sound coding colors (SCCs) can replicate three characteristics of colors, i.e., hue, chroma, and value, by matching them with three characteristics of sound, i.e., timbre, intensity, and pitch. This paper examines relationships between sound (melody) and color mediated by tactile pattern color coding and provides sound coding for hue, chroma, and value to help PVI deepen their relationship with visual art. Our two proposed SCC sets use melody to improve upon most SCC sets currently in use by adding more colors (18 colors in 6 hues). User experience and identification tests were conducted with 12 visually impaired and 8 sighted adults, and the results suggest that the SCC sets were helpful for the participants.https://www.mdpi.com/2079-9292/9/11/1981user experiencevisually impairedcolor sound codingaccessibilityart appreciation
spellingShingle Jun Dong Cho
Jaeho Jeong
Ji Hye Kim
Hoonsuk Lee
Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
Electronics
user experience
visually impaired
color sound coding
accessibility
art appreciation
title Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
title_full Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
title_fullStr Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
title_full_unstemmed Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
title_short Sound Coding Color to Improve Artwork Appreciation by People with Visual Impairments
title_sort sound coding color to improve artwork appreciation by people with visual impairments
topic user experience
visually impaired
color sound coding
accessibility
art appreciation
url https://www.mdpi.com/2079-9292/9/11/1981
work_keys_str_mv AT jundongcho soundcodingcolortoimproveartworkappreciationbypeoplewithvisualimpairments
AT jaehojeong soundcodingcolortoimproveartworkappreciationbypeoplewithvisualimpairments
AT jihyekim soundcodingcolortoimproveartworkappreciationbypeoplewithvisualimpairments
AT hoonsuklee soundcodingcolortoimproveartworkappreciationbypeoplewithvisualimpairments