Designing and Evaluating User Experience of an AI-Based Defense System
In recent years, artificial intelligence (AI) has been applied in various fields, with rapid expansion of the scope of AI-human interactions. However, most AI technologies continue to exhibit black-box characteristics, i.e., their decisions and actions are not explainable, degrading user experience...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10304133/ |
| _version_ | 1827767724639518720 |
|---|---|
| author | Sunyoung Park Hyun K. Kim Jaehyun Park Yuryeon Lee |
| author_facet | Sunyoung Park Hyun K. Kim Jaehyun Park Yuryeon Lee |
| author_sort | Sunyoung Park |
| collection | DOAJ |
| description | In recent years, artificial intelligence (AI) has been applied in various fields, with rapid expansion of the scope of AI-human interactions. However, most AI technologies continue to exhibit black-box characteristics, i.e., their decisions and actions are not explainable, degrading user experience (UX). Recently, research on explainable AI (XAI), focusing on both AI performance and UX, has garnered significant attention. However, development of generalizable UX evaluation tools for AI and improvement of AI UX have not been investigated adequately. In this study, a UX evaluation tool is developed for AI based on a systematic literature review and verified using exploratory and confirmatory factor analyses. Subsequently, based on identified AI UX factors, UX of an AI defense system is upgraded. Based on user evaluation, there were significant improvements in eight factors (satisfaction, safety, controllability, trust, causality, efficiency, accountability, and explainability) with the exception of fairness. The proposed evaluation tool is expected to serve as a cornerstone for future evaluation of AI UX advancement. |
| first_indexed | 2024-03-11T12:02:59Z |
| format | Article |
| id | doaj.art-bcaed67b0d7649f98bba3ab3c5e42700 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-11T12:02:59Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-bcaed67b0d7649f98bba3ab3c5e427002023-11-08T00:01:17ZengIEEEIEEE Access2169-35362023-01-011112204512205610.1109/ACCESS.2023.332925710304133Designing and Evaluating User Experience of an AI-Based Defense SystemSunyoung Park0https://orcid.org/0000-0002-0615-5076Hyun K. Kim1https://orcid.org/0000-0002-5192-9405Jaehyun Park2https://orcid.org/0000-0002-5264-6941Yuryeon Lee3Department of Artificial Intelligence Convergence, Kwangwoon University, Seoul, South KoreaDepartment of Artificial Intelligence Convergence, Kwangwoon University, Seoul, South KoreaDepartment of Industrial and Management Engineering, Incheon National University, Incheon, South KoreaDepartment of Artificial Intelligence Convergence, Kwangwoon University, Seoul, South KoreaIn recent years, artificial intelligence (AI) has been applied in various fields, with rapid expansion of the scope of AI-human interactions. However, most AI technologies continue to exhibit black-box characteristics, i.e., their decisions and actions are not explainable, degrading user experience (UX). Recently, research on explainable AI (XAI), focusing on both AI performance and UX, has garnered significant attention. However, development of generalizable UX evaluation tools for AI and improvement of AI UX have not been investigated adequately. In this study, a UX evaluation tool is developed for AI based on a systematic literature review and verified using exploratory and confirmatory factor analyses. Subsequently, based on identified AI UX factors, UX of an AI defense system is upgraded. Based on user evaluation, there were significant improvements in eight factors (satisfaction, safety, controllability, trust, causality, efficiency, accountability, and explainability) with the exception of fairness. The proposed evaluation tool is expected to serve as a cornerstone for future evaluation of AI UX advancement.https://ieeexplore.ieee.org/document/10304133/Artificial intelligence (AI)AI system designAI UXAI UX measurementuser experience (UX) |
| spellingShingle | Sunyoung Park Hyun K. Kim Jaehyun Park Yuryeon Lee Designing and Evaluating User Experience of an AI-Based Defense System IEEE Access Artificial intelligence (AI) AI system design AI UX AI UX measurement user experience (UX) |
| title | Designing and Evaluating User Experience of an AI-Based Defense System |
| title_full | Designing and Evaluating User Experience of an AI-Based Defense System |
| title_fullStr | Designing and Evaluating User Experience of an AI-Based Defense System |
| title_full_unstemmed | Designing and Evaluating User Experience of an AI-Based Defense System |
| title_short | Designing and Evaluating User Experience of an AI-Based Defense System |
| title_sort | designing and evaluating user experience of an ai based defense system |
| topic | Artificial intelligence (AI) AI system design AI UX AI UX measurement user experience (UX) |
| url | https://ieeexplore.ieee.org/document/10304133/ |
| work_keys_str_mv | AT sunyoungpark designingandevaluatinguserexperienceofanaibaseddefensesystem AT hyunkkim designingandevaluatinguserexperienceofanaibaseddefensesystem AT jaehyunpark designingandevaluatinguserexperienceofanaibaseddefensesystem AT yuryeonlee designingandevaluatinguserexperienceofanaibaseddefensesystem |