Process-oriented evaluation of user interactions in integrated system analysis tools

When computer-based tools are used for analysis of complex systems, the design of user interactions and interfaces becomes an essential part of development that determines the overall quality. The objective of this study is to investigate the processes and results of user interactions with integrate...

Full description

Bibliographic Details
Main Authors: Lee, Chaiwoo, Grogan, Paul Thomas, de Weck, Olivier L.
Other Authors: Massachusetts Institute of Technology. Engineering Systems Division
Format: Article
Language:en_US
Published: Institute of Electrical and Electronics Engineers (IEEE) 2014
Online Access:http://hdl.handle.net/1721.1/84054
https://orcid.org/0000-0002-8835-4190
https://orcid.org/0000-0001-6677-383X
https://orcid.org/0000-0001-8986-4806
_version_ 1824457848866734080
author Lee, Chaiwoo
Grogan, Paul Thomas
de Weck, Olivier L.
author2 Massachusetts Institute of Technology. Engineering Systems Division
author_facet Massachusetts Institute of Technology. Engineering Systems Division
Lee, Chaiwoo
Grogan, Paul Thomas
de Weck, Olivier L.
author_sort Lee, Chaiwoo
collection MIT
description When computer-based tools are used for analysis of complex systems, the design of user interactions and interfaces becomes an essential part of development that determines the overall quality. The objective of this study is to investigate the processes and results of user interactions with integrated analysis tools to synthesize design implications for future tool development. In this study, two space exploration logistics tools are compared in a controlled user experiment. Through a comparative usability analysis, this study evaluated user performance and perception to provide design implications for future integrated analysis tools. For a comprehensive evaluation, multiple methods were used for data collection, including observation, questionnaire and interview. In addition to a result-oriented performance analysis, a process-oriented approach was used for analyzing patterns in user behaviors and errors. Results are presented with reference to the related features embedded in the interfaces of the two tools. Based on the comparative results, synthesized design insights for hierarchical structure, model transparency, automation, and visualization and feedback are discussed for integrated analysis tools in general.
first_indexed 2024-09-23T14:27:33Z
format Article
id mit-1721.1/84054
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T14:27:33Z
publishDate 2014
publisher Institute of Electrical and Electronics Engineers (IEEE)
record_format dspace
spelling mit-1721.1/840542022-10-01T21:23:58Z Process-oriented evaluation of user interactions in integrated system analysis tools Lee, Chaiwoo Grogan, Paul Thomas de Weck, Olivier L. Massachusetts Institute of Technology. Engineering Systems Division de Weck, Olivier Lee, Chaiwoo Grogan, Paul Thomas de Weck, Olivier L. When computer-based tools are used for analysis of complex systems, the design of user interactions and interfaces becomes an essential part of development that determines the overall quality. The objective of this study is to investigate the processes and results of user interactions with integrated analysis tools to synthesize design implications for future tool development. In this study, two space exploration logistics tools are compared in a controlled user experiment. Through a comparative usability analysis, this study evaluated user performance and perception to provide design implications for future integrated analysis tools. For a comprehensive evaluation, multiple methods were used for data collection, including observation, questionnaire and interview. In addition to a result-oriented performance analysis, a process-oriented approach was used for analyzing patterns in user behaviors and errors. Results are presented with reference to the related features embedded in the interfaces of the two tools. Based on the comparative results, synthesized design insights for hierarchical structure, model transparency, automation, and visualization and feedback are discussed for integrated analysis tools in general. American Society for Engineering Education. National Defense Science and Engineering Graduate Fellowship 2014-01-17T14:11:39Z 2014-01-17T14:11:39Z 2012-10 Article http://purl.org/eprint/type/ConferencePaper 978-1-4673-1714-6 978-1-4673-1713-9 978-1-4673-1712-2 http://hdl.handle.net/1721.1/84054 Lee, Chaiwoo, Paul T. Grogan, and Olivier L. de Weck. “Process-oriented evaluation of user interactions in integrated system analysis tools.” In 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 888-893. Institute of Electrical and Electronics Engineers, 2012. https://orcid.org/0000-0002-8835-4190 https://orcid.org/0000-0001-6677-383X https://orcid.org/0000-0001-8986-4806 en_US http://dx.doi.org/10.1109/ICSMC.2012.6377840 Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC) Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Institute of Electrical and Electronics Engineers (IEEE) Prof. de Weck via Angie Locknar
spellingShingle Lee, Chaiwoo
Grogan, Paul Thomas
de Weck, Olivier L.
Process-oriented evaluation of user interactions in integrated system analysis tools
title Process-oriented evaluation of user interactions in integrated system analysis tools
title_full Process-oriented evaluation of user interactions in integrated system analysis tools
title_fullStr Process-oriented evaluation of user interactions in integrated system analysis tools
title_full_unstemmed Process-oriented evaluation of user interactions in integrated system analysis tools
title_short Process-oriented evaluation of user interactions in integrated system analysis tools
title_sort process oriented evaluation of user interactions in integrated system analysis tools
url http://hdl.handle.net/1721.1/84054
https://orcid.org/0000-0002-8835-4190
https://orcid.org/0000-0001-6677-383X
https://orcid.org/0000-0001-8986-4806
work_keys_str_mv AT leechaiwoo processorientedevaluationofuserinteractionsinintegratedsystemanalysistools
AT groganpaulthomas processorientedevaluationofuserinteractionsinintegratedsystemanalysistools
AT deweckolivierl processorientedevaluationofuserinteractionsinintegratedsystemanalysistools