Visualizing subjective decision criteria for system evaluation
Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2010.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2011
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/61156 |
| _version_ | 1826216533929492480 |
|---|---|
| author | Coley, Jodyann Felicia |
| author2 | Mary L. Cummings. |
| author_facet | Mary L. Cummings. Coley, Jodyann Felicia |
| author_sort | Coley, Jodyann Felicia |
| collection | MIT |
| description | Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2010. |
| first_indexed | 2024-09-23T16:48:53Z |
| format | Thesis |
| id | mit-1721.1/61156 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T16:48:53Z |
| publishDate | 2011 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/611562019-04-10T17:59:56Z Visualizing subjective decision criteria for system evaluation Coley, Jodyann Felicia Mary L. Cummings. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (M. Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2010. Cataloged from PDF version of thesis. Includes bibliographical references (p. 105-109). The tools and methods used to evaluate complex systems in terms of human systems integration (HSI) include software, hardware, models, simulations, processes, and techniques. Hundreds of such tools currently exist to evaluate complex HSI systems, and the number is continuously growing. Many HSI tools are developed in research settings, or in an ad-hoc fashion to meet specific project goals. As such, there is no standard repository of HSI tools. Additionally, as HSI systems become more complex and the number of HSI dimensions in which decision-makers evaluate systems continues to grow, the HSI cost-benefit trade space that explores the costs and benefits of a system on the HSI dimensions expands. Therefore, it becomes more difficult for decision-makers to determine if and to what degree a system meets their specific HSI criteria. Engineers, managers, and other decision-makers often have to evaluate complex HSI systems, such as the case of acquisitions in which decision-makers need to rate and compare particular systems. Since there are hundreds of tools that currently exist to evaluate the HSI aspects of systems, decision-makers may not be familiar with all of them. Additionally, with the HSI cost-benefit trade space continually expanding, decision-makers need a way to reduce the number of HSI tools, or downs elect, from the hundreds of HSI tools to a smaller set of desirable tools. This smaller set of desirable tools is defined by users' criteria, which is often vague and ambiguous. This research investigates the visualization techniques of such downselection tools and how the visual representation of information impacts the decisions of decision-makers. The results of this work show that salient information biases decision-makers' decisions when using decision support tools (DSTs). Also, information aggregation did not appear to have an effect on decision-makers' level of automation bias when using decision support tools. There did not appear to be any correlation between decision-makers' trust in DSTs and the extent to which they rely on the results presented in those tools. Additionally, decision-makers' perception of the ease of use of DSTs is correlated with their trust in those tools, although there appeared to be an influence of age on users' perceptions of such tools. While this thesis focuses on the specific example of downselecting a database of HSI tools for a decision maker, the overall processes and research in this effort can generally be applied to any downselection from a large database of elements to a smaller set of desirable elements using both objective and subjective decision criteria of decision-makers. by Jodyann Felicia Coley. M.Eng. 2011-02-23T14:21:38Z 2011-02-23T14:21:38Z 2010 2010 Thesis http://hdl.handle.net/1721.1/61156 698212422 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 109 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Coley, Jodyann Felicia Visualizing subjective decision criteria for system evaluation |
| title | Visualizing subjective decision criteria for system evaluation |
| title_full | Visualizing subjective decision criteria for system evaluation |
| title_fullStr | Visualizing subjective decision criteria for system evaluation |
| title_full_unstemmed | Visualizing subjective decision criteria for system evaluation |
| title_short | Visualizing subjective decision criteria for system evaluation |
| title_sort | visualizing subjective decision criteria for system evaluation |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/61156 |
| work_keys_str_mv | AT coleyjodyannfelicia visualizingsubjectivedecisioncriteriaforsystemevaluation |