Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition?
This paper explores the abilities of engineers to estimate everyday tasks and their reliance on their own intuition when performing cost estimates. The approach to answering these questions is similar to that of the popular television show MythBusters which aims to separate truth from urban legen...
| Main Author: | |
|---|---|
| Format: | Presentation |
| Published: |
2014
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/84456 |
| _version_ | 1811095246774206464 |
|---|---|
| author | Valerdi, Ricardo |
| author_facet | Valerdi, Ricardo |
| author_sort | Valerdi, Ricardo |
| collection | MIT |
| description | This paper explores the abilities of engineers to estimate everyday tasks and their reliance on
their own intuition when performing cost estimates. The approach to answering these questions
is similar to that of the popular television show MythBusters which aims to separate truth from
urban legend using controlled experiments. In MythBusters, methods for testing myths and
urban legends are usually planned and executed in a manner to produce the most visually
dramatic results possible, which generally involves explosions, fires, or vehicle crashes. While
the question of parametric models versus intuition is not as exciting, we provide an interesting
result that demonstrates the difference between what is real and what is fiction in the world of
cost estimation.
Two heuristics, representativeness and anchoring, are explored in two experiments involving
psychology students, engineering students, and engineering practitioners. The first experiment,
designed to determine if there is a difference in estimating ability in everyday quantities,
demonstrates that the three groups estimate with relatively equal accuracy. The results shed light
on the distribution of estimates and the process of subjective judgment. The second experiment,
designed to explore abilities for estimating the cost of software-intensive systems given
incomplete information, shows that predictions by engineering students and practitioners are
within 3-12% of each other. Results also show that engineers rely more on their intuition than on
parametric models to make decisions.
The value of this work is in helping better understand how software engineers make decisions
based on limited information. Implications for the development of software cost estimation
models are discussed in light of the findings from the two experiments. |
| first_indexed | 2024-09-23T16:13:57Z |
| format | Presentation |
| id | mit-1721.1/84456 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T16:13:57Z |
| publishDate | 2014 |
| record_format | dspace |
| spelling | mit-1721.1/844562019-04-11T01:16:22Z Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? Valerdi, Ricardo cost estimates intuition parametric models This paper explores the abilities of engineers to estimate everyday tasks and their reliance on their own intuition when performing cost estimates. The approach to answering these questions is similar to that of the popular television show MythBusters which aims to separate truth from urban legend using controlled experiments. In MythBusters, methods for testing myths and urban legends are usually planned and executed in a manner to produce the most visually dramatic results possible, which generally involves explosions, fires, or vehicle crashes. While the question of parametric models versus intuition is not as exciting, we provide an interesting result that demonstrates the difference between what is real and what is fiction in the world of cost estimation. Two heuristics, representativeness and anchoring, are explored in two experiments involving psychology students, engineering students, and engineering practitioners. The first experiment, designed to determine if there is a difference in estimating ability in everyday quantities, demonstrates that the three groups estimate with relatively equal accuracy. The results shed light on the distribution of estimates and the process of subjective judgment. The second experiment, designed to explore abilities for estimating the cost of software-intensive systems given incomplete information, shows that predictions by engineering students and practitioners are within 3-12% of each other. Results also show that engineers rely more on their intuition than on parametric models to make decisions. The value of this work is in helping better understand how software engineers make decisions based on limited information. Implications for the development of software cost estimation models are discussed in light of the findings from the two experiments. 2014-01-23T20:53:16Z 2014-01-23T20:53:16Z 2007-06-12 Presentation Technical Report http://hdl.handle.net/1721.1/84456 Attribution-NonCommercial-ShareAlike 3.0 United States http://creativecommons.org/licenses/by-nc-sa/3.0/us/ application/pdf |
| spellingShingle | cost estimates intuition parametric models Valerdi, Ricardo Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title | Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title_full | Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title_fullStr | Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title_full_unstemmed | Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title_short | Myth Buster: Do Engineers Trust Parametric Models Over Their Own Intuition? |
| title_sort | myth buster do engineers trust parametric models over their own intuition |
| topic | cost estimates intuition parametric models |
| url | http://hdl.handle.net/1721.1/84456 |
| work_keys_str_mv | AT valerdiricardo mythbusterdoengineerstrustparametricmodelsovertheirownintuition |