An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance

This study presents an experimental methodology to measure how concept generation procedures can affect the anticipated lifecycle performance of engineering systems design concepts. The methodology is based on objective and quantitative measurements of anticipated lifecycle performance of the design...

Full description

Bibliographic Details
Main Authors: Cardin, Michel-Alexandre, Kolfschoten, Gwendolyn L., Frey, Daniel, de Neufville, Richard, de Weck, Olivier L., Geltner, David M.
Other Authors: Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Format: Article
Language:en_US
Published: INCOSE-International Council on Systems Engineering 2013
Online Access:http://hdl.handle.net/1721.1/81889
https://orcid.org/0000-0001-6677-383X
https://orcid.org/0000-0002-9886-7512
https://orcid.org/0000-0002-1024-7555
_version_ 1811086283514052608
author Cardin, Michel-Alexandre
Kolfschoten, Gwendolyn L.
Frey, Daniel
de Neufville, Richard
de Weck, Olivier L.
Geltner, David M.
author2 Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
author_facet Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Cardin, Michel-Alexandre
Kolfschoten, Gwendolyn L.
Frey, Daniel
de Neufville, Richard
de Weck, Olivier L.
Geltner, David M.
author_sort Cardin, Michel-Alexandre
collection MIT
description This study presents an experimental methodology to measure how concept generation procedures can affect the anticipated lifecycle performance of engineering systems design concepts. The methodology is based on objective and quantitative measurements of anticipated lifecycle performance of the design concepts. It merges cognitive and computer-aided techniques from the fields of collaboration engineering, creativity, and engineering design. It complements the body of existing techniques relying on subjective expert assessments, and other objective metrics not explicitly measuring anticipated lifecycle performance (e.g. development time and cost). Application of the methodology is demonstrated through evaluation of design procedures generating flexibility in engineering systems design. Experiments had ninety participants generate creative design alternatives to a simplified real estate development design problem. Thirty-two teams of two to three participants performed the collaborative design exercise. An online Group-Support System interface enabled efficient data collection and analysis. A computationally efficient mid-fidelity model was used to evaluate flexible design concepts quantitatively based on real options analysis techniques.
first_indexed 2024-09-23T13:23:24Z
format Article
id mit-1721.1/81889
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T13:23:24Z
publishDate 2013
publisher INCOSE-International Council on Systems Engineering
record_format dspace
spelling mit-1721.1/818892022-09-28T13:51:01Z An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance Cardin, Michel-Alexandre Kolfschoten, Gwendolyn L. Frey, Daniel de Neufville, Richard de Weck, Olivier L. Geltner, David M. Massachusetts Institute of Technology. Department of Aeronautics and Astronautics Massachusetts Institute of Technology. Department of Mechanical Engineering Massachusetts Institute of Technology. Department of Urban Studies and Planning Massachusetts Institute of Technology. Engineering Systems Division Frey, Daniel de Neufville, Richard de Weck, Olivier L. Geltner, David M. This study presents an experimental methodology to measure how concept generation procedures can affect the anticipated lifecycle performance of engineering systems design concepts. The methodology is based on objective and quantitative measurements of anticipated lifecycle performance of the design concepts. It merges cognitive and computer-aided techniques from the fields of collaboration engineering, creativity, and engineering design. It complements the body of existing techniques relying on subjective expert assessments, and other objective metrics not explicitly measuring anticipated lifecycle performance (e.g. development time and cost). Application of the methodology is demonstrated through evaluation of design procedures generating flexibility in engineering systems design. Experiments had ninety participants generate creative design alternatives to a simplified real estate development design problem. Thirty-two teams of two to three participants performed the collaborative design exercise. An online Group-Support System interface enabled efficient data collection and analysis. A computationally efficient mid-fidelity model was used to evaluate flexible design concepts quantitatively based on real options analysis techniques. Massachusetts Institute of Technology. Center for Real Estate Natural Sciences and Engineering Research Council of Canada Massachusetts Institute of Technology. Engineering Systems Division Singapore University of Technology and Design. International Design Center 2013-10-30T20:58:02Z 2013-10-30T20:58:02Z 2012-07 Article http://purl.org/eprint/type/ConferencePaper 978-1-62276-916-2 http://hdl.handle.net/1721.1/81889 Cardin, Michel-Alexandre, Gwendolyn L. Kolfschoten, Daniel D. Frey, Richard de Neufville, Olivier L. de Weck, and David M. Geltner. "An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance." In 22nd Annual International Symposium of the International Council on Systems Engineering (INCOSE 2012) and the 8th Biennial European Systems Engineering Conference 2012 (EuSEC 2012), July 9-2, 2012, Rome, Italy. pp. 777-801. https://orcid.org/0000-0001-6677-383X https://orcid.org/0000-0002-9886-7512 https://orcid.org/0000-0002-1024-7555 en_US http://toc.proceedings.com/17373webtoc.pdf Proceedings of the 22nd Annual International Symposium of the International Council on Systems Engineering (INCOSE 2012) and the 8th Biennial European Systems Engineering Conference 2012 (EuSEC 2012) Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf INCOSE-International Council on Systems Engineering Other univ. web domain
spellingShingle Cardin, Michel-Alexandre
Kolfschoten, Gwendolyn L.
Frey, Daniel
de Neufville, Richard
de Weck, Olivier L.
Geltner, David M.
An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title_full An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title_fullStr An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title_full_unstemmed An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title_short An Experimental Methodology to Evaluate Concept Generation Procedures Based on Quantitative Lifecycle Performance
title_sort experimental methodology to evaluate concept generation procedures based on quantitative lifecycle performance
url http://hdl.handle.net/1721.1/81889
https://orcid.org/0000-0001-6677-383X
https://orcid.org/0000-0002-9886-7512
https://orcid.org/0000-0002-1024-7555
work_keys_str_mv AT cardinmichelalexandre anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT kolfschotengwendolynl anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT freydaniel anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT deneufvillerichard anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT deweckolivierl anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT geltnerdavidm anexperimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT cardinmichelalexandre experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT kolfschotengwendolynl experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT freydaniel experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT deneufvillerichard experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT deweckolivierl experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance
AT geltnerdavidm experimentalmethodologytoevaluateconceptgenerationproceduresbasedonquantitativelifecycleperformance