A Model-Based Measure to Assess Operator Adherence to Procedures
Procedures play an important role in domains where humans interact with critical, complex systems. In such environments, the operator’s ability to correctly follow a given set of procedures can directly impact system safety. A quantitative measure of procedural adherence during training for complex...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Human Factors and Ergonomics Society
2013
|
| Online Access: | http://hdl.handle.net/1721.1/81171 |
| _version_ | 1811096825033129984 |
|---|---|
| author | Cummings, M. L. Stimpson, Alexander J. Buinhas, Luisa S. Bezek, Scott Boussemart, Yves |
| author2 | Massachusetts Institute of Technology. Humans and Automation Lab |
| author_facet | Massachusetts Institute of Technology. Humans and Automation Lab Cummings, M. L. Stimpson, Alexander J. Buinhas, Luisa S. Bezek, Scott Boussemart, Yves |
| author_sort | Cummings, M. L. |
| collection | MIT |
| description | Procedures play an important role in domains where humans interact with critical, complex systems. In such environments, the operator’s ability to correctly follow a given set of procedures can directly impact system safety. A quantitative measure of procedural adherence during training for complex system operation would be useful to assess trainee performance and evaluate a training program. This paper presents a novel model-based objective metric for quantifying procedural adherence in training. This metric is sensitive to both the number and nature of procedural deviations, and can be used with cluster analysis to classify trainee performance based on adherence. The metric was tested on an experimental data set gathered from volunteers using aircraft maintenance computer-based training (CBT). The properties of the metric are discussed, along with future possibilities. |
| first_indexed | 2024-09-23T16:49:36Z |
| format | Article |
| id | mit-1721.1/81171 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T16:49:36Z |
| publishDate | 2013 |
| publisher | Human Factors and Ergonomics Society |
| record_format | dspace |
| spelling | mit-1721.1/811712022-09-29T21:45:47Z A Model-Based Measure to Assess Operator Adherence to Procedures Cummings, M. L. Stimpson, Alexander J. Buinhas, Luisa S. Bezek, Scott Boussemart, Yves Massachusetts Institute of Technology. Humans and Automation Lab Stimpson, Alexander J. Buinhas, Luisa S. Bezek, Scott Boussemart, Yves Cummings, M. L. Procedures play an important role in domains where humans interact with critical, complex systems. In such environments, the operator’s ability to correctly follow a given set of procedures can directly impact system safety. A quantitative measure of procedural adherence during training for complex system operation would be useful to assess trainee performance and evaluate a training program. This paper presents a novel model-based objective metric for quantifying procedural adherence in training. This metric is sensitive to both the number and nature of procedural deviations, and can be used with cluster analysis to classify trainee performance based on adherence. The metric was tested on an experimental data set gathered from volunteers using aircraft maintenance computer-based training (CBT). The properties of the metric are discussed, along with future possibilities. 2013-09-25T17:16:26Z 2013-09-25T17:16:26Z 2012-09 Article http://purl.org/eprint/type/ConferencePaper 1541-9312 http://hdl.handle.net/1721.1/81171 Stimpson, A. J., L. S. Buinhas, S. Bezek, Y. Boussemart, and M. L. Cummings. “A Model-Based Measure to Assess Operator Adherence to Procedures.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 56, no. 1 (October 26, 2012): 2452-2456. en_US http://dx.doi.org/10.1177/1071181312561499 Proceedings of the Human Factors and Ergonomics Society Annual Meeting Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Human Factors and Ergonomics Society MIT web domain |
| spellingShingle | Cummings, M. L. Stimpson, Alexander J. Buinhas, Luisa S. Bezek, Scott Boussemart, Yves A Model-Based Measure to Assess Operator Adherence to Procedures |
| title | A Model-Based Measure to Assess Operator Adherence to Procedures |
| title_full | A Model-Based Measure to Assess Operator Adherence to Procedures |
| title_fullStr | A Model-Based Measure to Assess Operator Adherence to Procedures |
| title_full_unstemmed | A Model-Based Measure to Assess Operator Adherence to Procedures |
| title_short | A Model-Based Measure to Assess Operator Adherence to Procedures |
| title_sort | model based measure to assess operator adherence to procedures |
| url | http://hdl.handle.net/1721.1/81171 |
| work_keys_str_mv | AT cummingsml amodelbasedmeasuretoassessoperatoradherencetoprocedures AT stimpsonalexanderj amodelbasedmeasuretoassessoperatoradherencetoprocedures AT buinhasluisas amodelbasedmeasuretoassessoperatoradherencetoprocedures AT bezekscott amodelbasedmeasuretoassessoperatoradherencetoprocedures AT boussemartyves amodelbasedmeasuretoassessoperatoradherencetoprocedures AT cummingsml modelbasedmeasuretoassessoperatoradherencetoprocedures AT stimpsonalexanderj modelbasedmeasuretoassessoperatoradherencetoprocedures AT buinhasluisas modelbasedmeasuretoassessoperatoradherencetoprocedures AT bezekscott modelbasedmeasuretoassessoperatoradherencetoprocedures AT boussemartyves modelbasedmeasuretoassessoperatoradherencetoprocedures |