Behavioral Indicator-Based Initial Flight Training Competency Assessment Model

Ensuring training safety is paramount to flight schools. In response to the inadequacy of traditional flight training assessment for comprehensive quantitative evaluation of cadet competency, an initial flight training competency assessment standard based on behavioral indicators was developed and o...

Full description

Bibliographic Details
Main Authors: Hong Sun, Fangquan Yang, Peiwen Zhang, Qingqing Hu
Format: Article
Language:English
Published: MDPI AG 2023-05-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/13/10/6346
_version_ 1797601192177565696
author Hong Sun
Fangquan Yang
Peiwen Zhang
Qingqing Hu
author_facet Hong Sun
Fangquan Yang
Peiwen Zhang
Qingqing Hu
author_sort Hong Sun
collection DOAJ
description Ensuring training safety is paramount to flight schools. In response to the inadequacy of traditional flight training assessment for comprehensive quantitative evaluation of cadet competency, an initial flight training competency assessment standard based on behavioral indicators was developed and optimized using the VENN model. Firstly, the Assessor Score Measurement Form (ASMF) was constructed according to the requirements of the Training Evaluation Worksheet specification, such as typical subjects, observations, and completion criteria. Secondly, based on the basic principles of the experience of the flight expert and the Competency-Based Training and Assessment (CBTA), a matrix of correlations between the observations and each competency-based behavioral indicator was created to construct a competency assessment matrix. In addition, a two-dimensional model for representing competency items characterized by behavioral indicators was established and an optimization model for competency assessment criteria was constructed. Finally, through combining actual flight training data, the proposed method was validated in the flight screening check phase. The results show that the optimized flight training competency assessment scheme can be well quantified and matched to real instructor ratings with an accuracy of 84%. The assessment worksheet, the assessment matrix, and the VENN competency rating model can be adapted to the different teaching requirements of each flight phase, achieving a perfect match between the behavioral indicators and the competency items, which is highly versatile. The proposed model can more accurately reflect the core competencies of flight trainees, enable quantitative assessment of behavioral indicators and competency items, and provide support for subsequent training of trainees.
first_indexed 2024-03-11T03:57:47Z
format Article
id doaj.art-830e953d860c4ca9b141a5c8da8bdde8
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-11T03:57:47Z
publishDate 2023-05-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-830e953d860c4ca9b141a5c8da8bdde82023-11-18T00:24:21ZengMDPI AGApplied Sciences2076-34172023-05-011310634610.3390/app13106346Behavioral Indicator-Based Initial Flight Training Competency Assessment ModelHong Sun0Fangquan Yang1Peiwen Zhang2Qingqing Hu3Flight Technology and Flight Safety Research Base, Civil Aviation Flight University of China, Guanghan 618307, ChinaSchool of Airport, Civil Aviation Flight University of China, Guanghan 618307, ChinaSchool of Economics and Management, Civil Aviation Flight University of China, Guanghan 618307, ChinaSchool of Airport, Civil Aviation Flight University of China, Guanghan 618307, ChinaEnsuring training safety is paramount to flight schools. In response to the inadequacy of traditional flight training assessment for comprehensive quantitative evaluation of cadet competency, an initial flight training competency assessment standard based on behavioral indicators was developed and optimized using the VENN model. Firstly, the Assessor Score Measurement Form (ASMF) was constructed according to the requirements of the Training Evaluation Worksheet specification, such as typical subjects, observations, and completion criteria. Secondly, based on the basic principles of the experience of the flight expert and the Competency-Based Training and Assessment (CBTA), a matrix of correlations between the observations and each competency-based behavioral indicator was created to construct a competency assessment matrix. In addition, a two-dimensional model for representing competency items characterized by behavioral indicators was established and an optimization model for competency assessment criteria was constructed. Finally, through combining actual flight training data, the proposed method was validated in the flight screening check phase. The results show that the optimized flight training competency assessment scheme can be well quantified and matched to real instructor ratings with an accuracy of 84%. The assessment worksheet, the assessment matrix, and the VENN competency rating model can be adapted to the different teaching requirements of each flight phase, achieving a perfect match between the behavioral indicators and the competency items, which is highly versatile. The proposed model can more accurately reflect the core competencies of flight trainees, enable quantitative assessment of behavioral indicators and competency items, and provide support for subsequent training of trainees.https://www.mdpi.com/2076-3417/13/10/6346behavioral indicatorsinitial flight trainingcompetencyevaluation criteria
spellingShingle Hong Sun
Fangquan Yang
Peiwen Zhang
Qingqing Hu
Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
Applied Sciences
behavioral indicators
initial flight training
competency
evaluation criteria
title Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
title_full Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
title_fullStr Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
title_full_unstemmed Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
title_short Behavioral Indicator-Based Initial Flight Training Competency Assessment Model
title_sort behavioral indicator based initial flight training competency assessment model
topic behavioral indicators
initial flight training
competency
evaluation criteria
url https://www.mdpi.com/2076-3417/13/10/6346
work_keys_str_mv AT hongsun behavioralindicatorbasedinitialflighttrainingcompetencyassessmentmodel
AT fangquanyang behavioralindicatorbasedinitialflighttrainingcompetencyassessmentmodel
AT peiwenzhang behavioralindicatorbasedinitialflighttrainingcompetencyassessmentmodel
AT qingqinghu behavioralindicatorbasedinitialflighttrainingcompetencyassessmentmodel