A validation study of a consecutive interpreting test using many-facet Rasch analysis
Validation is the process of conducting a validity study on a test, gathering evidence to support inferences made based on test scores. Using many-facet Rasch analysis this paper validates the result of a consecutive interpreting test from four aspects: rating scale, raters, examinees and interpreti...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-02-01
|
| Series: | Frontiers in Communication |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomm.2022.1047389/full |
| _version_ | 1797937873633148928 |
|---|---|
| author | Nan Zhao |
| author_facet | Nan Zhao |
| author_sort | Nan Zhao |
| collection | DOAJ |
| description | Validation is the process of conducting a validity study on a test, gathering evidence to support inferences made based on test scores. Using many-facet Rasch analysis this paper validates the result of a consecutive interpreting test from four aspects: rating scale, raters, examinees and interpreting tasks. The study also identifies factors that affect the test results through bias analysis. The results of this analysis show that: (1) this analytical rating scale and task design can effectively reflect the examinees' interpreting competence, thus making it suitable for validating interpreting assessments; (2) one of the sub-scales: interpreting skills and manners, has a slightly negative effect on the overall validity of the assessment, making further revision on this sub-scale desirable. |
| first_indexed | 2024-04-10T18:52:07Z |
| format | Article |
| id | doaj.art-1000549ad9e24479a1e9ebee4e095bc2 |
| institution | Directory Open Access Journal |
| issn | 2297-900X |
| language | English |
| last_indexed | 2024-04-10T18:52:07Z |
| publishDate | 2023-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Communication |
| spelling | doaj.art-1000549ad9e24479a1e9ebee4e095bc22023-02-01T06:12:45ZengFrontiers Media S.A.Frontiers in Communication2297-900X2023-02-01710.3389/fcomm.2022.10473891047389A validation study of a consecutive interpreting test using many-facet Rasch analysisNan ZhaoValidation is the process of conducting a validity study on a test, gathering evidence to support inferences made based on test scores. Using many-facet Rasch analysis this paper validates the result of a consecutive interpreting test from four aspects: rating scale, raters, examinees and interpreting tasks. The study also identifies factors that affect the test results through bias analysis. The results of this analysis show that: (1) this analytical rating scale and task design can effectively reflect the examinees' interpreting competence, thus making it suitable for validating interpreting assessments; (2) one of the sub-scales: interpreting skills and manners, has a slightly negative effect on the overall validity of the assessment, making further revision on this sub-scale desirable.https://www.frontiersin.org/articles/10.3389/fcomm.2022.1047389/fullmany-facet Rasch analysisvalidityconsecutive interpretinganalytic rating scaleinterpreting assessment |
| spellingShingle | Nan Zhao A validation study of a consecutive interpreting test using many-facet Rasch analysis Frontiers in Communication many-facet Rasch analysis validity consecutive interpreting analytic rating scale interpreting assessment |
| title | A validation study of a consecutive interpreting test using many-facet Rasch analysis |
| title_full | A validation study of a consecutive interpreting test using many-facet Rasch analysis |
| title_fullStr | A validation study of a consecutive interpreting test using many-facet Rasch analysis |
| title_full_unstemmed | A validation study of a consecutive interpreting test using many-facet Rasch analysis |
| title_short | A validation study of a consecutive interpreting test using many-facet Rasch analysis |
| title_sort | validation study of a consecutive interpreting test using many facet rasch analysis |
| topic | many-facet Rasch analysis validity consecutive interpreting analytic rating scale interpreting assessment |
| url | https://www.frontiersin.org/articles/10.3389/fcomm.2022.1047389/full |
| work_keys_str_mv | AT nanzhao avalidationstudyofaconsecutiveinterpretingtestusingmanyfacetraschanalysis AT nanzhao validationstudyofaconsecutiveinterpretingtestusingmanyfacetraschanalysis |