Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value
Abstract Background This study investigated the scoring and criterion-related validity of the TEAP, a newly developed Test of English for Academic Purposes. In this study, scoring validity was examined by investigating the factor structure, while criterion-related validity was examined by first inve...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-09-01
|
| Series: | Language Testing in Asia |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40468-022-00183-4 |
| _version_ | 1811265005738262528 |
|---|---|
| author | Keita Nakamura |
| author_facet | Keita Nakamura |
| author_sort | Keita Nakamura |
| collection | DOAJ |
| description | Abstract Background This study investigated the scoring and criterion-related validity of the TEAP, a newly developed Test of English for Academic Purposes. In this study, scoring validity was examined by investigating the factor structure, while criterion-related validity was examined by first investigating the longitudinal change of test takers’ perceived test task value toward the measured construct and then investigating the relationship of test takers’ perceived value to the factor structure of the TEAP. Methods Confirmatory item-level factor analysis was conducted using the data obtained from 2217 first-year university students comparing four models (unitary, correlated, receptive-productive, higher order). Additional confirmatory factor analyses were conducted to first investigate the longitudinal change of perceived value toward the measured construct and then to investigate the relationship of test takers’ perceived value of the construct measured by the test to the factor structure of the TEAP. Results The results show that the higher-order model was the best-fitting model. This confirmed a previous small-scale study suggesting the generalizability of the test’s factor structure. Furthermore, it was found that test takers’ perceived values measured at the start of university positively affected the values measured about 6 months later. In addition, perceived values measured both at the start of university study and about 6 months later positively correlated with the higher-order factor of the test. Conclusions The results provide further support of the scoring validity of the test. In addition, a positive relationship between the higher-order factor of TEAP and the factors of perceived values provide evidence of the usefulness of test takers’ perception to further support the criterion-related validity of the test. |
| first_indexed | 2024-04-12T20:15:51Z |
| format | Article |
| id | doaj.art-468f63bb01a14d8fb2297811a1f1de94 |
| institution | Directory Open Access Journal |
| issn | 2229-0443 |
| language | English |
| last_indexed | 2024-04-12T20:15:51Z |
| publishDate | 2022-09-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Language Testing in Asia |
| spelling | doaj.art-468f63bb01a14d8fb2297811a1f1de942022-12-22T03:18:08ZengSpringerOpenLanguage Testing in Asia2229-04432022-09-0112112810.1186/s40468-022-00183-4Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task valueKeita Nakamura0Waseda UniversityAbstract Background This study investigated the scoring and criterion-related validity of the TEAP, a newly developed Test of English for Academic Purposes. In this study, scoring validity was examined by investigating the factor structure, while criterion-related validity was examined by first investigating the longitudinal change of test takers’ perceived test task value toward the measured construct and then investigating the relationship of test takers’ perceived value to the factor structure of the TEAP. Methods Confirmatory item-level factor analysis was conducted using the data obtained from 2217 first-year university students comparing four models (unitary, correlated, receptive-productive, higher order). Additional confirmatory factor analyses were conducted to first investigate the longitudinal change of perceived value toward the measured construct and then to investigate the relationship of test takers’ perceived value of the construct measured by the test to the factor structure of the TEAP. Results The results show that the higher-order model was the best-fitting model. This confirmed a previous small-scale study suggesting the generalizability of the test’s factor structure. Furthermore, it was found that test takers’ perceived values measured at the start of university positively affected the values measured about 6 months later. In addition, perceived values measured both at the start of university study and about 6 months later positively correlated with the higher-order factor of the test. Conclusions The results provide further support of the scoring validity of the test. In addition, a positive relationship between the higher-order factor of TEAP and the factors of perceived values provide evidence of the usefulness of test takers’ perception to further support the criterion-related validity of the test.https://doi.org/10.1186/s40468-022-00183-4Factor structureScoring validityCriterion-related validityLongitudinal change of perceived value |
| spellingShingle | Keita Nakamura Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value Language Testing in Asia Factor structure Scoring validity Criterion-related validity Longitudinal change of perceived value |
| title | Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value |
| title_full | Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value |
| title_fullStr | Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value |
| title_full_unstemmed | Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value |
| title_short | Investigating the factor structure of the Test of English for Academic Purposes (TEAP) and its relation to test takers’ perceived test task value |
| title_sort | investigating the factor structure of the test of english for academic purposes teap and its relation to test takers perceived test task value |
| topic | Factor structure Scoring validity Criterion-related validity Longitudinal change of perceived value |
| url | https://doi.org/10.1186/s40468-022-00183-4 |
| work_keys_str_mv | AT keitanakamura investigatingthefactorstructureofthetestofenglishforacademicpurposesteapanditsrelationtotesttakersperceivedtesttaskvalue |