Development and validation of an English test measuring EFL learners’ critical thinking skills
Abstract Addressing the lack of English tests that measure critical thinking (CT) abilities of EFL learners, this study aims to develop an English Critical Thinking Test (ECTT) designed to measure the consistency, analysis, and inference CT skills. It is a follow-up to a pilot study to accumulate va...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2022-10-01
|
| Series: | Language Testing in Asia |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40468-022-00193-2 |
| _version_ | 1828106025352298496 |
|---|---|
| author | Akiyo Hirai Hideaki Oka Takeshi Kato Hiroki Maeda |
| author_facet | Akiyo Hirai Hideaki Oka Takeshi Kato Hiroki Maeda |
| author_sort | Akiyo Hirai |
| collection | DOAJ |
| description | Abstract Addressing the lack of English tests that measure critical thinking (CT) abilities of EFL learners, this study aims to develop an English Critical Thinking Test (ECTT) designed to measure the consistency, analysis, and inference CT skills. It is a follow-up to a pilot study to accumulate validity evidence for the use of the ECTT. A total of 262 Japanese EFL learners who were first-year college students took the ECTT, a Japanese Critical Thinking Test (JCTT), and an English proficiency test (EPT). The result of the internal structures of ECTT and JCTT revealed that both CT tests fit two-factor models better than three-factor models, with consistency as one factor and analysis and inference as the other factor. This implies that it is difficult to measure the CT skills’ hierarchical nature. However, the model that included the three tests fit the data well and indicated moderately high correlations between the ECTT and EPT (r = .64) and between the ECTT and JCTT (r = .55). In addition, we confirmed that the skills that test-takers needed most in solving questions in each of the three CT sections (i.e., consistency, analysis, and inference CT skills) of the ECTT were as intended. Based on these findings, the validation of the ECTT has been improved; ECTT can be used for EFL learners at upper secondary and university levels in Japan. |
| first_indexed | 2024-04-11T10:10:39Z |
| format | Article |
| id | doaj.art-72ee71b04cd9476ea553c09d001880ed |
| institution | Directory Open Access Journal |
| issn | 2229-0443 |
| language | English |
| last_indexed | 2024-04-11T10:10:39Z |
| publishDate | 2022-10-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Language Testing in Asia |
| spelling | doaj.art-72ee71b04cd9476ea553c09d001880ed2022-12-22T04:30:06ZengSpringerOpenLanguage Testing in Asia2229-04432022-10-0112112210.1186/s40468-022-00193-2Development and validation of an English test measuring EFL learners’ critical thinking skillsAkiyo Hirai0Hideaki Oka1Takeshi Kato2Hiroki Maeda3Humanities and Social Sciences, University of TsukubaThe University of NaganoGraduate School, University of TsukubaMatsuyama UniversityAbstract Addressing the lack of English tests that measure critical thinking (CT) abilities of EFL learners, this study aims to develop an English Critical Thinking Test (ECTT) designed to measure the consistency, analysis, and inference CT skills. It is a follow-up to a pilot study to accumulate validity evidence for the use of the ECTT. A total of 262 Japanese EFL learners who were first-year college students took the ECTT, a Japanese Critical Thinking Test (JCTT), and an English proficiency test (EPT). The result of the internal structures of ECTT and JCTT revealed that both CT tests fit two-factor models better than three-factor models, with consistency as one factor and analysis and inference as the other factor. This implies that it is difficult to measure the CT skills’ hierarchical nature. However, the model that included the three tests fit the data well and indicated moderately high correlations between the ECTT and EPT (r = .64) and between the ECTT and JCTT (r = .55). In addition, we confirmed that the skills that test-takers needed most in solving questions in each of the three CT sections (i.e., consistency, analysis, and inference CT skills) of the ECTT were as intended. Based on these findings, the validation of the ECTT has been improved; ECTT can be used for EFL learners at upper secondary and university levels in Japan.https://doi.org/10.1186/s40468-022-00193-2Critical thinking testValidationAnalysisConsistencyInferenceReading literacy |
| spellingShingle | Akiyo Hirai Hideaki Oka Takeshi Kato Hiroki Maeda Development and validation of an English test measuring EFL learners’ critical thinking skills Language Testing in Asia Critical thinking test Validation Analysis Consistency Inference Reading literacy |
| title | Development and validation of an English test measuring EFL learners’ critical thinking skills |
| title_full | Development and validation of an English test measuring EFL learners’ critical thinking skills |
| title_fullStr | Development and validation of an English test measuring EFL learners’ critical thinking skills |
| title_full_unstemmed | Development and validation of an English test measuring EFL learners’ critical thinking skills |
| title_short | Development and validation of an English test measuring EFL learners’ critical thinking skills |
| title_sort | development and validation of an english test measuring efl learners critical thinking skills |
| topic | Critical thinking test Validation Analysis Consistency Inference Reading literacy |
| url | https://doi.org/10.1186/s40468-022-00193-2 |
| work_keys_str_mv | AT akiyohirai developmentandvalidationofanenglishtestmeasuringefllearnerscriticalthinkingskills AT hideakioka developmentandvalidationofanenglishtestmeasuringefllearnerscriticalthinkingskills AT takeshikato developmentandvalidationofanenglishtestmeasuringefllearnerscriticalthinkingskills AT hirokimaeda developmentandvalidationofanenglishtestmeasuringefllearnerscriticalthinkingskills |