Integrating automatic question generation with computerised adaptive test
Abstract The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Asia-Pacific Society for Computers in Education (APSCE)
2020-05-01
|
| Series: | Research and Practice in Technology Enhanced Learning |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s41039-020-00132-w |
| _version_ | 1797765129884925952 |
|---|---|
| author | Yuni Susanti Takenobu Tokunaga Hitoshi Nishikawa |
| author_facet | Yuni Susanti Takenobu Tokunaga Hitoshi Nishikawa |
| author_sort | Yuni Susanti |
| collection | DOAJ |
| description | Abstract The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a simulation-based experiment of the AQG and CAT integration. We proposed a method to integrate them with a predetermined item difficulty that enables to integrate AQG and CAT without administering the items in a pretesting. The result showed that all CAT simulations performed better than the baseline, a linear test, in estimating the test taker’s true proficiency. |
| first_indexed | 2024-03-12T20:06:38Z |
| format | Article |
| id | doaj.art-59e9de99f7f6454ebf520d280c78573a |
| institution | Directory Open Access Journal |
| issn | 1793-7078 |
| language | English |
| last_indexed | 2024-03-12T20:06:38Z |
| publishDate | 2020-05-01 |
| publisher | The Asia-Pacific Society for Computers in Education (APSCE) |
| record_format | Article |
| series | Research and Practice in Technology Enhanced Learning |
| spelling | doaj.art-59e9de99f7f6454ebf520d280c78573a2023-08-02T02:03:58ZengThe Asia-Pacific Society for Computers in Education (APSCE)Research and Practice in Technology Enhanced Learning1793-70782020-05-0115112210.1186/s41039-020-00132-wIntegrating automatic question generation with computerised adaptive testYuni Susanti0Takenobu Tokunaga1Hitoshi Nishikawa2Department of Computer Science (W8E-6F), Tokyo Institute of TechnologyDepartment of Computer Science (W8E-6F), Tokyo Institute of TechnologyDepartment of Computer Science (W8E-6F), Tokyo Institute of TechnologyAbstract The present study focuses on the integration of an automatic question generation (AQG) system and a computerised adaptive test (CAT). We conducted two experiments. In the first experiment, we administered sets of questions to English learners to gather their responses. We further used their responses in the second experiment, which is a simulation-based experiment of the AQG and CAT integration. We proposed a method to integrate them with a predetermined item difficulty that enables to integrate AQG and CAT without administering the items in a pretesting. The result showed that all CAT simulations performed better than the baseline, a linear test, in estimating the test taker’s true proficiency.http://link.springer.com/article/10.1186/s41039-020-00132-wAutomatic question generationComputerised adaptive testEnglish vocabulary questionMultiple-choice question |
| spellingShingle | Yuni Susanti Takenobu Tokunaga Hitoshi Nishikawa Integrating automatic question generation with computerised adaptive test Research and Practice in Technology Enhanced Learning Automatic question generation Computerised adaptive test English vocabulary question Multiple-choice question |
| title | Integrating automatic question generation with computerised adaptive test |
| title_full | Integrating automatic question generation with computerised adaptive test |
| title_fullStr | Integrating automatic question generation with computerised adaptive test |
| title_full_unstemmed | Integrating automatic question generation with computerised adaptive test |
| title_short | Integrating automatic question generation with computerised adaptive test |
| title_sort | integrating automatic question generation with computerised adaptive test |
| topic | Automatic question generation Computerised adaptive test English vocabulary question Multiple-choice question |
| url | http://link.springer.com/article/10.1186/s41039-020-00132-w |
| work_keys_str_mv | AT yunisusanti integratingautomaticquestiongenerationwithcomputerisedadaptivetest AT takenobutokunaga integratingautomaticquestiongenerationwithcomputerisedadaptivetest AT hitoshinishikawa integratingautomaticquestiongenerationwithcomputerisedadaptivetest |