DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS
A Computerized Adaptive Test proposes items according to the student's knowledge level. Therefore, the number of items, which are given to students, is reduced. Besides, the ending of such test is determined by the student's knowledge level, which allows an instructor to reduce testing tim...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Institute for Digitalisation of Education of the NAES of Ukraine
2019-10-01
|
| Series: | Інформаційні технології і засоби навчання |
| Subjects: | |
| Online Access: | https://journal.iitta.gov.ua/index.php/itlt/article/view/2520 |
| _version_ | 1797765472987381760 |
|---|---|
| author | Viktor E. Bondarenko |
| author_facet | Viktor E. Bondarenko |
| author_sort | Viktor E. Bondarenko |
| collection | DOAJ |
| description | A Computerized Adaptive Test proposes items according to the student's knowledge level. Therefore, the number of items, which are given to students, is reduced. Besides, the ending of such test is determined by the student's knowledge level, which allows an instructor to reduce testing time. As usual, construction of such tests is based on the Item Response Theory (IRT). This theory gives models which use statistical data about the student's knowledge level and difficulty of items. We do not have such statistics for new tests. In such cases, this paper proposes to estimate the complexity of items on the basis of the experts' conclusions. These conclusions are based on the analytic hierarchy process (AHP) which was modified. The modification allows experts to estimate the complexity of items with the help of the collection of the items characteristics. This modification can remove the expert's inadequate estimates of items or their characteristics. This method allows experts to classify all items in clusters according to their complexity in the first stage of the testing when statistics of items use is absent. A test constructor, on the basis of a decision tables network, realizes the algorithm of the items' selection from different clusters. In the future, tutors will have tested a sufficient number of students' groups. They record statistics of the test using. A test constructor receives such statistics, which will allow them to use the models of the Item Response Theory for estimation of the test items' complexity. The assessment of the knowledge level of students is made with the help of an adaptive test, which is based on a network of decision tables. This network determines the algorithm of using items from different clusters for the testing. The adaptive test is built on the basis of the network of decision tables as a computer system. This system is constructed on the Java platform with the help of the programming environment Android Studio. It has the interface suitable for students as well as for a constructor, which allows the constructor to change the algorithm of using items if received statistics of items use shows such necessity. |
| first_indexed | 2024-03-12T20:10:41Z |
| format | Article |
| id | doaj.art-6be198f1af24447b97c1c41c4afd0b6e |
| institution | Directory Open Access Journal |
| issn | 2076-8184 |
| language | English |
| last_indexed | 2024-03-12T20:10:41Z |
| publishDate | 2019-10-01 |
| publisher | Institute for Digitalisation of Education of the NAES of Ukraine |
| record_format | Article |
| series | Інформаційні технології і засоби навчання |
| spelling | doaj.art-6be198f1af24447b97c1c41c4afd0b6e2023-08-02T01:42:52ZengInstitute for Digitalisation of Education of the NAES of UkraineІнформаційні технології і засоби навчання2076-81842019-10-0173510.33407/itlt.v73i5.2520DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICSViktor E. Bondarenko0Kyiv International UniversityA Computerized Adaptive Test proposes items according to the student's knowledge level. Therefore, the number of items, which are given to students, is reduced. Besides, the ending of such test is determined by the student's knowledge level, which allows an instructor to reduce testing time. As usual, construction of such tests is based on the Item Response Theory (IRT). This theory gives models which use statistical data about the student's knowledge level and difficulty of items. We do not have such statistics for new tests. In such cases, this paper proposes to estimate the complexity of items on the basis of the experts' conclusions. These conclusions are based on the analytic hierarchy process (AHP) which was modified. The modification allows experts to estimate the complexity of items with the help of the collection of the items characteristics. This modification can remove the expert's inadequate estimates of items or their characteristics. This method allows experts to classify all items in clusters according to their complexity in the first stage of the testing when statistics of items use is absent. A test constructor, on the basis of a decision tables network, realizes the algorithm of the items' selection from different clusters. In the future, tutors will have tested a sufficient number of students' groups. They record statistics of the test using. A test constructor receives such statistics, which will allow them to use the models of the Item Response Theory for estimation of the test items' complexity. The assessment of the knowledge level of students is made with the help of an adaptive test, which is based on a network of decision tables. This network determines the algorithm of using items from different clusters for the testing. The adaptive test is built on the basis of the network of decision tables as a computer system. This system is constructed on the Java platform with the help of the programming environment Android Studio. It has the interface suitable for students as well as for a constructor, which allows the constructor to change the algorithm of using items if received statistics of items use shows such necessity.https://journal.iitta.gov.ua/index.php/itlt/article/view/2520computerized adaptive testanalytic hierarchy processexperts’ conclusiondecision tablesa network of decision tables |
| spellingShingle | Viktor E. Bondarenko DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS Інформаційні технології і засоби навчання computerized adaptive test analytic hierarchy process experts’ conclusion decision tables a network of decision tables |
| title | DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS |
| title_full | DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS |
| title_fullStr | DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS |
| title_full_unstemmed | DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS |
| title_short | DESIGNING OF COMPUTERIZED ADAPTIVE TESTS IN THE ABSENCE OF TESTING STATISTICS |
| title_sort | designing of computerized adaptive tests in the absence of testing statistics |
| topic | computerized adaptive test analytic hierarchy process experts’ conclusion decision tables a network of decision tables |
| url | https://journal.iitta.gov.ua/index.php/itlt/article/view/2520 |
| work_keys_str_mv | AT viktorebondarenko designingofcomputerizedadaptivetestsintheabsenceoftestingstatistics |