Improving Peak Shift Estimation to Rank Exams by Difficulty
Candidates and other stakeholders often wish to know the difficulty level of exams, particularly compared with other exams in the same domain. Peak Shift Estimation (PSE) is a method for estimating the comparative difficulty of exams. However, this method requires users to correctly identify the mos...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10286494/ |
| _version_ | 1797649763883024384 |
|---|---|
| author | Satoshi Takahashi Masaki Kitazawa Atsushi Yoshikawa |
| author_facet | Satoshi Takahashi Masaki Kitazawa Atsushi Yoshikawa |
| author_sort | Satoshi Takahashi |
| collection | DOAJ |
| description | Candidates and other stakeholders often wish to know the difficulty level of exams, particularly compared with other exams in the same domain. Peak Shift Estimation (PSE) is a method for estimating the comparative difficulty of exams. However, this method requires users to correctly identify the most difficult exam in advance, which is not always possible. Therefore, we aimed to develop an improved version of PSE to overcome this limitation. Our new algorithm involves two key improvements. First, our method overcomes the issue described above using each exam as the most difficult in turn, and comparing the results. The second improvement addresses a potential problem which the first improvement, caused by the large number of exams of moderate difficulty. Instead of using all exams, our method randomly selects a subset of exams to remove this potential problem. We validated our new algorithm using data for the number of successful applicants at different universities from high schools in the Tokyo metropolitan area. The Improved PSE method correctly estimated the comparative difficulty of university entrance exams without prior knowledge of the most difficult exam. Few previous studies have considered selectively omitted exam data. The current findings should encourage other researchers to use these data in future studies. |
| first_indexed | 2024-03-11T15:50:42Z |
| format | Article |
| id | doaj.art-2a7047156e7141e980dd0040eb8411d3 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-11T15:50:42Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-2a7047156e7141e980dd0040eb8411d32023-10-25T23:00:17ZengIEEEIEEE Access2169-35362023-01-011111496311497510.1109/ACCESS.2023.332509610286494Improving Peak Shift Estimation to Rank Exams by DifficultySatoshi Takahashi0https://orcid.org/0000-0002-1067-6704Masaki Kitazawa1https://orcid.org/0000-0002-6352-0164Atsushi Yoshikawa2https://orcid.org/0000-0001-7020-5085College of Science and Engineering, Kanto Gakuin University, Yokohama, JapanKitazawa Tech, Kanagawa, JapanCollege of Science and Engineering, Kanto Gakuin University, Yokohama, JapanCandidates and other stakeholders often wish to know the difficulty level of exams, particularly compared with other exams in the same domain. Peak Shift Estimation (PSE) is a method for estimating the comparative difficulty of exams. However, this method requires users to correctly identify the most difficult exam in advance, which is not always possible. Therefore, we aimed to develop an improved version of PSE to overcome this limitation. Our new algorithm involves two key improvements. First, our method overcomes the issue described above using each exam as the most difficult in turn, and comparing the results. The second improvement addresses a potential problem which the first improvement, caused by the large number of exams of moderate difficulty. Instead of using all exams, our method randomly selects a subset of exams to remove this potential problem. We validated our new algorithm using data for the number of successful applicants at different universities from high schools in the Tokyo metropolitan area. The Improved PSE method correctly estimated the comparative difficulty of university entrance exams without prior knowledge of the most difficult exam. Few previous studies have considered selectively omitted exam data. The current findings should encourage other researchers to use these data in future studies.https://ieeexplore.ieee.org/document/10286494/ExaminationIRTpeak shift estimationrankingselectively omitted exam data |
| spellingShingle | Satoshi Takahashi Masaki Kitazawa Atsushi Yoshikawa Improving Peak Shift Estimation to Rank Exams by Difficulty IEEE Access Examination IRT peak shift estimation ranking selectively omitted exam data |
| title | Improving Peak Shift Estimation to Rank Exams by Difficulty |
| title_full | Improving Peak Shift Estimation to Rank Exams by Difficulty |
| title_fullStr | Improving Peak Shift Estimation to Rank Exams by Difficulty |
| title_full_unstemmed | Improving Peak Shift Estimation to Rank Exams by Difficulty |
| title_short | Improving Peak Shift Estimation to Rank Exams by Difficulty |
| title_sort | improving peak shift estimation to rank exams by difficulty |
| topic | Examination IRT peak shift estimation ranking selectively omitted exam data |
| url | https://ieeexplore.ieee.org/document/10286494/ |
| work_keys_str_mv | AT satoshitakahashi improvingpeakshiftestimationtorankexamsbydifficulty AT masakikitazawa improvingpeakshiftestimationtorankexamsbydifficulty AT atsushiyoshikawa improvingpeakshiftestimationtorankexamsbydifficulty |