Reliability testing of a modified MISTELS score using a low-cost trainer box
Abstract Background Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is det...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2019-05-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12909-019-1572-4 |
| _version_ | 1811270228331462656 |
|---|---|
| author | Anis Hasnaoui Haithem Zaafouri Dhafer Haddad Ahmed Bouhafa Anis Ben Maamer |
| author_facet | Anis Hasnaoui Haithem Zaafouri Dhafer Haddad Ahmed Bouhafa Anis Ben Maamer |
| author_sort | Anis Hasnaoui |
| collection | DOAJ |
| description | Abstract Background Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be implemented in countries with limited resources using a low-cost trainer box. Would the use of a low-cost trainer box alter the reliability of the MISTELS score? Objective of study The aim of the study was to evaluate the reliability of a modified MISTELS using a low-cost trainer box. Methods It was a prospective study carried out at Habib Thameur hospital in Tunis (Tunisia), between April 2016 and August 2016. The study involved residents from different surgical specialties in the departments of general surgery and paediatric surgery of the hospital during 2015 and 2016. This study assessed the reliability of a modified MISTELS system (Only three tasks were performed out of the five tasks used in the original MISTELS system). Evaluation was based on Cronbach’s alpha and intraclass correlation coefficients (ICC). A low-cost trainer box was designed and constructed. The residents included in the study performed three series of three tasks using this trainer box. The first series was scored by two trained raters to evaluate inter-rater reliability. The two-other series were successively performed to evaluate test-retest reliability. Results The internal consistency, assessed by Cronbach’s alpha, was at 0.929 which is an acceptable score. As for inter-rater and test-retest reliabilities that were assessed by ICCs, they yielded excellent scores that were at 1 and 0.95 (95% CI, 0.891–0.978) respectively. Conclusions The reliability of a modified MISTELS is not altered by the use of a low-cost trainer box. The score of the modified MISTELS is a reliable score for evaluating technical skills of surgical residents using a low-cost trainer box. |
| first_indexed | 2024-04-12T21:57:10Z |
| format | Article |
| id | doaj.art-2b8c32af5adb4f518c0e01094cb18f85 |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-04-12T21:57:10Z |
| publishDate | 2019-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-2b8c32af5adb4f518c0e01094cb18f852022-12-22T03:15:16ZengBMCBMC Medical Education1472-69202019-05-011911710.1186/s12909-019-1572-4Reliability testing of a modified MISTELS score using a low-cost trainer boxAnis Hasnaoui0Haithem Zaafouri1Dhafer Haddad2Ahmed Bouhafa3Anis Ben Maamer4Department of General Surgery, Habib Thameur HospitalDepartment of General Surgery, Habib Thameur HospitalDepartment of General Surgery, Habib Thameur HospitalDepartment of General Surgery, Habib Thameur HospitalDepartment of General Surgery, Habib Thameur HospitalAbstract Background Training programs such as the fundamentals of laparoscopic surgery (FLS) that are based on simulation are being currently used in several western countries. FLS allows skill acquisition and evaluation of competency in laparoscopic surgery. On the practical side, evaluation is determined by the MISTELS metrics (MISTELS is the acronym for the McGill inanimate system for training and evaluation of laparoscopic skills). This training program may be modified so that it can be implemented in countries with limited resources using a low-cost trainer box. Would the use of a low-cost trainer box alter the reliability of the MISTELS score? Objective of study The aim of the study was to evaluate the reliability of a modified MISTELS using a low-cost trainer box. Methods It was a prospective study carried out at Habib Thameur hospital in Tunis (Tunisia), between April 2016 and August 2016. The study involved residents from different surgical specialties in the departments of general surgery and paediatric surgery of the hospital during 2015 and 2016. This study assessed the reliability of a modified MISTELS system (Only three tasks were performed out of the five tasks used in the original MISTELS system). Evaluation was based on Cronbach’s alpha and intraclass correlation coefficients (ICC). A low-cost trainer box was designed and constructed. The residents included in the study performed three series of three tasks using this trainer box. The first series was scored by two trained raters to evaluate inter-rater reliability. The two-other series were successively performed to evaluate test-retest reliability. Results The internal consistency, assessed by Cronbach’s alpha, was at 0.929 which is an acceptable score. As for inter-rater and test-retest reliabilities that were assessed by ICCs, they yielded excellent scores that were at 1 and 0.95 (95% CI, 0.891–0.978) respectively. Conclusions The reliability of a modified MISTELS is not altered by the use of a low-cost trainer box. The score of the modified MISTELS is a reliable score for evaluating technical skills of surgical residents using a low-cost trainer box.http://link.springer.com/article/10.1186/s12909-019-1572-4TrainingEvaluationSimulationFLSMISTELSReliability |
| spellingShingle | Anis Hasnaoui Haithem Zaafouri Dhafer Haddad Ahmed Bouhafa Anis Ben Maamer Reliability testing of a modified MISTELS score using a low-cost trainer box BMC Medical Education Training Evaluation Simulation FLS MISTELS Reliability |
| title | Reliability testing of a modified MISTELS score using a low-cost trainer box |
| title_full | Reliability testing of a modified MISTELS score using a low-cost trainer box |
| title_fullStr | Reliability testing of a modified MISTELS score using a low-cost trainer box |
| title_full_unstemmed | Reliability testing of a modified MISTELS score using a low-cost trainer box |
| title_short | Reliability testing of a modified MISTELS score using a low-cost trainer box |
| title_sort | reliability testing of a modified mistels score using a low cost trainer box |
| topic | Training Evaluation Simulation FLS MISTELS Reliability |
| url | http://link.springer.com/article/10.1186/s12909-019-1572-4 |
| work_keys_str_mv | AT anishasnaoui reliabilitytestingofamodifiedmistelsscoreusingalowcosttrainerbox AT haithemzaafouri reliabilitytestingofamodifiedmistelsscoreusingalowcosttrainerbox AT dhaferhaddad reliabilitytestingofamodifiedmistelsscoreusingalowcosttrainerbox AT ahmedbouhafa reliabilitytestingofamodifiedmistelsscoreusingalowcosttrainerbox AT anisbenmaamer reliabilitytestingofamodifiedmistelsscoreusingalowcosttrainerbox |