Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale
Background. Task-sharing is the involvement of non-specialist providers to deliver mental health services. A challenge for task-sharing programs is to achieve and maintain clinical competence of non-specialists, including primary care workers, paraprofessi...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2015-01-01
|
| Series: | Cambridge Prisms: Global Mental Health |
| Subjects: | |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2054425115000217/type/journal_article |
| _version_ | 1811156120294653952 |
|---|---|
| author | B. A. Kohrt M. K. Ramaiya S. Rai A. Bhardwaj M. J. D Jordans |
| author_facet | B. A. Kohrt M. K. Ramaiya S. Rai A. Bhardwaj M. J. D Jordans |
| author_sort | B. A. Kohrt |
| collection | DOAJ |
| description |
Background.
Task-sharing is the involvement of non-specialist providers to deliver mental health services. A challenge for task-sharing programs is to achieve and maintain clinical competence of non-specialists, including primary care workers, paraprofessionals, and lay providers. We developed a tool for non-specialist peer ratings of common factors clinical competency to evaluate and optimize competence during training and supervision in global mental health task-sharing initiatives.
Methods.
The 18-item
EN
hancing
A
ssessment of
C
ommon
T
herapeutic factors (ENACT) tool was pilot-tested with non-specialists participating in mental health Gap Action Programme trainings in Nepal. Qualitative process evaluation was used to document development of the peer rating scoring system. Qualitative data included interviews with trainers and raters as well as transcripts of pre- and post-training observed structured clinical evaluations.
Results.
Five challenges for non-specialist peer ratings were identified through the process evaluation: (1) balance of training and supervision objectives with research objectives; (2) burden for peer raters due to number of scale items, number of response options, and use of behavioral counts; (3) capturing hierarchy of clinical skills; (4) objective v. subjective aspects of rating; and (5) social desirability when rating peers.
Conclusion.
The process culminated in five recommendations based on the key findings for the development of scales to be used by non-specialists for peer ratings in low-resource settings. Further research is needed to determine the ability of ENACT to capture the relationship of clinical competence with client outcomes and to explore the relevance of these recommendations for non-specialist peer ratings in high-resource settings.
|
| first_indexed | 2024-04-10T04:46:16Z |
| format | Article |
| id | doaj.art-8b78415f072c4d0db0cc607d57b4aa44 |
| institution | Directory Open Access Journal |
| issn | 2054-4251 |
| language | English |
| last_indexed | 2024-04-10T04:46:16Z |
| publishDate | 2015-01-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Cambridge Prisms: Global Mental Health |
| spelling | doaj.art-8b78415f072c4d0db0cc607d57b4aa442023-03-09T12:35:32ZengCambridge University PressCambridge Prisms: Global Mental Health2054-42512015-01-01210.1017/gmh.2015.21Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scaleB. A. Kohrt0M. K. Ramaiya1S. Rai2A. Bhardwaj3M. J. D Jordans4Transcultural Psychosocial Organization (TPO) Nepal, Kathmandu, Nepal Department of Psychiatry and Behavioral Sciences, Duke University, Durham, USA Duke Global Health Institute, Duke University, Durham, USADuke Global Health Institute, Duke University, Durham, USA Department of Psychology, University of Nevada, Reno, USATranscultural Psychosocial Organization (TPO) Nepal, Kathmandu, Nepal Duke Global Health Institute, Duke University, Durham, USADuke Global Health Institute, Duke University, Durham, USAHealthNetTPO, Amsterdam, the Netherlands Centre for Global Mental Health, Institute of Psychiatry, Psychology, and Neuroscience, King's College London, London, UK Background. Task-sharing is the involvement of non-specialist providers to deliver mental health services. A challenge for task-sharing programs is to achieve and maintain clinical competence of non-specialists, including primary care workers, paraprofessionals, and lay providers. We developed a tool for non-specialist peer ratings of common factors clinical competency to evaluate and optimize competence during training and supervision in global mental health task-sharing initiatives. Methods. The 18-item EN hancing A ssessment of C ommon T herapeutic factors (ENACT) tool was pilot-tested with non-specialists participating in mental health Gap Action Programme trainings in Nepal. Qualitative process evaluation was used to document development of the peer rating scoring system. Qualitative data included interviews with trainers and raters as well as transcripts of pre- and post-training observed structured clinical evaluations. Results. Five challenges for non-specialist peer ratings were identified through the process evaluation: (1) balance of training and supervision objectives with research objectives; (2) burden for peer raters due to number of scale items, number of response options, and use of behavioral counts; (3) capturing hierarchy of clinical skills; (4) objective v. subjective aspects of rating; and (5) social desirability when rating peers. Conclusion. The process culminated in five recommendations based on the key findings for the development of scales to be used by non-specialists for peer ratings in low-resource settings. Further research is needed to determine the ability of ENACT to capture the relationship of clinical competence with client outcomes and to explore the relevance of these recommendations for non-specialist peer ratings in high-resource settings. https://www.cambridge.org/core/product/identifier/S2054425115000217/type/journal_articleCompetencecultureglobal healthmeasurementtask sharingtraining |
| spellingShingle | B. A. Kohrt M. K. Ramaiya S. Rai A. Bhardwaj M. J. D Jordans Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale Cambridge Prisms: Global Mental Health Competence culture global health measurement task sharing training |
| title | Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale |
| title_full | Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale |
| title_fullStr | Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale |
| title_full_unstemmed | Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale |
| title_short | Development of a scoring system for non-specialist ratings of clinical competence in global mental health: a qualitative process evaluation of the Enhancing Assessment of Common Therapeutic Factors (ENACT) scale |
| title_sort | development of a scoring system for non specialist ratings of clinical competence in global mental health a qualitative process evaluation of the enhancing assessment of common therapeutic factors enact scale |
| topic | Competence culture global health measurement task sharing training |
| url | https://www.cambridge.org/core/product/identifier/S2054425115000217/type/journal_article |
| work_keys_str_mv | AT bakohrt developmentofascoringsystemfornonspecialistratingsofclinicalcompetenceinglobalmentalhealthaqualitativeprocessevaluationoftheenhancingassessmentofcommontherapeuticfactorsenactscale AT mkramaiya developmentofascoringsystemfornonspecialistratingsofclinicalcompetenceinglobalmentalhealthaqualitativeprocessevaluationoftheenhancingassessmentofcommontherapeuticfactorsenactscale AT srai developmentofascoringsystemfornonspecialistratingsofclinicalcompetenceinglobalmentalhealthaqualitativeprocessevaluationoftheenhancingassessmentofcommontherapeuticfactorsenactscale AT abhardwaj developmentofascoringsystemfornonspecialistratingsofclinicalcompetenceinglobalmentalhealthaqualitativeprocessevaluationoftheenhancingassessmentofcommontherapeuticfactorsenactscale AT mjdjordans developmentofascoringsystemfornonspecialistratingsofclinicalcompetenceinglobalmentalhealthaqualitativeprocessevaluationoftheenhancingassessmentofcommontherapeuticfactorsenactscale |