The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale
Abstract Background Side effects in psychotherapy are common and have a negative impact on patients or clients. However, effective evaluation tools are still lacking and have not been fully studied. The present study aims to develop a scale with good reliability and validity to measure the side effe...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2023-02-01
|
| Series: | Brain and Behavior |
| Subjects: | |
| Online Access: | https://doi.org/10.1002/brb3.2885 |
| _version_ | 1811164273916772352 |
|---|---|
| author | Chen Fazhan Liu Liang Zhao Xudong Feng Qiang Ge Congcong Zhao Yunhan |
| author_facet | Chen Fazhan Liu Liang Zhao Xudong Feng Qiang Ge Congcong Zhao Yunhan |
| author_sort | Chen Fazhan |
| collection | DOAJ |
| description | Abstract Background Side effects in psychotherapy are common and have a negative impact on patients or clients. However, effective evaluation tools are still lacking and have not been fully studied. The present study aims to develop a scale with good reliability and validity to measure the side effects of psychotherapy. Methods The 25 items in the Psychotherapy Side Effects Scale (PSES) were condensed and distributed to 420 subjects online to test its psychometric properties. Results The internal consistency of the PSES was satisfactory to excellent (Cronbach's ɑ coefficient was .95, and the Guttman split‐half coefficient was 0.88). A statistically significant negative correlation between the satisfaction score and the total score of the PSES was shown (r = −0.51, p < .001). The PSES could effectively discriminate between two groups with and without side effects (F = 250.95, p < .001) and was able to predict the occurrence of side effects in psychotherapy with an area under curve of 0.932 and a 95% confidence interval of 0.900–0.964 (p < .001). A cutoff was set at 36 points in total PSES score, from which the maximum Youden's index (= 0.72) could be obtained. The positive rate of the PSES was 24% (101/420). Conclusion The PSES showed good internal consistency, content validity, concurrent validity, discriminant validity and predictive validity in evaluating and identifying side effects in psychotherapy. More advanced reliability testing methods and structural validity testing for PESE need to be practiced in the future to better serve clinical practice. |
| first_indexed | 2024-04-10T15:18:53Z |
| format | Article |
| id | doaj.art-f5060bc33b7042d8bd942eb4aacf58da |
| institution | Directory Open Access Journal |
| issn | 2162-3279 |
| language | English |
| last_indexed | 2024-04-10T15:18:53Z |
| publishDate | 2023-02-01 |
| publisher | Wiley |
| record_format | Article |
| series | Brain and Behavior |
| spelling | doaj.art-f5060bc33b7042d8bd942eb4aacf58da2023-02-14T16:52:41ZengWileyBrain and Behavior2162-32792023-02-01132n/an/a10.1002/brb3.2885The preliminary development and psychometric properties of the Psychotherapy Side Effects ScaleChen Fazhan0Liu Liang1Zhao Xudong2Feng Qiang3Ge Congcong4Zhao Yunhan5Clinical Research Center for Mental Disorders, Chinese‐German Institute of Mental Health, Shanghai Pudong New Area Mental Health Center, School of Medicine Tongji University Shanghai P.R. ChinaClinical Research Center for Mental Disorders, Chinese‐German Institute of Mental Health, Shanghai Pudong New Area Mental Health Center, School of Medicine Tongji University Shanghai P.R. ChinaClinical Research Center for Mental Disorders, Chinese‐German Institute of Mental Health, Shanghai Pudong New Area Mental Health Center, School of Medicine Tongji University Shanghai P.R. ChinaDepartment of Clinical Psychology, Shanghai East Hospital, School of Medicine Tongji University Shanghai P.R. ChinaClinical Research Center for Mental Disorders, Chinese‐German Institute of Mental Health, Shanghai Pudong New Area Mental Health Center, School of Medicine Tongji University Shanghai P.R. ChinaClinical Research Center for Mental Disorders, Chinese‐German Institute of Mental Health, Shanghai Pudong New Area Mental Health Center, School of Medicine Tongji University Shanghai P.R. ChinaAbstract Background Side effects in psychotherapy are common and have a negative impact on patients or clients. However, effective evaluation tools are still lacking and have not been fully studied. The present study aims to develop a scale with good reliability and validity to measure the side effects of psychotherapy. Methods The 25 items in the Psychotherapy Side Effects Scale (PSES) were condensed and distributed to 420 subjects online to test its psychometric properties. Results The internal consistency of the PSES was satisfactory to excellent (Cronbach's ɑ coefficient was .95, and the Guttman split‐half coefficient was 0.88). A statistically significant negative correlation between the satisfaction score and the total score of the PSES was shown (r = −0.51, p < .001). The PSES could effectively discriminate between two groups with and without side effects (F = 250.95, p < .001) and was able to predict the occurrence of side effects in psychotherapy with an area under curve of 0.932 and a 95% confidence interval of 0.900–0.964 (p < .001). A cutoff was set at 36 points in total PSES score, from which the maximum Youden's index (= 0.72) could be obtained. The positive rate of the PSES was 24% (101/420). Conclusion The PSES showed good internal consistency, content validity, concurrent validity, discriminant validity and predictive validity in evaluating and identifying side effects in psychotherapy. More advanced reliability testing methods and structural validity testing for PESE need to be practiced in the future to better serve clinical practice.https://doi.org/10.1002/brb3.2885psychometric propertiespsychotherapypsychotherapy side effects scaleside effects |
| spellingShingle | Chen Fazhan Liu Liang Zhao Xudong Feng Qiang Ge Congcong Zhao Yunhan The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale Brain and Behavior psychometric properties psychotherapy psychotherapy side effects scale side effects |
| title | The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale |
| title_full | The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale |
| title_fullStr | The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale |
| title_full_unstemmed | The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale |
| title_short | The preliminary development and psychometric properties of the Psychotherapy Side Effects Scale |
| title_sort | preliminary development and psychometric properties of the psychotherapy side effects scale |
| topic | psychometric properties psychotherapy psychotherapy side effects scale side effects |
| url | https://doi.org/10.1002/brb3.2885 |
| work_keys_str_mv | AT chenfazhan thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT liuliang thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT zhaoxudong thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT fengqiang thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT gecongcong thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT zhaoyunhan thepreliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT chenfazhan preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT liuliang preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT zhaoxudong preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT fengqiang preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT gecongcong preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale AT zhaoyunhan preliminarydevelopmentandpsychometricpropertiesofthepsychotherapysideeffectsscale |