External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects

Abstract Background In 2020, a research group published five linear longitudinal models, predict Expanded Prostate Cancer Index Composite-26 (EPIC-26) scores post-treatment for radical prostatectomy, external beam radiotherapy and active surveillance collectively in US patients with localized prosta...

Full description

Bibliographic Details
Main Authors: Matthew A. Borg, Michael E. O’Callaghan, Kim L. Moretti, Andrew D. Vincent
Format: Article
Language:English
Published: BMC 2024-01-01
Series:BMC Urology
Subjects:
Online Access:https://doi.org/10.1186/s12894-023-01373-9
_version_ 1797362848570015744
author Matthew A. Borg
Michael E. O’Callaghan
Kim L. Moretti
Andrew D. Vincent
author_facet Matthew A. Borg
Michael E. O’Callaghan
Kim L. Moretti
Andrew D. Vincent
author_sort Matthew A. Borg
collection DOAJ
description Abstract Background In 2020, a research group published five linear longitudinal models, predict Expanded Prostate Cancer Index Composite-26 (EPIC-26) scores post-treatment for radical prostatectomy, external beam radiotherapy and active surveillance collectively in US patients with localized prostate cancer. Methods Our study externally validates the five prediction models for patient reported outcomes post-surgery for localised prostate cancer. The models’ calibration, fit, variance explained and discrimination (concordance-indices) were assessed. Two Australian validation cohorts 1 and 2 years post-prostatectomy were constructed, consisting of 669 and 439 subjects, respectively (750 in total). Patient reported function in five domains post-prostatectomy: sexual, bowel, hormonal, urinary incontinence and other urinary dysfunction (irritation/obstruction). Domain function was assessed using the EPIC-26 questionnaire. Results 1 year post-surgery, R2 was highest for the sexual domain (35%, SD = 0.02), lower for the bowel (21%, SD = 0.03) and hormone (15%, SD = 0.03) domains, and close to zero for urinary incontinence (1%, SD = 0.01) and irritation/obstruction (− 5%, SD = 0.04). Calibration slopes for these five models were 1.04 (SD = 0.04), 0.84 (SD = 0.06), 0.85 (SD = 0.06), 1.16 (SD = 0.13) and 0.45 (SD = 0.04), respectively. Calibration-in-the-large values were − 2.2 (SD = 0.6), 2.1 (SD = 0.01), 5.1 (SD = 0.1), 9.6 (SD = 0.9) and 4.0 (SD = 0.2), respectively. Concordance-indices were 0.73, 0.70, 0.70, 0.58 and 0.62, respectively (all had SD = 0.01). Mean absolute error and root mean square error were similar across the validation and development cohorts. The validation measures were largely similar at 2 years post-surgery. Conclusions The sexual, bowel and hormone domain models validated well and show promise for accurately predicting patient reported outcomes in a non-US surgical population. The urinary domain models validated poorly and may require recalibration or revision.
first_indexed 2024-03-08T16:13:19Z
format Article
id doaj.art-64254c82d5784de5b2330dc25757a334
institution Directory Open Access Journal
issn 1471-2490
language English
last_indexed 2024-03-08T16:13:19Z
publishDate 2024-01-01
publisher BMC
record_format Article
series BMC Urology
spelling doaj.art-64254c82d5784de5b2330dc25757a3342024-01-07T12:48:47ZengBMCBMC Urology1471-24902024-01-012411810.1186/s12894-023-01373-9External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjectsMatthew A. Borg0Michael E. O’Callaghan1Kim L. Moretti2Andrew D. Vincent3School of Public Health, University of AdelaideUrology Unit, Flinders Medical CentreSouth Australian Prostate Cancer Clinical Outcomes CollaborativeFreemasons Centre for Male Health & Wellbeing, University of AdelaideAbstract Background In 2020, a research group published five linear longitudinal models, predict Expanded Prostate Cancer Index Composite-26 (EPIC-26) scores post-treatment for radical prostatectomy, external beam radiotherapy and active surveillance collectively in US patients with localized prostate cancer. Methods Our study externally validates the five prediction models for patient reported outcomes post-surgery for localised prostate cancer. The models’ calibration, fit, variance explained and discrimination (concordance-indices) were assessed. Two Australian validation cohorts 1 and 2 years post-prostatectomy were constructed, consisting of 669 and 439 subjects, respectively (750 in total). Patient reported function in five domains post-prostatectomy: sexual, bowel, hormonal, urinary incontinence and other urinary dysfunction (irritation/obstruction). Domain function was assessed using the EPIC-26 questionnaire. Results 1 year post-surgery, R2 was highest for the sexual domain (35%, SD = 0.02), lower for the bowel (21%, SD = 0.03) and hormone (15%, SD = 0.03) domains, and close to zero for urinary incontinence (1%, SD = 0.01) and irritation/obstruction (− 5%, SD = 0.04). Calibration slopes for these five models were 1.04 (SD = 0.04), 0.84 (SD = 0.06), 0.85 (SD = 0.06), 1.16 (SD = 0.13) and 0.45 (SD = 0.04), respectively. Calibration-in-the-large values were − 2.2 (SD = 0.6), 2.1 (SD = 0.01), 5.1 (SD = 0.1), 9.6 (SD = 0.9) and 4.0 (SD = 0.2), respectively. Concordance-indices were 0.73, 0.70, 0.70, 0.58 and 0.62, respectively (all had SD = 0.01). Mean absolute error and root mean square error were similar across the validation and development cohorts. The validation measures were largely similar at 2 years post-surgery. Conclusions The sexual, bowel and hormone domain models validated well and show promise for accurately predicting patient reported outcomes in a non-US surgical population. The urinary domain models validated poorly and may require recalibration or revision.https://doi.org/10.1186/s12894-023-01373-9Prostate cancerProstatectomyPatient-reported outcomesExternal validation
spellingShingle Matthew A. Borg
Michael E. O’Callaghan
Kim L. Moretti
Andrew D. Vincent
External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
BMC Urology
Prostate cancer
Prostatectomy
Patient-reported outcomes
External validation
title External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
title_full External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
title_fullStr External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
title_full_unstemmed External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
title_short External validation of predictive models of sexual, urinary, bowel and hormonal function after surgery in prostate cancer subjects
title_sort external validation of predictive models of sexual urinary bowel and hormonal function after surgery in prostate cancer subjects
topic Prostate cancer
Prostatectomy
Patient-reported outcomes
External validation
url https://doi.org/10.1186/s12894-023-01373-9
work_keys_str_mv AT matthewaborg externalvalidationofpredictivemodelsofsexualurinarybowelandhormonalfunctionaftersurgeryinprostatecancersubjects
AT michaeleocallaghan externalvalidationofpredictivemodelsofsexualurinarybowelandhormonalfunctionaftersurgeryinprostatecancersubjects
AT kimlmoretti externalvalidationofpredictivemodelsofsexualurinarybowelandhormonalfunctionaftersurgeryinprostatecancersubjects
AT andrewdvincent externalvalidationofpredictivemodelsofsexualurinarybowelandhormonalfunctionaftersurgeryinprostatecancersubjects