Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)

Oxford Mental Illness and Suicide tool (OxMIS) is a standardised, scalable, and transparent instrument for suicide risk assessment in people with severe mental illness (SMI) based on 17 sociodemographic, criminal history, familial, and clinical risk factors. However, alongside most prediction models...

Full description

Bibliographic Details
Main Authors: Sariaslan, A, Fanshawe, T, Pitkänen, J, Cipriani, A, Martikainen, P, Fazel, S
Format: Journal article
Language:English
Published: Springer Nature 2023
_version_ 1826310234131398656
author Sariaslan, A
Fanshawe, T
Pitkänen, J
Cipriani, A
Martikainen, P
Fazel, S
author_facet Sariaslan, A
Fanshawe, T
Pitkänen, J
Cipriani, A
Martikainen, P
Fazel, S
author_sort Sariaslan, A
collection OXFORD
description Oxford Mental Illness and Suicide tool (OxMIS) is a standardised, scalable, and transparent instrument for suicide risk assessment in people with severe mental illness (SMI) based on 17 sociodemographic, criminal history, familial, and clinical risk factors. However, alongside most prediction models in psychiatry, external validations are currently lacking. We utilised a Finnish population sample of all persons diagnosed by mental health services with SMI (schizophrenia-spectrum and bipolar disorders) between 1996 and 2017 (n = 137,112). To evaluate the performance of OxMIS, we initially calculated the predicted 12-month suicide risk for each individual by weighting risk factors by effect sizes reported in the original OxMIS prediction model and converted to a probability. This probability was then used to assess the discrimination and calibration of the OxMIS model in this external sample. Within a year of assessment, 1.1% of people with SMI (n = 1475) had died by suicide. The overall discrimination of the tool was good, with an area under the curve of 0.70 (95% confidence interval: 0.69–0.71). The model initially overestimated suicide risks in those with elevated predicted risks of >5% over 12 months (Harrell’s Emax = 0.114), which applied to 1.3% (n = 1780) of the cohort. However, when we used a 5% maximum predicted suicide risk threshold as is recommended clinically, the calibration was excellent (ICI = 0.002; Emax = 0.005). Validating clinical prediction tools using routinely collected data can address research gaps in prediction psychiatry and is a necessary step to translating such models into clinical practice.
first_indexed 2024-03-07T07:47:25Z
format Journal article
id oxford-uuid:bca5517a-8d86-47ab-817f-dca0527bcfa3
institution University of Oxford
language English
last_indexed 2024-03-07T07:47:25Z
publishDate 2023
publisher Springer Nature
record_format dspace
spelling oxford-uuid:bca5517a-8d86-47ab-817f-dca0527bcfa32023-06-21T15:16:01ZPredicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:bca5517a-8d86-47ab-817f-dca0527bcfa3EnglishSymplectic ElementsSpringer Nature2023Sariaslan, AFanshawe, TPitkänen, JCipriani, AMartikainen, PFazel, SOxford Mental Illness and Suicide tool (OxMIS) is a standardised, scalable, and transparent instrument for suicide risk assessment in people with severe mental illness (SMI) based on 17 sociodemographic, criminal history, familial, and clinical risk factors. However, alongside most prediction models in psychiatry, external validations are currently lacking. We utilised a Finnish population sample of all persons diagnosed by mental health services with SMI (schizophrenia-spectrum and bipolar disorders) between 1996 and 2017 (n = 137,112). To evaluate the performance of OxMIS, we initially calculated the predicted 12-month suicide risk for each individual by weighting risk factors by effect sizes reported in the original OxMIS prediction model and converted to a probability. This probability was then used to assess the discrimination and calibration of the OxMIS model in this external sample. Within a year of assessment, 1.1% of people with SMI (n = 1475) had died by suicide. The overall discrimination of the tool was good, with an area under the curve of 0.70 (95% confidence interval: 0.69–0.71). The model initially overestimated suicide risks in those with elevated predicted risks of >5% over 12 months (Harrell’s Emax = 0.114), which applied to 1.3% (n = 1780) of the cohort. However, when we used a 5% maximum predicted suicide risk threshold as is recommended clinically, the calibration was excellent (ICI = 0.002; Emax = 0.005). Validating clinical prediction tools using routinely collected data can address research gaps in prediction psychiatry and is a necessary step to translating such models into clinical practice.
spellingShingle Sariaslan, A
Fanshawe, T
Pitkänen, J
Cipriani, A
Martikainen, P
Fazel, S
Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title_full Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title_fullStr Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title_full_unstemmed Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title_short Predicting suicide risk in 137,112 people with severe mental illness in Finland: external validation of the Oxford Mental Illness and Suicide tool (OxMIS)
title_sort predicting suicide risk in 137 112 people with severe mental illness in finland external validation of the oxford mental illness and suicide tool oxmis
work_keys_str_mv AT sariaslana predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis
AT fanshawet predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis
AT pitkanenj predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis
AT cipriania predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis
AT martikainenp predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis
AT fazels predictingsuicideriskin137112peoplewithseverementalillnessinfinlandexternalvalidationoftheoxfordmentalillnessandsuicidetooloxmis