←
OxRisk84 posts
OxRisk avatar

OxRisk

@OxRisk

Freely available risk calculators from the Forensic Psychiatry and Psychology Group | @OxPsychiatry | University of Oxford. Posting updates and publications.

◷ Joined May 2021▧ 12 Photos and videos
OxRisk avatar
OxRisk@OxRisk·19 May 2021

🧵 An intro to the OxRisk tools. These are a set of simple scalable & free online tools that we've developed and validated for key adverse outcomes in psychiatry & criminal justice.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Finally, blanket statements that suicide risk prediction is not possible/accurate is not based on the latest international evidence. Repeating such blanket statements now reflect outdated information and comes across as ideological.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Another key area is more clinical studies. Notable that NICE could not find any studies that compared tools with unstructured (subjective) clinical judgement. But question is whether tools PLUS unstructured approach improve outcomes.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Focus of research should shift more towards external validation of existing models, head-to-head comparisons, and model updating and extension. Important to prioritise methodological rigour. Complete, accurate, and transparent reporting is key.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Most limitations of current research are avoidable issues in study design, conduct, and analysis. Also, many models have no intention for clinical use (unclear target populations and settings, prediction horizon, when to be used). Some impossible to use prospectively.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

But field also involves significant research waste. Oversupply of unvalidated prediction models addressing similar research questions. Often developed w/ sub-optimal methods, poorly reported.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Many of the identified models showed good discriminative ability (similar to models in other areas of medicine). Identified 5 models with good discrimination and calibration performance in external validation.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

What does it all mean? Our findings show that pessimism about the feasibility of suicide risk prediction is NOT evidence-based.

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

👉OxMIS: predicts 1-year risk of suicide in individuals with severe mental illness 👉Four models by Simon et al: predict 90-day risk of suicide attempt and death following secondary mental health and general medicine care

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

We identified 5 models with good discrimination and calibration performance in external validation👇

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Most common methodological problems were incomplete assessment of performance (ignoring calibration), insufficient sample sizes, reporting/handling missing data, not adequately accounting for overfitting, optimism in performance estimates.

Post attachment
OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

All development studies, and all but two external validations, were at high risk of bias (using PROBAST tool).

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

Only 17% of models presented in a way allowing for independent validation/use by others. For remaining models, authors not provide sufficient information to allow predictions in new individuals.

Post attachment
OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

But calibration only assessed for 9% of models in development studies and 31% of external validations (and sometimes assessed incorrectly).

OxRisk avatar
OxRisk@OxRisk·16 Oct 2025

One measure of performance – the C index – was reported widely. Ranged from 0.61-0.97 (median 0.82) in development studies and 0.60-0.86 (median 0.81) in external validations. Comparable to models in other areas of medicine (cardiovascular, respiratory, COVID19).

Post attachment