Practical guideMethodology & analyticsMedicine & healthcare

TRIPOD+AI: reporting a clinical prediction model, including machine learning models

A prediction model that combines several variables to estimate a diagnosis or outcome needs different reporting from a single diagnostic test. This guide explains what TRIPOD+AI asks you to report, where it covers both regression and machine learning models, and where it reaches its limits.

What you will learn

  • Explain what TRIPOD+AI is and why it extends the original TRIPOD statement to machine learning models
  • Distinguish model development, internal validation and external validation studies and what each must report
  • Report model performance (discrimination, calibration) in terms a reader can judge for applicability
  • Recognise where TRIPOD+AI stops and a diagnostic accuracy or outcome trial guideline is needed instead
  • Compare a thin prediction-model report against one written to TRIPOD+AI

What you will unlearn

  • A high area-under-the-curve is enough to report for a prediction model.TRIPOD+AI expects discrimination and calibration to be reported together, since a model can discriminate well yet still produce poorly calibrated probabilities.
  • Reporting standards for machine learning models need to be entirely different from statistical models.TRIPOD+AI is explicitly written to cover both regression-based and machine learning prediction models, sharing most items between the two.
  • A model that performs well on the data used to build it will perform well elsewhere.TRIPOD+AI distinguishes development, internal validation and external validation precisely because performance typically drops when a model is tested on new data.
  • TRIPOD+AI applies to any study that uses a statistical or machine learning model.It applies specifically to models that predict an individual's diagnosis or outcome; models used only to test an association between two variables need STROBE instead.

Skills you will practise

  • Distinguishing development from validation studies
  • Reporting discrimination and calibration
  • Describing model inputs and missing data handling
  • Reporting on machine learning pipelines
  • Judging model applicability

What TRIPOD+AI is and who maintains it

TRIPOD+AI, Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis, including artificial intelligence, is an updated reporting guideline for studies that develop or validate a model predicting an individual's diagnosis or prognosis from multiple predictors. It extends the original 2015 TRIPOD statement to explicitly cover machine learning models alongside conventional regression models, and was developed by a large international group of methodologists, clinicians and data scientists (Collins et al., 2024).

The checklist covers the title and abstract, introduction, methods (source of data, participants, outcome, predictors, sample size, missing data, the statistical or machine learning analysis, and how performance was evaluated), results and discussion. A key item throughout is stating clearly whether the study develops a new model, validates an existing model, or does both.

Why it exists

A prediction model is often reported with a single headline number, such as an area under the curve of 0.85, which on its own tells a reader almost nothing about whether the model is ready for use. Readers need to know how the model was built, on what data, whether it was tested on data it had not seen, and how well its predicted probabilities matched what actually happened, not only how well it ranked patients from higher to lower risk.

Machine learning models raise this problem again in a sharper form, because flexible algorithms can fit patterns in the training data that do not generalise, and because reporting practices around data splitting, feature selection and hyperparameter tuning have historically been inconsistent. TRIPOD+AI exists to bring the same discipline that TRIPOD brought to regression models to this wider class of methods.

A further, specific risk with flexible models is data leakage: information from the data used to test a model inadvertently influencing how it was built, for example when feature selection or hyperparameter tuning is carried out on the whole dataset before splitting it into training and test sets. Leakage of this kind inflates apparent performance in a way that can be almost invisible unless the modelling pipeline is reported step by step, which is exactly what TRIPOD+AI's methods items ask for.

Which studies it fits

The guideline also covers model updating, where an existing model is recalibrated or extended for a new population rather than built from scratch; this is treated as its own category because the reporting needs are different again from either a fresh development or a straightforward external validation.

TRIPOD+AI applies to any study that develops, validates or updates a multivariable model to predict an individual's probability of having a condition now (diagnostic prediction) or developing one in the future (prognostic prediction), whether the model is a logistic regression, a Cox model, a random forest, a neural network or another machine learning method.

TRIPOD+AI reporting expectations by study type
Study typeWhat it reportsTRIPOD+AI expectation
DevelopmentBuilding a new model from a datasetFull detail on predictors, outcome definition, sample size, handling of missing data and model-building steps
Internal validationTesting performance on data from the same source, e.g. by cross-validation or bootstrappingThe validation method used and whether it accounts for the full model-building process, including any feature selection
External validationTesting an existing model on an independent datasetHow the validation population differs from the development population, and performance in that new setting
Development and validation combinedBoth steps reported in one paperClear separation of development and validation results, not a single blended performance figure

Where TRIPOD+AI does not apply

TRIPOD+AI is for models that predict an individual outcome from multiple predictors, and it should not be used for a study that simply tests whether one exposure is associated with one outcome; that is an observational association study and belongs under STROBE instead (von Elm et al., 2007). It also does not apply to a study evaluating a single index test's accuracy against a reference standard with no combination of predictors, which belongs under STARD (Bossuyt et al., 2015).

A trial that tests whether using a prediction model in clinical practice changes patient outcomes, as opposed to a study that reports the model's statistical performance, is an intervention study and should be reported with CONSORT and its relevant extension, since the question being asked (does using the model help patients) is different from the question TRIPOD+AI reporting answers (how accurate is the model).

It is worth separating these two questions explicitly in a doctoral thesis, because they are often run together in a single chapter. Showing that a model is accurate is a necessary step before testing whether using it changes care, but accuracy alone does not establish that acting on the model's output improves outcomes; that claim needs its own, separate study design.

Why it matters

Prediction models that look promising on paper very often perform worse when tested on new data, and many published models are never properly externally validated before being proposed for use. Reporting that is complete enough to show exactly how a model was built and evaluated is what lets other researchers attempt an external validation at all; a model whose predictors, coding and thresholds are not fully specified cannot be reproduced by anyone else. The same indirectness concerns that apply to diagnostic accuracy studies apply here too: a model built on one population may not transfer to another, which frameworks such as GRADE take into account when rating how much confidence to place in model-based evidence (Guyatt et al., 2008).

How it is applied in practice

Journals publishing clinical prediction model research increasingly require a completed TRIPOD or TRIPOD+AI checklist at submission, and some now explicitly ask authors to state whether their model has been externally validated and, if not, to justify why it is being reported before that step. Sharing code and, where governance allows, data following the FAIR principles is increasingly expected alongside the written report, since a prediction model is, in practice, a piece of software as well as a set of coefficients, and independent testing usually needs access to it (Wilkinson et al., 2016).

For a doctoral researcher, the most common mistake is reporting a model's internal performance (how it does on the data used to build it) as if it were external validation; TRIPOD+AI's insistence on stating the study type up front is a direct response to this confusion.

Where a doctoral project plans to develop a model and validate it on a separate dataset, deciding and recording the analysis plan, including which predictors will be tried and how performance will be measured, before looking at the validation data serves the same purpose that a registered protocol serves for a trial: it keeps a clear line between what was planned and what was found after the fact (Nosek et al., 2018).

An illustrative example

The passage below is a hypothetical illustration, not a quotation from a published study.

Illustrative before-and-after reporting against TRIPOD+AI (hypothetical model)
ElementWithout TRIPOD+AIWith TRIPOD+AI
Study type"We built and tested a model to predict readmission.""This is a model development study with internal validation by 10-fold cross-validation, repeated 100 times; no external validation was performed."
Predictors"Clinical and demographic variables were used.""Twelve predictors were included, selected before model fitting based on prior literature; each is listed with its definition, timing of measurement and how missing values were handled (multiple imputation, 20 datasets)."
Model"A machine learning model was trained.""A gradient-boosted tree model (XGBoost, version 2.0) was trained with hyperparameters tuned by nested cross-validation; the final model and code are available in a public repository."
Performance"The model achieved an AUC of 0.85.""Discrimination (C-statistic 0.85, 95% CI 0.81–0.89) and calibration (calibration plot and slope, 0.94) are reported together, with performance also reported separately for the internal validation folds."
ApplicabilityNot discussed"The development cohort was drawn from a single urban tertiary hospital; performance in other settings, such as rural or paediatric populations, has not been tested."

What to check before you submit

  • Does the title or abstract state plainly whether this is a development, validation or combined study?
  • Are all predictors defined, with their timing of measurement and how missing values were handled?
  • Is the model, including its final form or code, reported in enough detail for another researcher to apply it?
  • Are both discrimination and calibration reported, not discrimination alone?
  • Is the development or validation population described well enough to judge applicability elsewhere?
  • If internal validation was used, does it account for the full model-building process, including any feature selection or tuning?
  • Official checklist and source: TRIPOD Statement (tripod-statement.org) .

Key takeaways

  • TRIPOD+AI reports how a multivariable prediction model, regression-based or machine learning, was developed and validated (Collins et al., 2024).
  • It exists because headline statistics such as a single AUC do not show how well a model will perform on new data or new populations.
  • It fits prediction models with multiple predictors; single-test accuracy studies use STARD (Bossuyt et al., 2015) and single-exposure association studies use STROBE (von Elm et al., 2007).
  • Development and validation performance should always be reported and labelled separately, never blended.
  • Sharing the model's code and data, where governance allows, follows FAIR principles and is often what makes external validation possible (Wilkinson et al., 2016).
  • Fixing the analysis plan before looking at validation data protects against the same hindsight problem preregistration addresses in other designs (Nosek et al., 2018).
Your next step

Want to apply this to your own study?

  1. 1Tell us your topic, data and deadline
  2. 2A subject mentor reviews your work with you
  3. 3You get a plan and a quote
Big data analytics

References

  1. Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., Kressel, H. Y., Rifai, N., Golub, R. M., Altman, D. G., Hooft, L., Korevaar, D. A., & Cohen, J. F., for the STARD Group. (2015). STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies. BMJ, 351, h5527. https://doi.org/10.1136/bmj.h5527
  2. Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., van Smeden, M., Boulesteix, A.-L., Camaradou, J. C., Celi, L. A., Denaxas, S., Denniston, A. K., Glocker, B., Golub, R. M., Harvey, H., Heinze, G., . . . Logullo, P. (2024). TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ, 385, e078378. https://doi.org/10.1136/bmj-2023-078378
  3. Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008). GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ, 336(7650), 924–926. https://doi.org/10.1136/bmj.39489.470347.AD
  4. Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600–2606. https://doi.org/10.1073/pnas.1708274114
  5. von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007). The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. The Lancet, 370(9596), 1453–1457. https://doi.org/10.1016/S0140-6736(07)61602-X
  6. Wilkinson, M. D., Dumontier, M., Aalbersberg, I. J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., Bonino da Silva Santos, L., Bourne, P. E., Bouwman, J., Brookes, A. J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C. T., Finkers, R., . . . Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3, 160018. https://doi.org/10.1038/sdata.2016.18

How to cite this article

Choose your referencing style, then copy. Check your university's or journal's guide for local variations.

PhD Research Lab Academy. (2026, October 8). TRIPOD+AI: reporting a clinical prediction model, including machine learning models. PhD Research Lab. https://www.phdassistance.com/academy/guidelines/tripod-ai/

PhD Research Lab Academy. “TRIPOD+AI: Reporting a Clinical Prediction Model, Including Machine Learning Models.” PhD Research Lab, 8 Oct. 2026, www.phdassistance.com/academy/guidelines/tripod-ai. Accessed [access date].

PhD Research Lab Academy (2026) TRIPOD+AI: reporting a clinical prediction model, including machine learning models. PhD Research Lab. Available at: https://www.phdassistance.com/academy/guidelines/tripod-ai/ (Accessed: [access date]).

PhD Research Lab Academy. “TRIPOD+AI: Reporting a Clinical Prediction Model, Including Machine Learning Models.” PhD Research Lab. October 8, 2026. https://www.phdassistance.com/academy/guidelines/tripod-ai.

PhD Research Lab Academy, ‘TRIPOD+AI: Reporting a Clinical Prediction Model, Including Machine Learning Models’ (PhD Research Lab, 8 October 2026) <https://www.phdassistance.com/academy/guidelines/tripod-ai> accessed [access date].

PhD Research Lab Academy. TRIPOD+AI: reporting a clinical prediction model, including machine learning models [Internet]. PhD Research Lab; 2026 Oct 8 [cited [access date]]. Available from: https://www.phdassistance.com/academy/guidelines/tripod-ai/

PhD Research Lab Academy, “TRIPOD+AI: reporting a clinical prediction model, including machine learning models,” PhD Research Lab, Oct. 8, 2026. [Online]. Available: https://www.phdassistance.com/academy/guidelines/tripod-ai. [Accessed: [access date]].

@online{guideline_tripod_ai_2026,
  author = {{PhD Research Lab Academy}},
  title = {{TRIPOD+AI: reporting a clinical prediction model, including machine learning models}},
  organization = {PhD Research Lab},
  date = {2026-10-08},
  url = {https://www.phdassistance.com/academy/guidelines/tripod-ai},
  urldate = {[access date]}
}

This article is for learning. Use it to understand the method and cite the original sources above in your own work; do not copy or submit it as your own.

TRIPOD+AINeed help applying it to your study?
Big data analytics