Paired Recipient-based Evaluation of Survival Prediction for Deceased Donor Kidney Transplants

Misaki Matsuura, Mohammadreza Nemati, Dulat Bekbolsynov, Stanislaw Stepkowski, Kevin S. Xu
Proceedings of the 11th Machine Learning for Healthcare Conference, PMLR 340:1300-1320, 2026.

Abstract

There has been significant interest in using machine learning algorithms to predict kidney transplant outcomes, such as the number of years until a graft inevitably fails. These prediction algorithms could possibly be used for pre-transplant donor-recipient matching to identify more compatible donors and recipients and thus improve post-transplant outcomes. In this study, we explore the use of survival prediction models trained on deceased donor kidney transplant data from the Scientific Registry of Transplant Recipients (SRTR). We propose a novel paired recipient-based evaluation framework that compares graft outcomes between two recipients who received kidneys from the same deceased donor, allowing us to evaluate the \emph{counterfactual benefit} of changing the recipient for a certain donor. We find that five different survival prediction models, ranging in complexity from linear to deep learning-based models, all result in $\sim 60%$ paired recipient-based accuracy. We further translate this accuracy into an interpretable quantity of post-transplant years gained. We also highlight major limitations of the commonly used concordance index (C-index) metric for evaluating survival prediction accuracy in this setting and demonstrate that our proposed paired recipient-based accuracy metric is more clinically relevant and better reflects real-world allocation settings.

Cite this Paper


BibTeX
@InProceedings{pmlr-v340-matsuura26a, title = {Paired Recipient-based Evaluation of Survival Prediction for Deceased Donor Kidney Transplants}, author = {Matsuura, Misaki and Nemati, Mohammadreza and Bekbolsynov, Dulat and Stepkowski, Stanislaw and Xu, Kevin S.}, booktitle = {Proceedings of the 11th Machine Learning for Healthcare Conference}, pages = {1300--1320}, year = {2026}, editor = {Krishnan, Rahul G. and van Amsterdam, Wouter A. C. and Chopra, Sumit and Overgaard, Shauna and Hughes, Michael and Ötleş, Erkin and Shen, Yiqiu and Shanmugam, Divya and Nayan, Madhur and Engelhard, Matthew and Fackler, Jim and Oberst, Michael}, volume = {340}, series = {Proceedings of Machine Learning Research}, month = {12--14 Aug}, publisher = {PMLR}, pdf = {https://raw.githubusercontent.com/mlresearch/v340/main/assets/matsuura26a/matsuura26a.pdf}, url = {https://proceedings.mlr.press/v340/matsuura26a.html}, abstract = {There has been significant interest in using machine learning algorithms to predict kidney transplant outcomes, such as the number of years until a graft inevitably fails. These prediction algorithms could possibly be used for pre-transplant donor-recipient matching to identify more compatible donors and recipients and thus improve post-transplant outcomes. In this study, we explore the use of survival prediction models trained on deceased donor kidney transplant data from the Scientific Registry of Transplant Recipients (SRTR). We propose a novel paired recipient-based evaluation framework that compares graft outcomes between two recipients who received kidneys from the same deceased donor, allowing us to evaluate the \emph{counterfactual benefit} of changing the recipient for a certain donor. We find that five different survival prediction models, ranging in complexity from linear to deep learning-based models, all result in $\sim 60%$ paired recipient-based accuracy. We further translate this accuracy into an interpretable quantity of post-transplant years gained. We also highlight major limitations of the commonly used concordance index (C-index) metric for evaluating survival prediction accuracy in this setting and demonstrate that our proposed paired recipient-based accuracy metric is more clinically relevant and better reflects real-world allocation settings.} }
Endnote
%0 Conference Paper %T Paired Recipient-based Evaluation of Survival Prediction for Deceased Donor Kidney Transplants %A Misaki Matsuura %A Mohammadreza Nemati %A Dulat Bekbolsynov %A Stanislaw Stepkowski %A Kevin S. Xu %B Proceedings of the 11th Machine Learning for Healthcare Conference %C Proceedings of Machine Learning Research %D 2026 %E Rahul G. Krishnan %E Wouter A. C. van Amsterdam %E Sumit Chopra %E Shauna Overgaard %E Michael Hughes %E Erkin Ötleş %E Yiqiu Shen %E Divya Shanmugam %E Madhur Nayan %E Matthew Engelhard %E Jim Fackler %E Michael Oberst %F pmlr-v340-matsuura26a %I PMLR %P 1300--1320 %U https://proceedings.mlr.press/v340/matsuura26a.html %V 340 %X There has been significant interest in using machine learning algorithms to predict kidney transplant outcomes, such as the number of years until a graft inevitably fails. These prediction algorithms could possibly be used for pre-transplant donor-recipient matching to identify more compatible donors and recipients and thus improve post-transplant outcomes. In this study, we explore the use of survival prediction models trained on deceased donor kidney transplant data from the Scientific Registry of Transplant Recipients (SRTR). We propose a novel paired recipient-based evaluation framework that compares graft outcomes between two recipients who received kidneys from the same deceased donor, allowing us to evaluate the \emph{counterfactual benefit} of changing the recipient for a certain donor. We find that five different survival prediction models, ranging in complexity from linear to deep learning-based models, all result in $\sim 60%$ paired recipient-based accuracy. We further translate this accuracy into an interpretable quantity of post-transplant years gained. We also highlight major limitations of the commonly used concordance index (C-index) metric for evaluating survival prediction accuracy in this setting and demonstrate that our proposed paired recipient-based accuracy metric is more clinically relevant and better reflects real-world allocation settings.
APA
Matsuura, M., Nemati, M., Bekbolsynov, D., Stepkowski, S. & Xu, K.S.. (2026). Paired Recipient-based Evaluation of Survival Prediction for Deceased Donor Kidney Transplants. Proceedings of the 11th Machine Learning for Healthcare Conference, in Proceedings of Machine Learning Research 340:1300-1320 Available from https://proceedings.mlr.press/v340/matsuura26a.html.

Related Material