Beta Survival Models

David Hubbard, Benoit Rostykus, Yves Raimond, Tony Jebara
Proceedings of AAAI Spring Symposium on Survival Prediction - Algorithms, Challenges, and Applications 2021, PMLR 146:22-39, 2021.

Abstract

Survival modeling is an important area of study, and has been used widely in many applications including clinical research, online advertising, manufacturing, etc. There are many methods to consider when analyzing survival problems, however these techniques generally focus on either estimating the uncertainty of different risk factors (cox-proportional hazards, etc), or predicting the time to event in a non-parametric way (e.g. tree based methods), or forecasting the survival beyond an observed horizon (parametric techniques such as exponential). In this work, we introduce efficient estimation methods for linear, tree, and neural network versions of the Beta-Logistic model - a classical extension of the logistic function into the discrete survival setting. The Beta-Logistic allows for recovery of the underlying beta distribution as well as having the advantages of non-linear or tree based techniques while still allowing for projecting beyond an observed horizon. Empirical results using simulated data as well as large-scale data-sets across three use-cases (online conversions, retention modeling in a subscription service, and survival of democracies and dictatorships), demonstrate the competitiveness of the method at these tasks. The simplicity of the method and its ability to capture skew in the data makes it a viable alternative to standard techniques particularly when we are interested in forecasting time to event beyond our observed horizon and when the underlying probabilities are heterogeneous.

Cite this Paper


BibTeX
@InProceedings{pmlr-v146-hubbard21a, title = {Beta Survival Models}, author = {Hubbard, David and Rostykus, Benoit and Raimond, Yves and Jebara, Tony}, booktitle = {Proceedings of AAAI Spring Symposium on Survival Prediction - Algorithms, Challenges, and Applications 2021}, pages = {22--39}, year = {2021}, editor = {Greiner, Russell and Kumar, Neeraj and Gerds, Thomas Alexander and van der Schaar, Mihaela}, volume = {146}, series = {Proceedings of Machine Learning Research}, month = {22--24 Mar}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v146/hubbard21a/hubbard21a.pdf}, url = {https://proceedings.mlr.press/v146/hubbard21a.html}, abstract = {Survival modeling is an important area of study, and has been used widely in many applications including clinical research, online advertising, manufacturing, etc. There are many methods to consider when analyzing survival problems, however these techniques generally focus on either estimating the uncertainty of different risk factors (cox-proportional hazards, etc), or predicting the time to event in a non-parametric way (e.g. tree based methods), or forecasting the survival beyond an observed horizon (parametric techniques such as exponential). In this work, we introduce efficient estimation methods for linear, tree, and neural network versions of the Beta-Logistic model - a classical extension of the logistic function into the discrete survival setting. The Beta-Logistic allows for recovery of the underlying beta distribution as well as having the advantages of non-linear or tree based techniques while still allowing for projecting beyond an observed horizon. Empirical results using simulated data as well as large-scale data-sets across three use-cases (online conversions, retention modeling in a subscription service, and survival of democracies and dictatorships), demonstrate the competitiveness of the method at these tasks. The simplicity of the method and its ability to capture skew in the data makes it a viable alternative to standard techniques particularly when we are interested in forecasting time to event beyond our observed horizon and when the underlying probabilities are heterogeneous.} }
Endnote
%0 Conference Paper %T Beta Survival Models %A David Hubbard %A Benoit Rostykus %A Yves Raimond %A Tony Jebara %B Proceedings of AAAI Spring Symposium on Survival Prediction - Algorithms, Challenges, and Applications 2021 %C Proceedings of Machine Learning Research %D 2021 %E Russell Greiner %E Neeraj Kumar %E Thomas Alexander Gerds %E Mihaela van der Schaar %F pmlr-v146-hubbard21a %I PMLR %P 22--39 %U https://proceedings.mlr.press/v146/hubbard21a.html %V 146 %X Survival modeling is an important area of study, and has been used widely in many applications including clinical research, online advertising, manufacturing, etc. There are many methods to consider when analyzing survival problems, however these techniques generally focus on either estimating the uncertainty of different risk factors (cox-proportional hazards, etc), or predicting the time to event in a non-parametric way (e.g. tree based methods), or forecasting the survival beyond an observed horizon (parametric techniques such as exponential). In this work, we introduce efficient estimation methods for linear, tree, and neural network versions of the Beta-Logistic model - a classical extension of the logistic function into the discrete survival setting. The Beta-Logistic allows for recovery of the underlying beta distribution as well as having the advantages of non-linear or tree based techniques while still allowing for projecting beyond an observed horizon. Empirical results using simulated data as well as large-scale data-sets across three use-cases (online conversions, retention modeling in a subscription service, and survival of democracies and dictatorships), demonstrate the competitiveness of the method at these tasks. The simplicity of the method and its ability to capture skew in the data makes it a viable alternative to standard techniques particularly when we are interested in forecasting time to event beyond our observed horizon and when the underlying probabilities are heterogeneous.
APA
Hubbard, D., Rostykus, B., Raimond, Y. & Jebara, T.. (2021). Beta Survival Models. Proceedings of AAAI Spring Symposium on Survival Prediction - Algorithms, Challenges, and Applications 2021, in Proceedings of Machine Learning Research 146:22-39 Available from https://proceedings.mlr.press/v146/hubbard21a.html.

Related Material