Managing Multiple Models

Hugh A. Chipman, Edward I. George, Robert E. McCulloch
Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics, PMLR R3:41-48, 2001.

Abstract

Recent research in model selection and adaptive modeling has produced an embarrassment of riches. By using any one of several different techniques, an analyst is able to generate a number of models that describe the same data set well. Examples include multiple tree models generated by bootstrapping or stochastic searches, and different subsets of variables in linear regression models identified by stochastic or exhaustive searches. While model averaging can use these models to improve prediction accuracy, interpretation of the resultant models becomes difficult. We seek a compromise, developing measures of dissimilarity between different models and using these to select good models which may reveal different aspects of the data. Data on housing prices in Boston are used to illustrate this in the context of treed regression models.

Cite this Paper

BibTeX
@InProceedings{pmlr-vR3-chipman01a, title = {Managing Multiple Models}, author = {Chipman, Hugh A. and George, Edward I. and McCulloch, Robert E.}, booktitle = {Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics}, pages = {41--48}, year = {2001}, editor = {Richardson, Thomas S. and Jaakkola, Tommi S.}, volume = {R3}, series = {Proceedings of Machine Learning Research}, month = {04--07 Jan}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/r3/chipman01a/chipman01a.pdf}, url = {https://proceedings.mlr.press/r3/chipman01a.html}, abstract = {Recent research in model selection and adaptive modeling has produced an embarrassment of riches. By using any one of several different techniques, an analyst is able to generate a number of models that describe the same data set well. Examples include multiple tree models generated by bootstrapping or stochastic searches, and different subsets of variables in linear regression models identified by stochastic or exhaustive searches. While model averaging can use these models to improve prediction accuracy, interpretation of the resultant models becomes difficult. We seek a compromise, developing measures of dissimilarity between different models and using these to select good models which may reveal different aspects of the data. Data on housing prices in Boston are used to illustrate this in the context of treed regression models.}, note = {Reissued by PMLR on 31 March 2021.} }
Endnote
%0 Conference Paper %T Managing Multiple Models %A Hugh A. Chipman %A Edward I. George %A Robert E. McCulloch %B Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2001 %E Thomas S. Richardson %E Tommi S. Jaakkola %F pmlr-vR3-chipman01a %I PMLR %P 41--48 %U https://proceedings.mlr.press/r3/chipman01a.html %V R3 %X Recent research in model selection and adaptive modeling has produced an embarrassment of riches. By using any one of several different techniques, an analyst is able to generate a number of models that describe the same data set well. Examples include multiple tree models generated by bootstrapping or stochastic searches, and different subsets of variables in linear regression models identified by stochastic or exhaustive searches. While model averaging can use these models to improve prediction accuracy, interpretation of the resultant models becomes difficult. We seek a compromise, developing measures of dissimilarity between different models and using these to select good models which may reveal different aspects of the data. Data on housing prices in Boston are used to illustrate this in the context of treed regression models. %Z Reissued by PMLR on 31 March 2021.
APA
Chipman, H.A., George, E.I. & McCulloch, R.E.. (2001). Managing Multiple Models. Proceedings of the Eighth International Workshop on Artificial Intelligence and Statistics, in Proceedings of Machine Learning Research R3:41-48 Available from https://proceedings.mlr.press/r3/chipman01a.html. Reissued by PMLR on 31 March 2021.

Related Material