Adaptive truncated residual regression for fine-grained regression problems

Hirotaka Hachiya, Yu Yamamoto, Kazuro Hirahara, Naonori Ueda
Proceedings of The Eleventh Asian Conference on Machine Learning, PMLR 101:868-882, 2019.

Abstract

Recently, anchor-based regression methods have been applied to challenging regression problems, e.g., object detection and distance estimation, and greatly improved those performances. The key idea of anchor-based regression is to solve the regression of the residuals between selected anchors and original target variable, where the variance is expected to be smaller. However, similar to an ordinary regression method, the anchor-based regression could face difficulty on a fine-grained regression and ill-posed problems where the residual variables tend to be too small and complicated to accurately predict. To overcome these problems on the anchor-based regression, we propose to introduce an adaptive residual encoding in which the too small residual is magnified, and the too-large residual is truncated using adaptively tuned sigmoidal function. Our proposed method, called ATR-Nets (Adaptive Truncated Residual-Networks) with an end-to-end architecture could control the range of the target residual to be fitted based on the regression performance, Through experiments with toy-data and the system identification for earthquake asperity models, we show the effectiveness of our proposed method.

Cite this Paper

BibTeX
@InProceedings{pmlr-v101-hachiya19a, title = {Adaptive truncated residual regression for fine-grained regression problems}, author = {Hachiya, Hirotaka and Yamamoto, Yu and Hirahara, Kazuro and Ueda, Naonori}, booktitle = {Proceedings of The Eleventh Asian Conference on Machine Learning}, pages = {868--882}, year = {2019}, editor = {Lee, Wee Sun and Suzuki, Taiji}, volume = {101}, series = {Proceedings of Machine Learning Research}, month = {17--19 Nov}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v101/hachiya19a/hachiya19a.pdf}, url = {https://proceedings.mlr.press/v101/hachiya19a.html}, abstract = {Recently, anchor-based regression methods have been applied to challenging regression problems, e.g., object detection and distance estimation, and greatly improved those performances. The key idea of anchor-based regression is to solve the regression of the residuals between selected anchors and original target variable, where the variance is expected to be smaller. However, similar to an ordinary regression method, the anchor-based regression could face difficulty on a fine-grained regression and ill-posed problems where the residual variables tend to be too small and complicated to accurately predict. To overcome these problems on the anchor-based regression, we propose to introduce an adaptive residual encoding in which the too small residual is magnified, and the too-large residual is truncated using adaptively tuned sigmoidal function. Our proposed method, called ATR-Nets (Adaptive Truncated Residual-Networks) with an end-to-end architecture could control the range of the target residual to be fitted based on the regression performance, Through experiments with toy-data and the system identification for earthquake asperity models, we show the effectiveness of our proposed method.} }
Endnote
%0 Conference Paper %T Adaptive truncated residual regression for fine-grained regression problems %A Hirotaka Hachiya %A Yu Yamamoto %A Kazuro Hirahara %A Naonori Ueda %B Proceedings of The Eleventh Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2019 %E Wee Sun Lee %E Taiji Suzuki %F pmlr-v101-hachiya19a %I PMLR %P 868--882 %U https://proceedings.mlr.press/v101/hachiya19a.html %V 101 %X Recently, anchor-based regression methods have been applied to challenging regression problems, e.g., object detection and distance estimation, and greatly improved those performances. The key idea of anchor-based regression is to solve the regression of the residuals between selected anchors and original target variable, where the variance is expected to be smaller. However, similar to an ordinary regression method, the anchor-based regression could face difficulty on a fine-grained regression and ill-posed problems where the residual variables tend to be too small and complicated to accurately predict. To overcome these problems on the anchor-based regression, we propose to introduce an adaptive residual encoding in which the too small residual is magnified, and the too-large residual is truncated using adaptively tuned sigmoidal function. Our proposed method, called ATR-Nets (Adaptive Truncated Residual-Networks) with an end-to-end architecture could control the range of the target residual to be fitted based on the regression performance, Through experiments with toy-data and the system identification for earthquake asperity models, we show the effectiveness of our proposed method.
APA
Hachiya, H., Yamamoto, Y., Hirahara, K. & Ueda, N.. (2019). Adaptive truncated residual regression for fine-grained regression problems. Proceedings of The Eleventh Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 101:868-882 Available from https://proceedings.mlr.press/v101/hachiya19a.html.

Related Material