Adversarial Regression with Multiple Learners

Liang Tong, Sixie Yu, Scott Alfeld,  vorobeychik
Proceedings of the 35th International Conference on Machine Learning, PMLR 80:4946-4954, 2018.

Abstract

Despite the considerable success enjoyed by machine learning techniques in practice, numerous studies demonstrated that many approaches are vulnerable to attacks. An important class of such attacks involves adversaries changing features at test time to cause incorrect predictions. Previous investigations of this problem pit a single learner against an adversary. However, in many situations an adversary’s decision is aimed at a collection of learners, rather than specifically targeted at each independently. We study the problem of adversarial linear regression with multiple learners. We approximate the resulting game by exhibiting an upper bound on learner loss functions, and show that the resulting game has a unique symmetric equilibrium. We present an algorithm for computing this equilibrium, and show through extensive experiments that equilibrium models are significantly more robust than conventional regularized linear regression.

Cite this Paper

BibTeX
@InProceedings{pmlr-v80-tong18a, title = {Adversarial Regression with Multiple Learners}, author = {Tong, Liang and Yu, Sixie and Alfeld, Scott and yevgeniy vorobeychik}, booktitle = {Proceedings of the 35th International Conference on Machine Learning}, pages = {4946--4954}, year = {2018}, editor = {Dy, Jennifer and Krause, Andreas}, volume = {80}, series = {Proceedings of Machine Learning Research}, month = {10--15 Jul}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v80/tong18a/tong18a.pdf}, url = {https://proceedings.mlr.press/v80/tong18a.html}, abstract = {Despite the considerable success enjoyed by machine learning techniques in practice, numerous studies demonstrated that many approaches are vulnerable to attacks. An important class of such attacks involves adversaries changing features at test time to cause incorrect predictions. Previous investigations of this problem pit a single learner against an adversary. However, in many situations an adversary’s decision is aimed at a collection of learners, rather than specifically targeted at each independently. We study the problem of adversarial linear regression with multiple learners. We approximate the resulting game by exhibiting an upper bound on learner loss functions, and show that the resulting game has a unique symmetric equilibrium. We present an algorithm for computing this equilibrium, and show through extensive experiments that equilibrium models are significantly more robust than conventional regularized linear regression.} }
Endnote
%0 Conference Paper %T Adversarial Regression with Multiple Learners %A Liang Tong %A Sixie Yu %A Scott Alfeld %A vorobeychik %B Proceedings of the 35th International Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2018 %E Jennifer Dy %E Andreas Krause %F pmlr-v80-tong18a %I PMLR %P 4946--4954 %U https://proceedings.mlr.press/v80/tong18a.html %V 80 %X Despite the considerable success enjoyed by machine learning techniques in practice, numerous studies demonstrated that many approaches are vulnerable to attacks. An important class of such attacks involves adversaries changing features at test time to cause incorrect predictions. Previous investigations of this problem pit a single learner against an adversary. However, in many situations an adversary’s decision is aimed at a collection of learners, rather than specifically targeted at each independently. We study the problem of adversarial linear regression with multiple learners. We approximate the resulting game by exhibiting an upper bound on learner loss functions, and show that the resulting game has a unique symmetric equilibrium. We present an algorithm for computing this equilibrium, and show through extensive experiments that equilibrium models are significantly more robust than conventional regularized linear regression.
APA
Tong, L., Yu, S., Alfeld, S. & vorobeychik, . (2018). Adversarial Regression with Multiple Learners. Proceedings of the 35th International Conference on Machine Learning, in Proceedings of Machine Learning Research 80:4946-4954 Available from https://proceedings.mlr.press/v80/tong18a.html.

Related Material