Stochastic Variance Reduced Optimization for Nonconvex Sparse Learning


Xingguo Li, Tuo Zhao, Raman Arora, Han Liu, Jarvis Haupt ;
Proceedings of The 33rd International Conference on Machine Learning, PMLR 48:917-925, 2016.


We propose a stochastic variance reduced optimization algorithm for solving a class of large-scale nonconvex optimization problems with cardinality constraints, and provide sufficient conditions under which the proposed algorithm enjoys strong linear convergence guarantees and optimal estimation accuracy in high dimensions. Numerical experiments demonstrate the efficiency of our method in terms of both parameter estimation and computational performance.

Related Material