Multi-Order Information for Working Set Selection of Sequential Minimal Optimization

Qimao Yang, Changrong Li, Jun Guo
Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, PMLR 89:3264-3272, 2019.

Abstract

A new working set selection method for sequential minimal optimization (SMO) is proposed in this paper. Instead of the method adopted in the current version of LIBSVM, which uses the second order information of the objective function to choose the violating pairs, we suggest a new method where a higher order information is considered. It includes the descent degree of the objective function and the stride of variables update. Many experimental results show, in contrast to LIBSVM, the number of iterations obtained by the proposed method is less in the vast majority of cases and the training of support vector machines (SVMs) is sped up. Meanwhile, the convergence of the proposed approach can be guaranteed and its accuracy is at the same level as LIBSVM’s.

Cite this Paper

BibTeX
@InProceedings{pmlr-v89-yang19b, title = {Multi-Order Information for Working Set Selection of Sequential Minimal Optimization}, author = {Yang, Qimao and Li, Changrong and Guo, Jun}, booktitle = {Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics}, pages = {3264--3272}, year = {2019}, editor = {Chaudhuri, Kamalika and Sugiyama, Masashi}, volume = {89}, series = {Proceedings of Machine Learning Research}, month = {16--18 Apr}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v89/yang19b/yang19b.pdf}, url = {https://proceedings.mlr.press/v89/yang19b.html}, abstract = {A new working set selection method for sequential minimal optimization (SMO) is proposed in this paper. Instead of the method adopted in the current version of LIBSVM, which uses the second order information of the objective function to choose the violating pairs, we suggest a new method where a higher order information is considered. It includes the descent degree of the objective function and the stride of variables update. Many experimental results show, in contrast to LIBSVM, the number of iterations obtained by the proposed method is less in the vast majority of cases and the training of support vector machines (SVMs) is sped up. Meanwhile, the convergence of the proposed approach can be guaranteed and its accuracy is at the same level as LIBSVM’s.} }
Endnote
%0 Conference Paper %T Multi-Order Information for Working Set Selection of Sequential Minimal Optimization %A Qimao Yang %A Changrong Li %A Jun Guo %B Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics %C Proceedings of Machine Learning Research %D 2019 %E Kamalika Chaudhuri %E Masashi Sugiyama %F pmlr-v89-yang19b %I PMLR %P 3264--3272 %U https://proceedings.mlr.press/v89/yang19b.html %V 89 %X A new working set selection method for sequential minimal optimization (SMO) is proposed in this paper. Instead of the method adopted in the current version of LIBSVM, which uses the second order information of the objective function to choose the violating pairs, we suggest a new method where a higher order information is considered. It includes the descent degree of the objective function and the stride of variables update. Many experimental results show, in contrast to LIBSVM, the number of iterations obtained by the proposed method is less in the vast majority of cases and the training of support vector machines (SVMs) is sped up. Meanwhile, the convergence of the proposed approach can be guaranteed and its accuracy is at the same level as LIBSVM’s.
APA
Yang, Q., Li, C. & Guo, J.. (2019). Multi-Order Information for Working Set Selection of Sequential Minimal Optimization. Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics, in Proceedings of Machine Learning Research 89:3264-3272 Available from https://proceedings.mlr.press/v89/yang19b.html.

Related Material