Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits

Jiahao Yao, Haoya Li, Marin Bukov, Lin Lin, Lexing Ying
Proceedings of Mathematical and Scientific Machine Learning, PMLR 190:49-64, 2022.

Abstract

Variational quantum algorithms stand at the forefront of simulations on near-term and future fault-tolerant quantum devices. While most variational quantum algorithms involve only continuous optimization variables, the representation power of the variational ansatz can sometimes be significantly enhanced by adding certain discrete optimization variables, as is exemplified by the generalized quantum approximate optimization algorithm (QAOA). However, the hybrid discrete-continuous optimization problem in the generalized QAOA poses a challenge to the optimization. We propose a new algorithm called MCTS-QAOA, which combines a Monte Carlo tree search method with an improved policy gradient solver to optimize the discrete and continuous variables in the quantum circuit, respectively. We find that MCTS-QAOA has excellent noise-resilience properties, and can outperform prior algorithms in challenging instances of the generalized QAOA.

Cite this Paper

BibTeX
@InProceedings{pmlr-v190-yao22a, title = {Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits}, author = {Yao, Jiahao and Li, Haoya and Bukov, Marin and Lin, Lin and Ying, Lexing}, booktitle = {Proceedings of Mathematical and Scientific Machine Learning}, pages = {49--64}, year = {2022}, editor = {Dong, Bin and Li, Qianxiao and Wang, Lei and Xu, Zhi-Qin John}, volume = {190}, series = {Proceedings of Machine Learning Research}, month = {15--17 Aug}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v190/yao22a/yao22a.pdf}, url = {https://proceedings.mlr.press/v190/yao22a.html}, abstract = {Variational quantum algorithms stand at the forefront of simulations on near-term and future fault-tolerant quantum devices. While most variational quantum algorithms involve only continuous optimization variables, the representation power of the variational ansatz can sometimes be significantly enhanced by adding certain discrete optimization variables, as is exemplified by the generalized quantum approximate optimization algorithm (QAOA). However, the hybrid discrete-continuous optimization problem in the generalized QAOA poses a challenge to the optimization. We propose a new algorithm called MCTS-QAOA, which combines a Monte Carlo tree search method with an improved policy gradient solver to optimize the discrete and continuous variables in the quantum circuit, respectively. We find that MCTS-QAOA has excellent noise-resilience properties, and can outperform prior algorithms in challenging instances of the generalized QAOA.} }
Endnote
%0 Conference Paper %T Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits %A Jiahao Yao %A Haoya Li %A Marin Bukov %A Lin Lin %A Lexing Ying %B Proceedings of Mathematical and Scientific Machine Learning %C Proceedings of Machine Learning Research %D 2022 %E Bin Dong %E Qianxiao Li %E Lei Wang %E Zhi-Qin John Xu %F pmlr-v190-yao22a %I PMLR %P 49--64 %U https://proceedings.mlr.press/v190/yao22a.html %V 190 %X Variational quantum algorithms stand at the forefront of simulations on near-term and future fault-tolerant quantum devices. While most variational quantum algorithms involve only continuous optimization variables, the representation power of the variational ansatz can sometimes be significantly enhanced by adding certain discrete optimization variables, as is exemplified by the generalized quantum approximate optimization algorithm (QAOA). However, the hybrid discrete-continuous optimization problem in the generalized QAOA poses a challenge to the optimization. We propose a new algorithm called MCTS-QAOA, which combines a Monte Carlo tree search method with an improved policy gradient solver to optimize the discrete and continuous variables in the quantum circuit, respectively. We find that MCTS-QAOA has excellent noise-resilience properties, and can outperform prior algorithms in challenging instances of the generalized QAOA.
APA
Yao, J., Li, H., Bukov, M., Lin, L. & Ying, L.. (2022). Monte Carlo Tree Search based Hybrid Optimization of Variational Quantum Circuits. Proceedings of Mathematical and Scientific Machine Learning, in Proceedings of Machine Learning Research 190:49-64 Available from https://proceedings.mlr.press/v190/yao22a.html.

Related Material