Adaptive sampling methods for learning dynamical systems

Zichen Zhao, Qianxiao Li
Proceedings of Mathematical and Scientific Machine Learning, PMLR 190:335-350, 2022.

Abstract

Learning dynamical systems from observed trajectories is a fundamental problem in data-driven science and engineering. While many existing works focus on improving model architectures or training methods, less attention has been directed at how to effectively sample training data to give rise to accurate models. In particular, one of the most basic problems is to select the length of sampled trajectories that balances computational overhead due to sampling and the quality of learned models. This paper deals with the task of improving sampling efficiency for learning dynamics.We first formulate proper target risks to evaluate the model performance of learning in the dynamical setting.This allows us to connect generalization to matching empirical measures with specific target measures. In line with this observation, we propose a class of adaptive algorithms to find effective sampling strategies that control the length of sampled trajectories. Through numerical experiments, we show the adaptive algorithms can achieve more accurate results given a sampling budget compared to baseline sampling methods.

Cite this Paper


BibTeX
@InProceedings{pmlr-v190-zhao22a, title = {Adaptive sampling methods for learning dynamical systems}, author = {Zhao, Zichen and Li, Qianxiao}, booktitle = {Proceedings of Mathematical and Scientific Machine Learning}, pages = {335--350}, year = {2022}, editor = {Dong, Bin and Li, Qianxiao and Wang, Lei and Xu, Zhi-Qin John}, volume = {190}, series = {Proceedings of Machine Learning Research}, month = {15--17 Aug}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v190/zhao22a/zhao22a.pdf}, url = {https://proceedings.mlr.press/v190/zhao22a.html}, abstract = {Learning dynamical systems from observed trajectories is a fundamental problem in data-driven science and engineering. While many existing works focus on improving model architectures or training methods, less attention has been directed at how to effectively sample training data to give rise to accurate models. In particular, one of the most basic problems is to select the length of sampled trajectories that balances computational overhead due to sampling and the quality of learned models. This paper deals with the task of improving sampling efficiency for learning dynamics.We first formulate proper target risks to evaluate the model performance of learning in the dynamical setting.This allows us to connect generalization to matching empirical measures with specific target measures. In line with this observation, we propose a class of adaptive algorithms to find effective sampling strategies that control the length of sampled trajectories. Through numerical experiments, we show the adaptive algorithms can achieve more accurate results given a sampling budget compared to baseline sampling methods.} }
Endnote
%0 Conference Paper %T Adaptive sampling methods for learning dynamical systems %A Zichen Zhao %A Qianxiao Li %B Proceedings of Mathematical and Scientific Machine Learning %C Proceedings of Machine Learning Research %D 2022 %E Bin Dong %E Qianxiao Li %E Lei Wang %E Zhi-Qin John Xu %F pmlr-v190-zhao22a %I PMLR %P 335--350 %U https://proceedings.mlr.press/v190/zhao22a.html %V 190 %X Learning dynamical systems from observed trajectories is a fundamental problem in data-driven science and engineering. While many existing works focus on improving model architectures or training methods, less attention has been directed at how to effectively sample training data to give rise to accurate models. In particular, one of the most basic problems is to select the length of sampled trajectories that balances computational overhead due to sampling and the quality of learned models. This paper deals with the task of improving sampling efficiency for learning dynamics.We first formulate proper target risks to evaluate the model performance of learning in the dynamical setting.This allows us to connect generalization to matching empirical measures with specific target measures. In line with this observation, we propose a class of adaptive algorithms to find effective sampling strategies that control the length of sampled trajectories. Through numerical experiments, we show the adaptive algorithms can achieve more accurate results given a sampling budget compared to baseline sampling methods.
APA
Zhao, Z. & Li, Q.. (2022). Adaptive sampling methods for learning dynamical systems. Proceedings of Mathematical and Scientific Machine Learning, in Proceedings of Machine Learning Research 190:335-350 Available from https://proceedings.mlr.press/v190/zhao22a.html.

Related Material