Multi-Scale Anomaly Detection for Time Series with Attention-based Recurrent Autoencoders

Lu Qingning, Li Wenzhong, Zhu Chuanze, Chen Yizhou, Wang Yinke, Zhang Zhijie, Shen Linshan, Lu Sanglu
Proceedings of The 14th Asian Conference on Machine Learning, PMLR 189:674-689, 2023.

Abstract

Anomaly detection on time series is an important research topic in data mining, which has a wide range of applications in financial markets, biological data, information technology, manufacturing system, etc. However, the existing time series anomaly detection methods mainly capture temporal features from a single-scale viewpoint, which cannot detect multi-scale anomalies effectively. In this paper, we propose a novel approach of Multi-scale Anomaly Detection for Time Series (MAD-TS) with an attention-based recurrent autoencoder model to solve the above problem. The proposed method adopts a hierarchically connected recurrent encoder to extract the features of a time series from different levels. The multi-scale features are then fused by a hierarchical decoder with attention mechanism to reconstruct the original sequence at different scales. Based on the reconstruction errors at multiple scales, anomaly scores can be learned for different data points, which can be used to infer the anomaly status of the time series. Extensive experiments based on five open time series datasets show that the proposed MAD-TS method achieves significant performance improvement on anomaly detection compared to the state-of-the-arts.

Cite this Paper


BibTeX
@InProceedings{pmlr-v189-qingning23a, title = {Multi-Scale Anomaly Detection for Time Series with Attention-based Recurrent Autoencoders}, author = {Qingning, Lu and Wenzhong, Li and Chuanze, Zhu and Yizhou, Chen and Yinke, Wang and Zhijie, Zhang and Linshan, Shen and Sanglu, Lu}, booktitle = {Proceedings of The 14th Asian Conference on Machine Learning}, pages = {674--689}, year = {2023}, editor = {Khan, Emtiyaz and Gonen, Mehmet}, volume = {189}, series = {Proceedings of Machine Learning Research}, month = {12--14 Dec}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v189/qingning23a/qingning23a.pdf}, url = {https://proceedings.mlr.press/v189/qingning23a.html}, abstract = {Anomaly detection on time series is an important research topic in data mining, which has a wide range of applications in financial markets, biological data, information technology, manufacturing system, etc. However, the existing time series anomaly detection methods mainly capture temporal features from a single-scale viewpoint, which cannot detect multi-scale anomalies effectively. In this paper, we propose a novel approach of Multi-scale Anomaly Detection for Time Series (MAD-TS) with an attention-based recurrent autoencoder model to solve the above problem. The proposed method adopts a hierarchically connected recurrent encoder to extract the features of a time series from different levels. The multi-scale features are then fused by a hierarchical decoder with attention mechanism to reconstruct the original sequence at different scales. Based on the reconstruction errors at multiple scales, anomaly scores can be learned for different data points, which can be used to infer the anomaly status of the time series. Extensive experiments based on five open time series datasets show that the proposed MAD-TS method achieves significant performance improvement on anomaly detection compared to the state-of-the-arts.} }
Endnote
%0 Conference Paper %T Multi-Scale Anomaly Detection for Time Series with Attention-based Recurrent Autoencoders %A Lu Qingning %A Li Wenzhong %A Zhu Chuanze %A Chen Yizhou %A Wang Yinke %A Zhang Zhijie %A Shen Linshan %A Lu Sanglu %B Proceedings of The 14th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2023 %E Emtiyaz Khan %E Mehmet Gonen %F pmlr-v189-qingning23a %I PMLR %P 674--689 %U https://proceedings.mlr.press/v189/qingning23a.html %V 189 %X Anomaly detection on time series is an important research topic in data mining, which has a wide range of applications in financial markets, biological data, information technology, manufacturing system, etc. However, the existing time series anomaly detection methods mainly capture temporal features from a single-scale viewpoint, which cannot detect multi-scale anomalies effectively. In this paper, we propose a novel approach of Multi-scale Anomaly Detection for Time Series (MAD-TS) with an attention-based recurrent autoencoder model to solve the above problem. The proposed method adopts a hierarchically connected recurrent encoder to extract the features of a time series from different levels. The multi-scale features are then fused by a hierarchical decoder with attention mechanism to reconstruct the original sequence at different scales. Based on the reconstruction errors at multiple scales, anomaly scores can be learned for different data points, which can be used to infer the anomaly status of the time series. Extensive experiments based on five open time series datasets show that the proposed MAD-TS method achieves significant performance improvement on anomaly detection compared to the state-of-the-arts.
APA
Qingning, L., Wenzhong, L., Chuanze, Z., Yizhou, C., Yinke, W., Zhijie, Z., Linshan, S. & Sanglu, L.. (2023). Multi-Scale Anomaly Detection for Time Series with Attention-based Recurrent Autoencoders. Proceedings of The 14th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 189:674-689 Available from https://proceedings.mlr.press/v189/qingning23a.html.

Related Material