AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (2.3 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Using Multi-Scale Convolution Fusion and Memory-Augmented Adversarial Autoencoder to Detect Diverse Anomalies in Multivariate Time Series

College of Computer Science and Technology (College of Data Science), Taiyuan University of Technology, Jinzhong 030600, China
Show Author Information

Abstract

Time series anomaly detection is an important task in many applications, and deep learning based time series anomaly detection has made great progress. However, due to complex device interactions, time series exhibit diverse abnormal signal shapes, subtle anomalies, and imbalanced abnormal instances, which make anomaly detection in time series still a challenge. Fusion and analysis of multivariate time series can help uncover their intrinsic spatio-temporal characteristics, and contribute to the discovery of complex and subtle anomalies. In this paper, we propose a novel approach named Multi-scale Convolution Fusion and Memory-augmented Adversarial AutoEncoder (MCFMAAE) for multivariate time series anomaly detection. It is an encoder-decoder-based framework with four main components. Multi-scale convolution fusion module fuses multi-sensor signals and captures various scales of temporal information. Self-attention-based encoder adopts the multi-head attention mechanism for sequence modeling to capture global context information. Memory module is introduced to explore the internal structure of normal samples, capturing it into the latent space, and thus remembering the typical pattern. Finally, the decoder is used to reconstruct the signals, and then a process is coming to calculate the anomaly score. Moreover, an additional discriminator is added to the model, which enhances the representation ability of autoencoder and avoids overfitting. Experiments on public datasets demonstrate that MCFMAAE improves the performance compared to other state-of-the-art methods, which provides an effective solution for multivariate time series anomaly detection.

References

[1]
T. Huang, P. Chen, and R. Li, A semi-supervised VAE based active anomaly detection framework in multivariate time series for online systems, in Proc. ACM Web Conf. 2022, Lyon, France, 2022, pp. 1797–1806.
[2]
S. Park, S. Han, and S. S. Woo, Forecasting error pattern-based anomaly detection in multivariate time series, in Proc. Machine Learning and Knowledge Discovery in Databases : Applied Data Science Track : European Conference, Ghent, Belgium, 2020, pp. 157–172.
[3]

K. Yang, Y. Wang, X. Han, Y. Cheng, L. Guo, and J. Gong, Unsupervised anomaly detection for time series data of spacecraft using multi-task learning, Appl. Sci., vol. 12, no. 13, p. 6296, 2022.

[4]
A. Blázquez-García, A. Conde, U. Mori, and Lozano J. A, A review on outlier/anomaly detection in time series data, ACM Comput. Surv., vol. 54, no. 3, p. 56, 2021.
[5]

M. Thill, W. Konen, H. Wang, and T. Bäck, Temporal convolutional autoencoder for unsupervised anomaly detection in time series, Appl. Soft Comput., vol. 112, p. 107751, 2021.

[6]

Z. Ji, Y. Wang, K. Yan, X. Xie, Y. Xiang, and J. Huang, A space-embedding strategy for anomaly detection in multivariate time series, Expert Syst. Appl., vol. 206, p. 117892, 2022.

[7]

X. Zhang, J. Mu, X. Zhang, H. Liu, L. Zong, and Y. Li, Deep anomaly detection with self-supervised learning and adversarial training, Pattern Recognit., vol. 121, p. 108234, 2022.

[8]

K. Choi, J. Yi, C. Park, and S. Yoon, Deep learning for anomaly detection in time-series data: Review, analysis, and guidelines, IEEE Access, vol. 9, pp. 120043–120065, 2021.

[9]
Z. Ning, Z. Jiang, H. Miao, and L. Wang, MST-GNN: A multi-scale temporal-enhanced graph neural network for anomaly detection in multivariate time series, in Proc. Web and Big Data : 6th International Joint Conference, Nanjing, China, 2022, pp. 382–390.
[10]
Y. Su, Y. Zhao, C. Niu, R. Liu, W. Sun, and D. Pei, Robust anomaly detection for multivariate time series through stochastic recurrent neural network, in Proc. 25th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Anchorage, AK, USA, 2019, pp. 2828–2837.
[11]

C. Yin, S. Zhang, J. Wang, and N. N. Xiong, Anomaly detection based on convolutional recurrent autoencoder for IoT time series, IEEE Trans. Syst. Man Cybern. Syst., vol. 52, no. 1, pp. 112–122, 2022.

[12]

R.-Q. Chen, G.-H. Shi, W.-L. Zhao, and C.-H. Liang, A joint model for IT operation series prediction and anomaly detection, Neurocomputing, vol. 448, pp. 130–139, 2021.

[13]

W. Gong, Y. Wang, M. Zhang, E. Mihankhah, H. Chen, and D. Wang, A fast anomaly diagnosis approach based on modified CNN and multisensor data fusion, IEEE Trans. Ind. Electron., vol. 69, no. 12, pp. 13636–13646, 2022.

[14]

Y. Cheng, Y. Xu, H. Zhong, and Y. Liu, Leveraging semisupervised hierarchical stacking temporal convolutional network for anomaly detection in IoT communication, IEEE Internet Things J., vol. 8, no. 1, pp. 144–155, 2021.

[15]
L. Xu, K. Xu, Y. Qin, Y. Li, X. Huang, Z. Lin, N. Ye, and X. Ji, TGAN-AD: Transformer-based GAN for anomaly detection of time series data, Appl. Sci., vol. 12, no. 16, p. 8085, 2022.
[16]

Z. Chen, D. Chen, X. Zhang, Z. Yuan, and X. Cheng, Learning graph structures with transformer for multivariate time-series anomaly detection in IoT, IEEE Internet Things J., vol. 9, no. 12, pp. 9179–9189, 2022.

[17]
S. Tuli, G. Casale, and N. R. Jennings, TranAD: Deep transformer networks for anomaly detection in multivariate time series data, Proc. VLDB Endowment, vol. 15, no. 6, pp. 1201–1214, 2022.
[18]
Q. Xiao, S. Shao, and J. Wang, Memory-augmented adversarial autoencoders for multivariate time-series anomaly detection with deep reconstruction and prediction, arXiv preprint arXiv:2110.08306, 2021.
[19]

H. Ozkan, F. Ozkan, and S. S. Kozat, Online anomaly detection under Markov statistics with controllable type-I error, IEEE Trans. Signal Process., vol. 64, no. 6, pp. 1435–1445, 2016.

[20]
M. Gu, Anomaly detection based on Chi-square statistic technology in computer information system, Appl. Mech. Mater., vol. 462–463, pp. 1046–1049, 2013.
[21]

W. Hu, J. Gao, B. Li, O. Wu, J. Du, and S. Maybank, Anomaly detection using local kernel density estimation and context-based regression, IEEE Trans. Knowl. Data Eng., vol. 32, no. 2, pp. 218–233, 2020.

[22]

Z. Lei, L. Zhu, Y. Fang, X. Li, and B. Liu, Anomaly detection of bridge health monitoring data based on KNN algorithm, Journal of Intelligent & Fuzzy Systems, vol. 39, no. 4, pp. 5243–5252, 2020.

[23]
R. Pamula, J. K. Deka, and S. Nandi, An outlier detection method based on clustering, in Proc. Second Int. Conf. Emerging Applications of Information Technology, Kolkata, India, 2011, pp. 253–256.
[24]

Y. Zhang, J. Wang, Y. Chen, H. Yu, and T. Qin, Adaptive memory networks with self-supervised learning for unsupervised anomaly detection, IEEE Trans. Knowl. Data Eng., vol. 35, no. 12, pp. 12068–12080, 2023.

[25]
T.-A. Pham, J.-H. Lee, and C.-S. Park, MST-VAE: Multi-scale temporal variational autoencoder for anomaly detection in multivariate time series, Appl. Sci., vol. 12, no. 19, p. 10078, 2022.
[26]

C. Zhang, D. Song, Y. Chen, X. Feng, C. Lumezanu, W. Cheng, J. Ni, B. Zong, H. Chen, and N. V. Chawla, A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data, Proc. AAAI Conf. Artif. Intell., vol. 33, no. 1, pp. 1409–1416, 2019.

[27]

J. Liu, G. Yang, X. Li, S. Hao, Y. Guan, and Y. Li, A deep generative model based on CNN-CVAE for wind turbine condition monitoring, Meas. Sci. Technol., vol. 34, no. 3, p. 035902, 2023.

[28]
J. Park, Y. Park, and C.-I. Kim, TCAE: Temporal convolutional autoencoders for time series anomaly detection, in Proc. Thirteenth Int. Conf. Ubiquitous and Future Networks (ICUFN), Barcelona, Spain, 2022, pp. 421–426.
[29]

F. Kong, J. Li, B. Jiang, H. Wang, and H. Song, Integrated generative model for industrial anomaly detection via bidirectional LSTM and attention mechanism, IEEE Trans. Ind. Inform., vol. 19, no. 1, pp. 541–550, 2023.

[30]
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, Attention is all you need, in Proc. of the 31st Int. Conf. on Neural Information Processing Systems, Long Beach, CA, USA, 2017, pp. 6000–6010.
[31]

X. Wang, D. Pi, X. Zhang, H. Liu, and C. Guo, Variational transformer-based anomaly detection approach for multivariate time series, Measurement, vol. 191, p. 110791, 2022.

[32]

Y. Zhang, Y. Chen, J. Wang, and Z. Pan, Unsupervised deep anomaly detection for multi-sensor time-series signals, IEEE Trans. Knowl. Data Eng., vol. 35, no. 2, pp. 2118–2132, 2023.

[33]
D. Li, D. Chen, B. Jin, L. Shi, J. Goh, and S.-K. Ng, MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks, in Proc. Inte. Conf. on Artificial Neural Networks. doi:10.1007/978-3-030-30490-4_56.
[34]
H. Zhao, Y. Wang, J. Duan, C. Huang, D. Cao, Y. Tong, B. Xu, J. Bai, J. Tong, and Q. Zhang, Multivariate time-series anomaly detection via graph attention network, in Proc. IEEE Int. Conf. Data Mining (ICDM), Sorrento, Italy, 2020, pp. 841–850.
[35]

A. Deng and B. Hooi, Graph neural network-based anomaly detection in multivariate time series, Proc. AAAI Conf. Artif. Intell., vol. 35, no. 5, pp. 4027–4035, 2021.

Tsinghua Science and Technology
Pages 234-246
Cite this article:
Ning Z, Miao H, Jiang Z, et al. Using Multi-Scale Convolution Fusion and Memory-Augmented Adversarial Autoencoder to Detect Diverse Anomalies in Multivariate Time Series. Tsinghua Science and Technology, 2025, 30(1): 234-246. https://doi.org/10.26599/TST.2023.9010095

154

Views

25

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics

Received: 01 September 2023
Accepted: 03 September 2023
Published: 11 September 2024
© The Author(s) 2025.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return