AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (4.8 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

QTFN: A General End-to-End Time-Frequency Network to Reveal the Time-Varying Signatures of the Time Series

State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou 310027, China
Shenzhen Key Laboratory of Intelligent Bioinformatics, and College of Computer Science and Control Engineering, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
Show Author Information

Abstract

Nonstationary time series are ubiquitous in almost all natural and engineering systems. Capturing the time-varying signatures from nonstationary time series is still a challenging problem for data mining. Quadratic Time-Frequency Distribution (TFD) provides a powerful tool to analyze these data. However, they suffer from Cross-Term (CT) issues that impair the readability of TFDs. Therefore, to achieve high-resolution and CT-free TFDs, an end-to-end architecture termed Quadratic TF-Net (QTFN) is proposed in this paper. Guided by classic TFD theory, the design of this deep learning architecture is heuristic, which firstly generates various basis functions through data-driven. Thus, more comprehensive TF features can be extracted by these basis functions. Then, to balance the results of various basis functions adaptively, the Efficient Channel Attention (ECA) block is also embedded into QTFN. Moreover, a new structure called Muti-scale Residual Encoder-Decoder (MRED) is also proposed to improve the learning ability of the model by highly integrating the multi-scale learning and encoder-decoder architecture. Finally, although the model is only trained by synthetic signals, both synthetic and real-world signals are tested to validate the generalization capability and superiority of the proposed QTFN.

References

[1]

D.-H. Pham and S. Meignen, High-order synchrosqueezing transform for multicomponent signals analysis—With an application to gravitational-wave signal, IEEE Trans. on Signal Processing, vol. 65, no. 12, pp. 3168–3178, 2017.

[2]

N. Liu, Y. Lei, R. Liu, Y. Yang, T. Wei, and J. Gao, Sparse time-frequency analysis of seismic data: Sparse representation to unrolled optimization, IEEE Tran. on Geoscience and Remote Sensing, vol. 61, pp. 1–10, 2023.

[3]

V. C. Chen, F. Li, S.-S. Ho, and H. Wechsler, Micro-Doppler effect in radar: phenomenon, model, and simulation study, IEEE Trans. on Aerospace and electronic systems, vol. 42, no. 1, pp. 2–21, 2006.

[4]

M. Mercuri, I. R. Lorato, Y.-H. Liu, F. Wieringa, C. V. Hoof, and T. Torfs, Vital-sign monitoring and spatial tracking of multiple people using a contactless radar-based sensor, Nature Electronics, vol. 2, no. 6, pp. 252–262, 2019.

[5]

S. K. Hadjidimitriou and L. J. Hadjileontiadis, Toward an EEG-based recognition of music liking using time-frequency analysis, IEEE Trans. on Biomedical Engineering, vol. 59, no. 12, pp. 3498–3510, 2012.

[6]

T. Kinoshita, K. Fujiwara, M. Kano, K. Ogawa, Y. Sumi, M. Matsuo, and H. Kadotani, Sleep spindle detection using RUSBoost and synchrosqueezed wavelet transform, IEEE Trans. on Neural Systems and Rehabilitation Engineering, vol. 28, no. 2, pp. 390–398, 2020.

[7]

T. Chen, Q. Zheng, L. Xie, and H. Su, Sinusoidal-assisted synchrosqueezing transform: Algorithms and biomedical applications, Biomedical Signal Processing and Control, vol. 85, p. 105043, 2023.

[8]

Z. Feng, M. Liang, and F. Chu, Recent advances in time-frequency analysis methods for machinery fault diagnosis: A review with application examples, Mechanical Systems and Signal Processing, vol. 38, no. 1, pp. 165–205, 2013.

[9]

S. Wang, X. Chen, I. W. Selesnick, Y. Guo, C. Tong, and X. Zhang, Matching synchrosqueezing transform: A useful tool for characterizing signals with fast varying instantaneous frequency and application to machine fault diagnosis, Mechanical Systems and Signal Processing, vol. 100, pp. 242–288, 2018.

[10]

S. Meignen and N. Singh, Analysis of reassignment operators used in synchrosqueezing transforms: With an application to instantaneous frequency estimation, IEEE Tran. on Signal Processing, vol. 70, pp. 216–227, 2021.

[11]

F. Auger, P. Flandrin, Y.-T. Lin, S. McLaughlin, S. Meignen, T. Oberlin, and H.-T. Wu, Time-frequency reassignment and synchrosqueezing: An overview, IEEE Signal Processing Magazine, vol. 30, no. 6, pp. 32–41, 2013.

[12]

I. Daubechies, J. Lu, and H.-T. Wu, Synchrosqueezed wavelet transforms: An empirical mode decomposition-like tool, Applied and computational harmonic analysis, vol. 30, no. 2, pp. 243–261, 2011.

[13]
T. Oberlin, S. Meignen, and V. Perrier, The Fourier-based synchrosqueezing transform, in Proc. IEEE Int. Conf. on acoustics, speech and signal processing (ICASSP), Florence, Italy, 2014, pp. 315–319.
[14]

G. Yu, M. Yu, and C. Xu, Synchroextracting transform, IEEE Trans. on Industrial Electronics, vol. 64, no. 10, pp. 8042–8054, 2017.

[15]

T. Oberlin, S. Meignen, and V. Perrier, Second-order synchrosqueezing transform or invertible reassignment? Towards ideal time-frequency representations, IEEE Trans. on Signal Processing, vol. 63, no. 5, pp. 1335–1344, 2015.

[16]
T. Oberlin and S. Meignen, The second-order wavelet synchrosqueezing transform, in Proc. IEEE Inte. Conf. on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA, 2017, pp. 3994–3998.
[17]

R. Behera, S. Meignen, and T. Oberlin, Theoretical analysis of the second-order synchrosqueezing transform, Applied and Computational Harmonic Analysis, vol. 45, no. 2, pp. 379–404, 2018.

[18]

X. Zhu, B. Li, K. Yang, Z. Zhang, and W. Li, Parameter analysis of chirplet transform and high-resolution time-frequency representation via chirplets combination, Signal Processing, vol. 205, p. 108824, 2023.

[19]

H.-I. Choi and W. J. Williams, Improved time-frequency representation of multicomponent signals using exponential kernels, IEEE Trans.on Acoustics, Speech, and Signal Processing, vol. 37, no. 6, pp. 862–871, 1989.

[20]

R. G. Baraniuk and D. L. Jones, Signal-dependent time-frequency analysis using a radially Gaussian kernel, Signal processing, vol. 32, no. 3, pp. 263–284, 1993.

[21]

D. L. Jones and R. G. Baraniuk, An adaptive optimal-kernel time-frequency representation, IEEE Tran. on Signal Processing, vol. 43, no. 10, pp. 2361–2371, 1995.

[22]

B. Barkat and B. Boashash, A high-resolution quadratic time-frequency distribution for multicomponent signals analysis, IEEE Tran. on Signal Processing, vol. 49, no. 10, pp. 2232–2239, 2001.

[23]

M. Abed, A. Belouchrani, M. Cheriet, and B. Boashash, Time-frequency distributions based on compact support kernels: properties and performance evaluation, IEEE Trans. on Signal Processing, vol. 60, no. 6, pp. 2814–2827, 2012.

[24]

N. A. Khan and B. Boashash, Instantaneous frequency estimation of multicomponent nonstationary signals using multiview time-frequency distributions based on the adaptive fractional spectrogram, IEEE Signal Processing Letters, vol. 20, no. 2, pp. 157–160, 2012.

[25]

B. Boashash, G. Azemi, and J. M. O’Toole, Time-frequency processing of nonstationary signals: Advanced TFD design to aid diagnosis with highlights from medical applications, IEEE signal processing magazine, vol. 30, no. 6, pp. 108–119, 2013.

[26]

B. Boashash and S. Ouelha, An improved design of high-resolution quadratic time-frequency distributions for the analysis of nonstationary multicomponent signals using directional compact kernels, IEEE Trans. on Signal Processing, vol. 65, no. 10, pp. 2701–2713, 2017.

[27]

M. Mohammadi, A. A. Pouyan, N. A. Khan, and V. Abolghasemi, Locally optimized adaptive directional time-frequency distributions, Circuits, Systems, and Signal Processing, vol. 37, pp. 3154–3174, 2018.

[28]

M. Al-Sad, B. Boashash, and M. Gabbouj, Design of an optimal piece-wise spline WignerVille distribution for TFD performance evaluation and comparison, IEEE Trans. on Signal Processing, vol. 69, pp. 3963–3976, 2021.

[29]

S. Ziani, Y. Farhaoui, and M. Moutaib, Extraction of fetal electrocardiogram by combining deep learning and SVD-ICA-NMF methods, Big Data Mining and Analytics, vol. 6, no. 3, pp. 301–310, 2023.

[30]

R. Pang, Y. Yang, A. Huang, Y. Liu, P. Zhang, and G. Tang, Multi-scale feature fusion model for bridge appearance defects detection, Big Data Mining and Analytics, vol. 7, no. 1, pp. 1–11, 2023.

[31]

X. Liu and M. Yang, Research on conversational machine reading comprehension based on dynamic graph neural network, Journal of Integration Technology, vol. 11, no. 2, pp. 67–78, 2022.

[32]

S. Zhang, M. S. R. Pavel, and Y. D. Zhang, Crossterm-free time-frequency representation exploiting deep convolutional neural network, Signal Processing, vol. 192, p. 108372, 2022.

[33]
L. Jiang, H. Zhang, L. Yu, and G. Hua, A data-driven high-resolution time-frequency distribution, IEEE Signal Processing Letters, vol. 29, pp. 1512–1516, 2022.
[34]
N. Liu, J. Wang, Y. Yang, Z. Li, and J. Gao, WVDNet: Time-frequency analysis via semi-supervised learning, IEEE Signal Processing Letters, vol. 30, pp. 55−59, 2023.
[35]
Q. Wang, B. Wu, P. Zhu, P. Li, W. Zuo, and Q. Hu, ECA-Net: Efficient channel attention for deep convolutional neural networks, in Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition, Virtual Event, 2020, pp. 11534–11542.
[36]

S. Mann and S. Haykin, The chirplet transform: Physical considerations, IEEE Trans. on Signal Processing, vol. 43, no. 11, pp. 2745–2761, 1995.

[37]
S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, in Proc. Int. Conf. on machine learning, Lile, France, 2015, pp. 448–456.
[38]
X. Mao, C. Shen, and Y.-B. Yang, Image restoration using very deep convolutional encoder-decoder networks with symmetric skip connections, in Proc. of the 30th In. Conf. on Neural Information Processing Systems, Red Hook, NY, USA, 2016, pp. 2810–2818.
[39]

P. Pan, Y. Zhang, Z. Deng, and W. Qi, Deep learning-based 2D frequency estimation of multiple sinusoidals, IEEE Trans. on Neural Networks and Learning Systems, vol. 33, no. 10, pp. 5429–5440, 2021.

[40]

T. Chen, Q. Chen, Q. Zheng, Z. Li, Z. Zhang, L. Xie, and H. Su, Adaptive multi-scale TF-net for high-resolution time-frequency representations, Signal Processing, vol. 214, p. 109247, 2024.

[41]

P. Flandrin and P. Borgnat, Time-frequency energy distributions meet compressed sensing, IEEE Trans. on Signal Processing, vol. 58, no. 6, pp. 2974–2982, 2010

[42]

L. Stankovic, A measure of some time-frequency distributions concentration, Signal Processing, vol. 81, no. 3, pp. 621–631, 2001.

[43]
S. Meignen, M. Colominas, and D.-H. Pham, On the use of Renyi entropy for optimal window size computation in the short-time Fourier transform, in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP), Virtual Event, 2020, pp. 5830–5834.
[44]

Z. Chen and H.-T. Wu, Disentangling modes with crossover instantaneous frequencies by synchrosqueezed chirplet transforms, from theory to application, Applied and Computational Harmonic Analysis, vol. 62, pp. 84–122, 2023.

[45]

X. Xiong, H. Liu, Z. Deng, M. Fu, W. Qi, and Y. Zhang, Micro-Doppler ambiguity resolution with variable shrinkage ratio based on time-delayed cross correlation processing for wideband radar, IEEE Trans. on Geoscience and Remote Sensing, vol. 57, no. 4, pp. 1906–1917, 2018.

[46]
P. Pan, Y. Zhang, Z. Deng, S. Fan, and X. Huang, TFA-Net: A deep learning-based time-frequency analysis tool, IEEE Trans. on Neural Networks and Learning Systems, vol. 34, no. 11, pp. 9274−9286, 2023.
Big Data Mining and Analytics
Pages 905-919
Cite this article:
Chen T, Jiao Y, Xie L, et al. QTFN: A General End-to-End Time-Frequency Network to Reveal the Time-Varying Signatures of the Time Series. Big Data Mining and Analytics, 2024, 7(3): 905-919. https://doi.org/10.26599/BDMA.2024.9020031

225

Views

23

Downloads

1

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics

Received: 24 October 2023
Revised: 07 May 2024
Accepted: 09 May 2024
Published: 28 August 2024
© The author(s) 2024.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return