Temporal Convolution Network Based on Attention for Intelligent Anomaly Detection of Wind Turbine Blades

  • Conference paper
  • First Online:
Algorithms and Architectures for Parallel Processing (ICA3PP 2021)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 13155))

Abstract

With the concept of “carbon neutral”, wind power industry ushers in a golden period of development. Wind turbine blades are the key components of wind turbine, their normal operation directly affects the operation of the whole wind power generation. The traditional diagnosis method of wind turbine blades needs to disassemble the wind turbine blades. However, due to the potential of long-short-term memory network model and feedforward network based on attention mechanism in anomaly detection and diagnosis, sequence model has become the mainstream of wind turbine blades anomaly detection. Unfortunately, RNN needs to wait for the end of the forward transmission of the previous time step before the forward transmission of the next time step. It can only input all the historical information by default, and can not achieve the fine control of the input information. Therefore, this paper applies TCN-ATT, a temporal convolution network based on attention mechanism, to intelligent anomaly detection of wind turbine blades by combining dilation convolution, causal convolution, the skip connection of residual blocks and attention module. In this method, causal convolution and dilation convolution are used to adapt to the frame of multi-dimensional time series data of wind turbine blades, which provides more flexibility for changing the size of receptive field. At the same time, attention mechanism is added to capture the relevant features in the sequence, so as to improve the classification accuracy of anomaly detection of wind turbine blades. To verify the effectiveness of the system, this paper compares the performance of TCN-ATT with TCN, LSTM, GRU and other methods. The comparative test shows that TCN-ATT has better performance of feature extraction and anomaly detection. In addition, TCN-ATT is applied to multi fault anomaly detection, which also achieves high classification accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (Canada)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Lu, X., Fan, Y., Qian, K.: Summary and development trend of equipment fault diagnosis technology. Mining Mach. 035(012), 15–18 (2007). (in chinese)

    Google Scholar 

  2. Ince, T., Kiranyaz, S., Eren, L., et al.: Real-time motor fault detection by 1D convolutional neural networks. IEEE Trans. Ind. Electron. 63(11) (2016)

    Google Scholar 

  3. Zhao, M., Kang, M., Tang, B., et al.: Deep residual networks with dynamically weighted wavelet coefficients for fault diagnosis of planetary gearboxes. IEEE Trans. Industr. Electron. 65(5), 4290–4300 (2018)

    Article  Google Scholar 

  4. Wang, S., **ang, J., Zhong, Y., et al.: A data indicator-based deep belief networks to detect multiple faults in axial piston pumps - ScienceDirect. Mech. Syst. Signal Process. 112, 154–170 (2018)

    Article  Google Scholar 

  5. Rahimilarki, R., Gao, Z., **, N., et al.: Time-series deep learning fault detection with the application of wind Turbine benchmark. In: 2019 IEEE 17th International Conference on Industrial Informatics (INDIN). IEEE (2019)

    Google Scholar 

  6. Liu, Y., Cheng, H., Kong, X., et al.: Intelligent wind turbine blade icing detection using supervisory control and data acquisition data and ensemble deep learning. Energy Sci. Eng. 7(6) (2019)

    Google Scholar 

  7. **an, D., Han, N., Wei, T.: Fault identification of direct drive wind turbine based on deep learning. Renewable Energy Resources (2018)

    Google Scholar 

  8. Bai S, Kolter J Z, Koltun V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. CoRR, abs/1803.01271 (2018)

    Google Scholar 

  9. Yan, J., Mu, L., Wang, L., et al.: Temporal convolutional networks for the advance prediction of ENSO. Sci. Rep. 10(1), 8055 (2020)

    Article  Google Scholar 

  10. Dai, R., Xu, S., Gu, Q., et al.: Hybrid spatio-temporal graph convolutional network: improving traffic prediction with navigation data. ACM (2020)

    Google Scholar 

  11. Guirguis, K., Schorn, C., Guntoro, A., et al.: SELD-TCN: sound event localization & detection via temporal convolutional networks (2020)

    Google Scholar 

  12. Oord, A., Dieleman, S., Zen, H., et al.: WaveNet: a generative model for raw audio (2016)

    Google Scholar 

  13. Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions. In: ICLR (2016)

    Google Scholar 

  14. He, K., Zhang, X., Ren, S., et al.: Deep Residual Learning for Image Recognition. IEEE (2016)

    Google Scholar 

  15. Zhang, H., Zhou, Q., Ren, X.: Analog detection for wind turbines based on autoencoder model. Software Guide 018(009), 158–162 (2019)

    Google Scholar 

  16. Chung, J., Gulcehre, C., Cho, K.H., et al.: Empirical evaluation of gated recurrent neural networks on sequence modeling. Eprint Arxiv (2014)

    Google Scholar 

  17. Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  18. Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention Is All You Need. ar**v (2017)

    Google Scholar 

  19. Bai, S., Kolter, J.Z., Koltun, V.: Trellis Networks for Sequence Modeling (2018)

    Google Scholar 

  20. Katser, I.D., Kozitsin, V.O.: Skoltech Anomaly Benchmark (SKAB). Kaggle (2020). https://doi.org/10.34740/KAGGLE/DSV/1693952

  21. Malhotra, P., Ramakrishnan, A., Anand, G., et al.: LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection (2016)

    Google Scholar 

  22. Fan, H., Zhang, F., Li, Z.: AnomalyDAE: dual autoencoder for anomaly detection on attributed networks. In: ICASSP 2020–2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2020)

    Google Scholar 

  23. Luo, W., Wen, L., Gao, S.: Remembering history with convolutional LSTM for anomaly detection. In: 2017 IEEE International Conference on Multimedia and Expo (ICME). IEEE (2017)

    Google Scholar 

  24. Cao V L, Nicolau M, Mcdermott J. A Hybrid Autoencoder and Density Estimation Model for Anomaly Detection[C]// International Conference on Parallel Problem Solving from Nature. Springer, Cham, 2016

    Google Scholar 

  25. Tao, X., Peng Y, Zhao F, et al. An Improved Parallel Network Traffic Anomaly Detection Method Based on Bagging and GRU[C]// International Conference on Wireless Algorithms, Systems, and Applications. Springer, Cham, 2020

    Google Scholar 

  26. Hao, H., Wang, Y., **a, Y., et al.: Temporal convolutional attention-based network for sequence modeling (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fan Lin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ding, J., Lin, F., Lv, S. (2022). Temporal Convolution Network Based on Attention for Intelligent Anomaly Detection of Wind Turbine Blades. In: Lai, Y., Wang, T., Jiang, M., Xu, G., Liang, W., Castiglione, A. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2021. Lecture Notes in Computer Science(), vol 13155. Springer, Cham. https://doi.org/10.1007/978-3-030-95384-3_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-95384-3_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-95383-6

  • Online ISBN: 978-3-030-95384-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation