Towards Physics-Based Metrics for Transfer Learning in Dynamics

  • Conference paper
  • First Online:
Data Science in Engineering, Volume 10 (SEM 2023)

Abstract

Data used for training structural health monitoring (SHM) systems are often expensive and/or impractical to obtain, particularly labelled data. Population-based SHM presents a potential solution to this issue by considering the available data across a population of structures. However, differences between structures will mean that the training and testing distributions will differ; thus, conventional machine learning methods cannot be expected to generalise between structures. To address this issue, transfer learning—in the form of domain adaptation (DA)—can be used to align the underlying distributions. An important consideration when applying DA is that it may lead to performance degradation; this scenario is referred to as negative transfer. Furthermore, validating whether negative transfer has occurred is challenging without labelled data, so assessing the similarity between the datasets is of critical importance to mitigate the likelihood of negative transfer. Typical unsupervised metrics measure the discrepancy between the marginal distributions, so they are not robust to scenarios where the conditional distributions differ significantly. This paper presents a discussion on negative transfer, proposing a physics-based metric that utilises the modal assurance criteria (MAC), between the modes of the healthy structures. This metric is compared to other popular metrics, showing that the proposed MAC-based metric indicates the likelihood of negative transfer under conditional distribution shift, whereas the previous unsupervised methods cannot.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Thailand)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 192.59
Price includes VAT (Thailand)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
EUR 229.99
Price excludes VAT (Thailand)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    This method assumes that some normal condition data can be labelled by assuming data from the start of a monitoring campaign correspond to the healthy structure.

  2. 2.

    This approach could be used to predict any performance metric by normalising values to \([0,1]\).

References

  1. Dervilis, N., Choi, M., Taylor, S., Barthorpe, R., Park, G., Farrar, C., Worden, K.: On damage diagnosis for a wind turbine blade using pattern recognition. J. Sound Vib. 333(6), 1833–1850 (2014)

    Article  Google Scholar 

  2. Farrar, C., Worden, K.: Structural Health Monitoring: A Machine Learning Perspective. Wiley, Chichester (2013)

    Google Scholar 

  3. Bull, L.A., Gardner, P., Gosliga, J., Rogers, T.J., Dervilis, N., Cross, E.J., Papatheou, E., Maguire, A.E., Campos, C., Worden, K.: Foundations of population-based SHM, Part I: Homogeneous populations and forms. Mech. Syst. Signal Process. 148, 107141 (2021)

    Article  Google Scholar 

  4. Gosliga, J., Gardner, P., Bull, L.A., Dervilis, N., Worden, K.: Foundations of population-based SHM, Part II: heterogeneous populations – graphs, networks, and communities. Mech. Syst. Signal Process. 148, 107144 (2021)

    Article  Google Scholar 

  5. Gardner, P., Bull, L., Gosliga, J., Dervilis, N., Worden, K.: Foundations of population-based SHM, Part III: Heterogeneous populations – Map** and transfer. Mech. Syst. Signal Process. 149, 107142 (2021)

    Article  Google Scholar 

  6. Zhuang, F., Qi, Z., Duan, K., **, D., Zhu, Y., Zhu, H., **ong, H., He, Q.: A comprehensive survey on transfer learning. Proc. IEEE 109(1), 43–76 (2021)

    Article  Google Scholar 

  7. Xu, S., Noh, H.Y.: Phymdan: Physics-informed knowledge transfer between buildings for seismic damage diagnosis through adversarial learning. Mech. Syst. Signal Process. 151, 107374 (2021)

    Article  Google Scholar 

  8. Gardner, P., Bull, L., Gosliga, J., Poole, J., Dervilis, N., Worden, K.: A population-based shm methodology for heterogeneous structures: Transferring damage localisation knowledge between different aircraft wings. Mech. Syst. Signal Process. 172, 108918 (2022)

    Article  Google Scholar 

  9. Bull, L., Gardner, P., Dervilis, N., Papatheou, E., Haywood-Alexander, M., Mills, R., Worden, K.: On the transfer of damage detectors between structures: An experimental case study. J. Sound Vib. 501, 116072 (2021)

    Article  Google Scholar 

  10. Gardner, P., Bull, L., Dervilis, N., Worden, K.: Overcoming the problem of repair in structural health monitoring: Metric-informed transfer learning. J. Sound Vib., 116245 (2021)

    Google Scholar 

  11. Gardner, P., Liu, X., Worden, K.: On the application of domain adaptation in structural health monitoring. Mech. Syst. Signal Process. 138, 106550 (2020)

    Article  Google Scholar 

  12. Zhang, W., Deng, L., Wu, D.: Overcoming negative transfer: A survey. ar**v, pp. 1–15 (2020)

    Google Scholar 

  13. Ben-David, S., Blitzer, J., Crammer, K., Pereira, F.: Analysis of representations for domain adaptation. Adv. Neural Inf. Process. Syst., 137–144 (2007)

    Google Scholar 

  14. Gretton, A., Sriperumbudur, B., Sejdinovic, D., Strathmann, H., Balakrishnan, S., Pontil, M., Fukumizu, K.: Optimal kernel choice for large-scale two-sample tests. Adv. Neural Inf. Process. Syst. 2, 1205–1213 (2012)

    Google Scholar 

  15. Allemang, R.J.: The modal assurance criterion–twenty years of use and abuse. Sound Vib. 37(8), 14–23 (2003)

    Google Scholar 

  16. Long, M., Wang, J., Ding, G., Pan, S.J., Yu, P.S.: Adaptation regularization: A general framework for transfer learning. IEEE Trans. Knowl. Data Eng. 26(5), 1076–1089 (2014)

    Article  Google Scholar 

  17. Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Vaughan, J. W.: A theory of learning from different domains. Mach. Learn. 79(1-2), 151–175 (2010)

    Article  MathSciNet  Google Scholar 

  18. Murphy, K.P.: Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge (2012)

    Google Scholar 

  19. Jialin Pan, S., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)

    Article  Google Scholar 

  20. Long, M., Cao, Y., Wang, J., Jordan, M.I.: Learning transferable features with deep adaptation networks. In: 32nd International Conference on Machine Learning, ICML 2015, vol. 1, pp. 97–105 (2015)

    Google Scholar 

  21. Wang, J., Chen, Y., Hao, S., Feng, W., Shen, Z.: Balanced distribution adaptation for transfer learning. In: Proceedings - IEEE International Conference on Data Mining, ICDM, pp. 1129–1134 (2017)

    Google Scholar 

  22. Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, pp. 1180–1189 (2015)

    Google Scholar 

  23. Long, M., Cao, Z., Wang, J., Jordan, M.I.: Conditional adversarial domain adaptation. Adv. Neural Inf. Process. Syst. 2018-Decem(NeurIPS), 1640–1650 (2018)

    Google Scholar 

  24. Worden, K., Dulieu-Barton, J.: An overview of intelligent fault detection in systems and structures. Struct. Health Monit. 3(1), 85–98 (2004)

    Article  Google Scholar 

  25. Farrar, C.R., Cornwell, P.J., Doebling, S.W., Prime, M.B.: Structural health monitoring studies of the alamosa canyon and i-40 bridges. Technical report, Los Alamos National Lab.(LANL), Los Alamos, NM (United States), 2000

    Google Scholar 

  26. Dervilis, N., Worden, K., Cross, E.: On robust regression analysis as a means of exploring environmental and operational conditions for shm data. J Sound Vib. 347, 279–296 (2015)

    Article  Google Scholar 

  27. Worden, K., Burrows, A.: Optimal sensor placement for fault detection. Eng. Struct. 23(8), 885–901 (2001)

    Article  Google Scholar 

  28. Christides, S., Barr, A.D.S.: One-dimensional theory of cracked Bernoulli-Euler beams. Int. J. Mech. Sci. 26(11-12), 639–648 (1984)

    Article  Google Scholar 

  29. Gong, B., Shi, Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2066–2073 (2012)

    Google Scholar 

  30. Poole, J., Gardner, P., Dervilis, N., Bull, L., Worden, K.: On statistic alignment for domain adaptation in structural health monitoring. Preprint (2022). ar**v:2205.12052

    Google Scholar 

  31. Pan, S.J., Ni, X., Sun, J.T., Yang, Q., Chen, Z.: Cross-domain sentiment classification via spectral feature alignment. In: Proceedings of the 19th International Conference on World Wide Web, WWW ’10, pp. 751–760 (2010)

    Google Scholar 

  32. Mclean, J., Jones, M., O’Connell, B., Maguire, A., Rogers, T.: Physically meaningful uncertainty quantification in probabilistic wind turbine power curve models as a damage sensitive feature. Preprint (2022). ar**v:2209.15579

    Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the support of the UK Engineering and Physical Sciences Research Council via grants EP/R006768/1, EP/R003645/1, EP/R004900/1 and EP/W005816/1. For the purpose of open access, the authors have applied for a Creative Commons Attribution (CC-BY-ND) licence to any author accepted manuscript version arising.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to J. Poole .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Society for Experimental Mechanics, Inc

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Poole, J., Gardner, P., Dervilis, N., Mclean, J.H., Rogers, T.J., Worden, K. (2023). Towards Physics-Based Metrics for Transfer Learning in Dynamics. In: Madarshahian, R., Hemez, F. (eds) Data Science in Engineering, Volume 10. SEM 2023. Conference Proceedings of the Society for Experimental Mechanics Series. Springer, Cham. https://doi.org/10.1007/978-3-031-34946-1_9

Download citation

Publish with us

Policies and ethics

Navigation