Abstract
Helicopter transmission system identification provides model support for fault diagnosis, health monitoring, controller design and so on. The great advantages of deep neural networks are shown in strong nonlinear identification such as helicopter transmission systems. In addition, transfer learning has advantages in the identification of helicopter transmission system with complex and changeable working conditions. In deep transfer learning, domain adversarial neural network can establish a generalization model in complex and variable working conditions, and fast and high-precision identification can be achieved by the network-based transfer method. Therefore, in order to take into account the accuracy and speediness of strong nonlinear helicopter transmission system identification with complicated and variable working conditions, this paper proposes a nonlinear system identification strategy based on domain adversarial neural network in deep transfer learning, which combines pre-trained and fine-tuning. Firstly, the domain adversarial neural network is pre-trained offline under various working conditions. Then, the pre-trained model is fine-tuned online in a single working condition to quickly obtain the high-precision model. The proposed nonlinear system identification strategy can achieve fast and accurate online identification under different working conditions. Finally, the experiment is carried out on the helicopter transmission test platform. The experimental results show that the pre-trained model with four working conditions can achieve high-precision identification under 16 working conditions. Furthermore, the model is fine-tuned based on the pre-trained model. The fine-tuning time is reduced by 41.5% compared to the training time of the same structure model.
Similar content being viewed by others
Data availability
The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.
References
Yin, Z.Y., Fu, B.B., Xue, T.B., Wang, Y.H., Gao, J.: Development of helicopter power transmission system technology. In: Applied mechanics and materials, vol. 86, pp. 1–17. Trans Tech Publications Ltd. (2011)
Patrick-Aldaco, R.: A model based framework for fault diagnosis and prognosis of dynamical systems with an application to helicopter transmissions. Georgia Institute of Technology (2007)
Qi, X., Theilliol, D., Qi, J.T., Zhang, Y.M., Han, J.D., Song, D.L., Wang, L., **a, Y.: Fault diagnosis and fault tolerant control methods for manned and unmanned helicopters: a literature review. In: 2013 Conference on Control and Fault-Tolerant Systems (SysTol), pp. 132–139 (2013)
Leyden, K., Goodwine, B.: Fractional-order system identification for health monitoring. Nonlinear Dyn. 92(3), 1317–1334 (2018)
Zhou, B., Lu, X.J., Tang, S., Zheng, Z.Q.: Nonlinear system identification and trajectory tracking control for a flybarless unmanned helicopter: theory and experiment. Nonlinear Dyn. 96(4), 2307–2326 (2019). https://doi.org/10.1007/s11071-019-04923-9
Quaranta, G., Lacarbonara, W., Masri, S.F.: A review on computational intelligence for identification of nonlinear dynamical systems. Nonlinear Dyn. 99(2), 1709–1761 (2020). https://doi.org/10.1007/s11071-019-05430-7
Ahn, C.K.: ℒ2–ℒ∞ nonlinear system identification via recurrent neural networks. Nonlinear Dyn. 62(3), 543–552 (2010). https://doi.org/10.1007/s11071-010-9741-3
Kou, J.Q., Zhang, W.W., Yin, M.L.: Novel Wiener models with a time-delayed nonlinear block and their identification. Nonlinear Dyn. 85(4), 2389–2404 (2016). https://doi.org/10.1007/s11071-016-2833-y
Pattanaik, R.K., Mohanty, M.N.: nonlinear system identification using robust fusion kernel-based radial basis function neural network. In: 2022 International Conference on Emerging Smart Computing and Informatics (ESCI), pp. 1–5 (2022). https://doi.org/10.1109/ESCI53509.2022.9758338
Son, N.N., Chinh, T.M., Anh, H.P.H.: Uncertain nonlinear system identification using Jaya-based adaptive neural network. Soft. Comput. 24(22), 17123–17132 (2020). https://doi.org/10.1007/s00500-020-05006-3
Qiao, J.F., Wang, G.M., Li, X.L., Li, W.J.: A self-organizing deep belief network for nonlinear system modeling. Appl. Soft Comput. 65, 170–183 (2018). https://doi.org/10.1016/j.asoc.2018.01.019
Li, W.J., Chu, M.H., Qiao, J.F.: A pruning feedforward small-world neural network based on Katz centrality for nonlinear system modeling. Neural Netw. 130, 269–285 (2020). https://doi.org/10.1016/j.neunet.2020.07.017
Zainuddin, F.A., Abd Samad, M.F.: Comparison of crossover in genetic algorithm for discrete-time system identification. Int. Rev. Mech. Eng. (IREME) 15(2), 59–66 (2021). https://doi.org/10.15866/ireme.v15i2.19726
Han, R., Wang, R.J., Zeng, G.M.: Identification of dynamical systems using a broad neural network and particle swarm optimization. IEEE Access 8, 132592–132602 (2020). https://doi.org/10.1109/ACCESS.2020.3009982
Qiao, J.F., Wang, L.Y.: Nonlinear system modeling and application based on restricted Boltzmann machine and improved BP neural network. Appl. Intell. 51(1), 37–50 (2021). https://doi.org/10.1007/s10489-019-01614-1
Aguilar, C.J.Z., Gomez-Aguilar, J.F., Alvarado-Martinez, V.M., Romero-Ugalde, H.M.: Fractional order neural networks for system identification. Chaos Solitons Fractals 130, 109444 (2020). https://doi.org/10.1016/j.chaos.2019.109444
Wang, J.D., Lan, C.L., Liu, C., Ouyang, Y.D., Qin, T., Lu, W., Chen, Y.Q., Zeng, W.J., Yu, P.: Generalizing to unseen domains: a survey on domain generalization. IEEE Trans. Knowl. Data Eng. (2022). https://doi.org/10.1109/TKDE.2022.3178128
Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: International Conference on Machine Learning, vol. 37, pp. 1180–1189 (2015)
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., Lempitsky, V.: Domain-adversarial training of neural networks. J. Mach. Learn. Res. 17(1), 2096 (2016)
Li, H.L., Pan, S.J., Wang, S.Q., Kot, A.C.: Domain generalization with adversarial feature learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5400–5409 (2018)
Blanchard, G., Deshmukh, A.A., Dogan, Ü., Lee, G., Scott, C.: Domain generalization by marginal transfer learning. J. Mach. Learn. Res. 22(1), 46–100 (2021)
Blanchard, G., Lee, G., Scott, C.: Generalizing from several related classification tasks to a new unlabeled sample. Adv. Neural Inf. Process. Syst. 24 (2011)
Albuquerque, I., Monteiro, J., Darvishi, M., Falk, T. H., Mitliagkas, I.: Generalizing to unseen domains via distribution matching. ar**v preprint https://arxiv.org/abs/1911.00804 (2019)
Tan, C.Q., Sun, F.C., Kong, T., Zhang, W.C., Yang, C., Liu, C.F.: A survey on deep transfer learning. In: International Conference on Artificial Neural Networks, pp. 270–279 (2018). https://doi.org/10.1007/978-3-030-01424-7_27
Rehman, A., Naz, S., Razzak, M.I., Akram, F., Imran, M.: A deep learning-based framework for automatic brain tumors classification using transfer learning. Circuits Syst. Signal Process. 39(2), 757–775 (2020). https://doi.org/10.1007/s00034-019-01246-3
Guo, Y.H., Shi, H.H., Kumar, A., Grauman, K., Rosing, T., Feris, R.: Spottune: transfer learning through adaptive fine-tuning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4805–4814 (2019). https://doi.org/10.1109/CVPR.2019.00494
Bansod, S., Nandedkar, A.: Transfer learning for video anomaly detection. J. Intell. Fuzzy Syst. 36(3), 1967–1975 (2019). https://doi.org/10.3233/JIFS-169908
Wang, A.X., Tran, C., Desai, N., Lobell, D., Ermon, S.: Deep transfer learning for crop yield prediction with remote sensing data. In: Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies, pp. 1–5 (2018). https://doi.org/10.1145/3209811.3212707
Guo, Y.H., Li, Y.D., Wang, L.Q., Rosing, T.: Adafilter: adaptive filter fine-tuning for deep transfer learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 4060–4066 (2020)
Peng, C., Tao, Y.F., Chen, Z.P., Zhang, Y., Sun, X.Y.: Multi-source transfer learning guided ensemble LSTM for building multi-load forecasting. Expert Syst. Appl. 202, 117194 (2022). https://doi.org/10.1016/j.eswa.2022.117194
Acknowledgements
This work is supported by the National Natural Science Foundation of China (No. 52241502), and the National defense technology basic research project of China (No. JSZL2022110A).
Funding
The authors have not disclosed any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, T., Zhang, X., Wang, C. et al. Domain adversarial neural network-based nonlinear system identification for helicopter transmission system. Nonlinear Dyn 111, 14695–14711 (2023). https://doi.org/10.1007/s11071-023-08657-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11071-023-08657-7