Abstract
The use of deep learning for sequence learning problems and system identification are intimately linked, and interesting opportunities exist on this cross section. The aim of this chapter is to briefly introduce deep learning from a system identification perspective and to explain some of the most apparent links between these two topics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Bibliography
Andersson C, Ribeiro AH, Tiels K, Wahlström N, Schön TB (2019) Deep convolutional networks are useful in system identification. In: Proceedings of the IEEE 58th IEEE Conference on Decision and Control (CDC), Nice
Bai S, Kolter JZ, Koltun V (2018) An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. Technical report. ar**v:1803.01271
Bottou L, Curtis FE, Nocedal J (2018) Optimization methods for large-scale machine learning. SIAM Rev 60(2):223–311
Boulanger-Lewandowski N, Bengio Y, Vincent P (2012) Modeling temporal dependencies in high-dimensional sequences: application to polyphonic music generation and transcription. In: Proceedings of the 29 th International Conference on Machine Learning (ICML), Edinburgh
Breiman L, Friedman J, Olshen R, Stone C (1984) Classification and regression trees. Belmont, Wadsworth
Cho K, Merrienboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y (2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha
Chung J, Kastner K, Dinh L, Goel K, Courville AC, Bengio Y (2015) A recurrent latent variable model for sequential data. In: Advances in Neural Information Processing Systems (NIPS)
Fabius O, van Amersfoort JR, Kingma DP (2014) Variational recurrent auto-encoders. Technical report. ar**v:1412.6581
Geman S, Bienenstock E, Doursat R (1992) Neural networks and the bias/variance dilemma. Neural Comput 4(1):1–58
Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge/London
Hinton G, Deng L, Yu D, Dahl GE, Mohamed A, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN, Kingsbury B (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82–97
Hochreiter S, Schmidthuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems NIPS, pp 1097–1105
LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444
Ljung L (1999) System identification – theory for the user, 2nd edn. Prentice Hall, Upper Saddle River
McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5(4):115–133
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. Technical report. ar**v:1301.3781
Osendorfer C, Bayer J (2014) Learning stochastic recurrent networks. Technical report. ar**v:1411.7610
Pascanu R, Gulcehre C, Cho K, Bengio Y (2014) How to construct deep recurrent neural networks. In: Proceedings of the 2nd International Conference on Learning Representations (ICLR)
Rangapuram SS, Seeger MW, Gasthaus J, Stella L, Wang Y, Januschowski T (2018) Deep state space models for time series forecasting. In: Advances in Neural Information Processing Systems (NIPS), pp 7785–7794
Robbins H, Monro S (1951) A stochastic approximation method. Ann Math Stat 22(3):400–407
Schoukens J, Ljung L (2019) Nonlinear system identification – a user-oriented roadmap. IEEE Control Syst Mag 39(6):28–99. https://doi.org/10.1109/MCS.2019.2938121, IEEE https://ieeexplore.ieee.org/document/8897147
Schoukens J, Vaes M, Pintelon R (2016) Linear system identification in a nonlinear setting: nonparametric analysis of the nonlinear distortion and their impact on the best linear approximation. IEEE Control Syst Mag 36:38–69
Williams RJ, Hinton GE, Rumelhart DE (1986) Learning representations by back-propagating errors. Nature 323:533–536
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this entry
Cite this entry
Schön, T., Ljung, L. (2021). Deep Learning in a System Identification Perspective. In: Baillieul, J., Samad, T. (eds) Encyclopedia of Systems and Control. Springer, Cham. https://doi.org/10.1007/978-3-030-44184-5_100089
Download citation
DOI: https://doi.org/10.1007/978-3-030-44184-5_100089
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-44183-8
Online ISBN: 978-3-030-44184-5
eBook Packages: Intelligent Technologies and RoboticsReference Module Computer Science and Engineering