Abstract
Predictive analytics is being increasingly recognized as being important for evaluating university students’ academic achievement. Utilizing big data analytics particularly students’ demographic information, offers valuable insights to bolster academic success and enhance completion rates. For instance, learning analytics is a vital element of big data within university settings, offering strategic decision-makers the chance to conduct time series analyses on learning activities. We have used semesters first and second records of Polytechnic Institute of Portalegre students. Advanced deep learning methods, such as the Long short-term memory (LSTM) model are employed to analyze students at risk of retention issues. Typically, the best design for a deep neural network model was found by trial and error, which is a laborious and exponential combinatorial challenge. Hence we proposed the heuristic technique to configure the parameters of the neural network. The parameter taken into account in this work is the learning rate of the Adam optimizer. In this study, we have presented the ant colony optimization (ACO) technique to determine the ideal learning rate for model training. Experimental results obtained with the predictive model indicated that prediction of student retention is possible with a high level of accuracy using ACO-LSTM approach.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Tanucci, G., Fasanella, A.: Orientamento e carriera universitaria. Ingressi ed abbandoni in 5 Facoltà dell’Università di Roma “La Sapienza” nel nuovo assetto didattico (2006)
Bentler, P.M., Speckart, G.: Models of attitude-behavior relations. Psychol. Rev. 86(5), 452 (1979)
Pascarella, E.T., Terenzini, P.T.: Predicting freshman persistence and voluntary dropout decisions from a theoretical model. J. High. Educ. 51(1), 60–75 (1980)
Raju, D., Schumacker, R.: Exploring student characteristics of retention that lead to graduation in higher education using data mining models. J. Coll. Student Retention: Res. Theory Pract. 16(4), 563–591 (2015)
Bala, M., Ojha, D.B.: Study of applications of data mining techniques in education. Int. J. Res. Sci. Technol. 1(4), 1–10 (2012)
Alban, M., Mauricio, D.: Neural networks to predict dropout at the universities. Int. J. Mach. Learn. Comput. 9(2), 149–153 (2019)
Sivakumar, S., Venkataraman, S., Selvaraj, R.: Predictive modeling of student dropout indicators in educational data mining using improved decision tree. Indian J. Sci. Technol. (2016)
Pereira, R.T., Romero, A.C., Toledo, J.J.: Extraction student dropout patterns with data mining techniques in undergraduate programs. In: International Conference on Knowledge Discovery and Information Retrieval, vol. 2. SCITEPRESS (2013)
Nagy, M., Molontay, R.: Predicting dropout in higher education based on secondary school performance. In: 2018 IEEE 22nd International Conference on Intelligent Engineering Systems (INES). IEEE (2018)
Uliyan, D., et al.: Deep learning model to predict students retention using BLSTM and CRF. IEEE Access 9, 135550–135558 (2021)
Domashova, J.V., et al.: Selecting an optimal architecture of neural network using genetic algorithm. Procedia Comput. Sci. 190, 263–273 (2021)
Luo, X.J., et al.: Genetic algorithm-determined deep feedforward neural network architecture for predicting electricity consumption in real buildings. Energy AI 2, 100015 (2020)
Realinho, V., et al.: Predicting student dropout and academic success. Data 7(11), 146 (2022)
Dorigo, M., Birattari, M., Stutzle, T.: Ant colony optimization. IEEE Comput. Intell. Mag. 1(4), 28–39 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
Conflict of Interest
The Authors declare that they have no conflict of interest.
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Singh, A.K., Karthikeyan, S. (2024). Heuristic Technique to Find Optimal Learning Rate of LSTM for Predicting Student Dropout Rate. In: Olney, A.M., Chounta, IA., Liu, Z., Santos, O.C., Bittencourt, I.I. (eds) Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky. AIED 2024. Communications in Computer and Information Science, vol 2151. Springer, Cham. https://doi.org/10.1007/978-3-031-64312-5_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-64312-5_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-64311-8
Online ISBN: 978-3-031-64312-5
eBook Packages: Computer ScienceComputer Science (R0)