SpringerLink
Log in

Enhanced long short-term memory with fireworks algorithm and mutation operator

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

Prediction models are used to prevent and prepare for corresponding events according to various types of data generated in production. Aiming at the problems of lower predictive accuracy and slower convergent speed of the existing prediction models, a prediction model based on fireworks algorithm (FWA) and long short-term memory (LSTM) is proposed to predict time-related data. Firstly, we establish the interconnection structure model of the hidden layer nodes in the LSTM. Then, considering the diversity and concurrency of the group, we optimize the hyperparameters combination of LSTM. Finally, we improve FWA by adding three mutation operators (Gaussian mutation operator, Cauchy mutation operator, and discrete mutation operator). Based on the enhanced FWA, we achieve a better optimization effect by increasing the diversity of hyperparameters combination. The experimental results show that the performance of the proposed LSTM-enhanced FWA model has been significantly improved by comparing to the existing LSTM and LSTM-GS models. The mean absolute error (MAE) is reduced by 38.49% and 17.79%, respectively; the root mean squared error (RMSE) is reduced by 29.47% and 19.28%, respectively; and the mean absolute percentage error (MAPE) is reduced by 36.67% and 26.92%, respectively. MAE and MAPE represent the degree of deviation between the predicted value and actual value, and RMSE well reflects the precision. This means that the proposed LSTM-enhanced FWA model is better than existing LSTM and LSTM-GS models because all three types of error are reduced, meanwhile three kinds of error better reflect accuracy and precision of error.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Zhang B, Zuo H, Huang Z et al (2020) Endpoint forecast of different diesel–biodiesel soot filtration process in diesel particulate filters considering ash deposition. Fuel 272:117678

    Article  Google Scholar 

  2. Zhang X, Chan KW, Li H et al (2020) Deep-learning-based probabilistic forecasting of electric vehicle charging load with a novel queuing model. IEEE Trans Cybern PP(99):1–14

    Google Scholar 

  3. Aladin S, Tran AVS, Allogba S et al (2020) Quality of transmission estimation and short-term performance forecast of lightpaths. J Lightw Technol PP(99):1–1

    Google Scholar 

  4. Egbelakin T, Zhao LL, Wang B et al (2020) Using artificial neural networks to forecast producer price index for New Zealand. Int J Int Manuf Serv 7(3):191

    Google Scholar 

  5. He L, Qian Z, Shang F (2020) A novel predicted replication strategy in cloud storage. J Supercomput 76(7):4838–4856

    Article  Google Scholar 

  6. Wang Z, Guo N, Wang S et al (2020) Prediction of highway asphalt pavement performance based on Markov chain and artificial neural network approach. J Supercomput

  7. Feng J, Wang W, Xu F et al (2020) Estimating surface heat and water vapor fluxes by combining two-source energy balance model and back-propagation neural network. Sci Total Environ 729:138724

    Article  Google Scholar 

  8. Ye Z, Yun L, Wang Y (2020) Prediction of storage tobacco mildew based on BP neural network optimized by beetle antennae search algorithm. In: 2020 Chinese Control and Decision Conference (CCDC)

  9. Dong H, Chong L, Zhou H et al (2020) A prediction model for local scour depth based on BP and GA-BP neural network. IOP Conf Ser Earth Environ Sci 525(1):012005 ((5pp))

    Article  Google Scholar 

  10. Cho K, Van Merrienboer B, Gulcehre C, et al (2014) Learning phrase representations using RNN encoder–decoder for statistical machine translation. Comput Sci

  11. Miao Y, Gowayyed M, Metze F (2015) EESEN: end-to-end speech recognition using deep RNN models and WFST-based decoding

  12. Zhao F, Zeng GQ, Lu KD (2020) EnLSTM-WPEO: short-term traffic flow prediction by ensemble LSTM, NNCT weight integration, and population extremal optimization. IEEE Trans Veh Technol 69(1):101–113

    Article  Google Scholar 

  13. Srivastava S, Lessmann S (2018) A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data. Sol Energy 162(mar.):232–247

    Article  Google Scholar 

  14. Laib O, Khadir MT, Mihaylova L (2019) Toward efficient energy systems based on natural gas consumption prediction with LSTM recurrent neural networks. Energy 177(JUN.15):530–542

    Article  Google Scholar 

  15. Hu Y, Yan L, Hang T, et al (2020) Stream-flow forecasting of small rivers based on LSTM

  16. Zheng J, Huang M (2020) Traffic flow forecast through time series analysis based on deep learning. IEEE Access PP(99):1–1

    Google Scholar 

  17. Hewage P, Trovati M, Pereira E et al (2021) Deep learning-based effective fine-grained weather forecasting model. Pattern Anal Appl 24(1):343–366

    Article  Google Scholar 

  18. Sun G, Jiang C, Wang X et al (2020) Short-term building load forecast based on a data-ining feature selection and LSTMInNN method. IEEE Trans Electr Electron Eng 15(7):1002–1010

    Article  Google Scholar 

  19. Dhunny AZ, Timmons DS, Allam Z et al (2020) An economic assessment of near-shore wind farm development using a weather research forecast-based genetic algorithm model. Energy 201:117541

    Article  Google Scholar 

  20. Adedeji PA, Akinlabi S, Madushele N et al (2020) Wind turbine power output short-term forecast: a comparative study of data clustering techniques in a PSO-ANFIS model. J Clean Prod 254:120135

    Article  Google Scholar 

  21. Jamali B, Rasekh M, Jamadi F et al (2018) Using PSO–GA algorithm for training artificial neural network to forecast solar space heating system parameters. Appl Thermal Eng 147:647–660

    Article  Google Scholar 

  22. Ya-Chao HU, Chao L, Yong C et al (2019) Neural network power load forecast based on PCA-PSO-RBF. Tech Autom Appl

  23. Tan Y, Zhu Y (2010) Fireworks algorithm for optimization. In: International Conference in Swarm Intelligence. Springer

  24. Tan Y (2015) Fireworks algorithm. https://doi.org/10.1007/978-3-662-46353-6

  25. Zheng S, Janecek A, Li J, et al (2014) Dynamic search in fireworks algorithm. In: IEEE Congress on Evolutionary Computation. IEEE

  26. Liu S, Zhang Z, Guan C et al (2020) An improved fireworks algorithm for the constrained single-row facility layout problem. Int J Prod Res 1:1–19

    Google Scholar 

  27. Pang X, Xue H, Tseng ML et al (2020) Hybrid flow shop scheduling problems using improved fireworks algorithm for permutation. Appl Sci 10(3):1174

    Article  Google Scholar 

  28. Xu Z, Zhang K, Xu X et al (2020) A fireworks algorithm based on transfer spark for evolutionary multitasking. Front Neurorobotics 13:109

    Article  Google Scholar 

  29. Pang X, Li Z, Tseng ML et al (2020) Electric vehicle relay lifetime prediction model using the improving fireworks algorithm-grey neural network model. Appl Sci 10(6):1940

    Article  Google Scholar 

  30. Yan X, Huang H, Hao Z et al (2020) A graph-based fuzzy evolutionary algorithm for solving two-echelon vehicle routing problems. IEEE Trans Evol Comput 24(1):129–141

    Article  Google Scholar 

  31. Neshat M, Alexander B, Wagner M (2020) A hybrid cooperative co-evolution algorithm framework for optimising power take off and placements of wave energy converters. Inform Sci 534:218–244

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was funded by the Scientific Research Foundation for Advanced Talents from Shenyang Aerospace University—18YB06, and the National Basic Research Program of China—JCKY2018410C004.

Author information

Authors and Affiliations

  1. School of Computer Science, Shenyang Aerospace University, Shenyang, 110136, China

    Changqing Gong, **nyao Wang & Han Qi

  2. Faculty of Computing and Informatics, University Malaysia Sabah, 87000, Labuan, Malaysia

    Abdullah Gani

Authors
  1. Changqing Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. **nyao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abdullah Gani
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Han Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Han Qi.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gong, C., Wang, X., Gani, A. et al. Enhanced long short-term memory with fireworks algorithm and mutation operator. J Supercomput 77, 12630–12646 (2021). https://doi.org/10.1007/s11227-021-03679-7

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-021-03679-7

Keywords

Search

Navigation