Abstract
To mitigate the adverse effects of floods, hydrologists are increasingly turning to artificial intelligence methodologies to enhance streamflow forecasting capabilities. Drawing inspiration from the efficacy of the Long Short-Term Memory (LSTM) model in capturing temporal dynamics and dependencies within data set, we have employed LSTM for predicting sequential flow rates utilizing collected data sets. Recognizing that not all data set contribute equally to accurate flood forecasts, it becomes imperative to discern and prioritize the relevant variables. Conventional LSTM models often fall short in effectively identifying and ranking informative factors. To overcome this limitation, we introduce an Attention LSTM (ALSTM) model tailored for streamflow forecasting, adept at identifying and capturing critical factors within the time series dataset. Leveraging data set sourced from the United States Geological Survey (USGS), our proposed model exhibits notable performance enhancements. By integrating an attention mechanism during the pre-processing stage, the ALSTM model showcases its ability to generate precise long-term forecasts across most of the basins. Utilizing a continuous 33-year streamflow data set (1970–2003), our proposed model surpasses conventional time series approaches in streamflow forecasting accuracy.
This is a preview of subscription content, log in via an institution to check access.
Data availability
The data that support the findings of this study are openly available at https://hydrology.nws.noaa.gov/pub/gcip/mopex/US_Data/.
References
Achite M, Emami S, Jehanzaib M, Katipoğlu OM, Emami H (2024) An election algorithm combined with support vector regression for estimating hydrological drought. Model Earth Syst Environ 10(1):1395–1405. https://doi.org/10.1007/s40808-023-01850-y
Akram MZ, Amrani EC (2016) Sequence to Sequence Weather Forecasting with Long Short-Term Memory Recurrent Neural Networks. Int J Computer Appl 143(11):7–11. https://doi.org/10.5120/ijca2016910497
Anctil F, Rat A (2005) Evaluation of Neural Network Streamflow Forecasting on 47 Watersheds. J Hydrol Eng 10(1):85–88. https://doi.org/10.1061/(asce)1084-0699(2005)10:1(85)
Ayele MA, Ayalew AT (2024) Modeling of watershed intervention techniques to rehabilitate sediment yield hotspot areas in Hare watershed, rift valley basin. Ethiopia Model Earth Syst Environ 10(1):425–441. https://doi.org/10.1007/s40808-023-01808-0
Bahdanau D, Cho K, Bengio Y (2015) Neural machine translation by jointly learning to align and translate. International Conference on Learning Representations (ICLR). https://arxiv.org/abs/1409.0473
Chen PA, Chang LC, Chang FJ (2013) Reinforced recurrent neural networks for multi-step-ahead flood forecasts. J Hydrol 497:71–79. https://doi.org/10.1016/j.jhydrol.2013.05.038
Chen C, Jiang J, Zhou Y, Lv N, Liang X, Wan S (2022) An edge intelligence empowered flooding process prediction using Internet of things in smart city. J Parallel Distributed Computing 165:66–78. https://doi.org/10.1016/j.jpdc.2022.03.010
Cheng J, Dong L, Lapata M (2016) Long short-term memory-networks for machine reading. EMNLP 2016 - Conference on Empirical Methods in Natural Language Processing, Proceedings 551–561. https://doi.org/10.18653/v1/d16-1053
Chiang YM, Chang LC, Chang FJ (2004) Comparison of static-feedforward and dynamic-feedback neural networks for rainfall-runoff modeling. J Hydrol 290(3–4):297–311. https://doi.org/10.1016/j.jhydrol.2003.12.033
Chung J, Gulcehre C, Cho K, Bengio Y (2014) Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. 1–9. Available at: http://arxiv.org/abs/1412.3555. Accessed 24 Jan 2024
Deshmukh RP, Ghatol AA (2010) Short Term Flood Forecasting Using Recurrent Neural Networks a Comparative Study. Int J Eng Technol 2(5):430–434. https://doi.org/10.7763/ijet.2010.v2.160
Galassi A, Lippi M, Torroni P (2021) Attention in Natural Language Processing. IEEE Trans Neural Netw Learning Syst 32(10):4291–4308. https://doi.org/10.1109/TNNLS.2020.3019893
Ghaffarian S, Valente J, Van Der Voort M, Tekinerdogan B (2021) Effect of attention mechanism in deep learning-based remote sensing image processing: A systematic literature review. Remote Sensing 13(15):1–22. https://doi.org/10.3390/rs13152965
Hochreiter S, Schmidhuber J (1997) Long Short-Term Memory. Neural Comput 9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735
Hosseinzadeh Talaee P (2014) Multilayer perceptron with different training algorithms for streamflow forecasting. Neural Comput Appl 24(3–4):695–703. https://doi.org/10.1007/s00521-012-1287-5
Kişi Ö (2005) Daily river flow forecasting using artificial neural networks and auto-regressive models. Turk J Eng Environ Sci 29(1):9–20
Li H, Chen G, Li G, Yu Y (2019) Motion guided attention for video salient object detection. Proceedings of the IEEE Int Conf Computer Vision 7273–7282. https://doi.org/10.1109/ICCV.2019.00737
Liu Z, Xu W, Feng J, Palaiahnakote S, Lu T (2018) Context-aware attention LSTM network for flood prediction. In: 24th international conference on pattern recognition (ICPR). IEEE, pp 1301–1306
Misra S, Sarkar S, Mitra P (2018) Statistical downscaling of precipitation using long short-term memory recurrent neural networks. Theoret Appl Climatol 134(3–4):1179–1196. https://doi.org/10.1007/s00704-017-2307-2
Mohammadi B, Ahmadi F, Mehdizadeh S, Guan Y, Pham QB, Linh NTT, Tri DQ (2020) Develo** Novel Robust Models to Improve the Accuracy of Daily Streamflow Modeling. Water Resour Manage 34(10):3387–3409. https://doi.org/10.1007/s11269-020-02619-z
Mounce SR, Shepherd W, Sailor G, Shucksmith J, Saul AJ (2014) Predicting combined sewer overflows chamber depth using artificial neural networks with rainfall radar data. Water Sci Technol 69(6):1326–1333. https://doi.org/10.2166/wst.2014.024
Nagesh Kumar D, Raju KS, Sathish TT (2018) River flow forecasting using recurrent neural networks. Int J Mechanical Eng Technol 9(10):706–714. https://doi.org/10.1201/b16994-60
Nejatian N, Abbaspour M, Javidan P, Nia MY, Shacheri F, Azizi H, Nia MY, Pazoki A, Pazoki M, Amiri MJ, Abbasi S (2024) Evaluation of the vulnerability and pathways of groundwater pollution in the Zanjanrud river basin by an integrated modeling approach. Model Earth Syst Environ 10(2):2295–2308. https://doi.org/10.1007/s40808-023-01897-x
Othman F, Naseri M (2011) Reservoir inflow forecasting using artificial neural network. 6(3), 434–440. https://doi.org/10.5897/IJPS10.649
Petty TR, Dhingra P (2018) Streamflow Hydrology Estimate Using Machine Learning (SHEM). J Am Water Resour Assoc 54(1):55–68. https://doi.org/10.1111/1752-1688.12555
Pham QB, Afan HA, Mohammadi B, Ahmed AN, Linh NTT, Vo ND, Moazenzadeh R, Yu PS, El-Shafie A (2020) Hybrid model to improve the river streamflow forecasting utilizing multi-layer perceptron-based intelligent water drop optimization algorithm. Soft Comput 24(23):18039–18056. https://doi.org/10.1007/s00500-020-05058-5
Rahimzad M, Moghaddam Nia A, Zolfonoon H, Soltani J, Danandeh Mehr A, Kwon HH (2021) Performance Comparison of an LSTM-based Deep Learning Model versus Conventional Machine Learning Algorithms for Streamflow Forecasting. Water Resour Manage 35(12):4167–4187. https://doi.org/10.1007/s11269-021-02937-w
Sammen SS, Ehteram M, Abba SI, Abdulkadir RA, Ahmed AN, El-Shafie A (2021) A new soft computing model for daily streamflow forecasting. Stoch Env Res Risk Assess 35(12):2479–2491. https://doi.org/10.1007/s00477-021-02012-1
Shamseldin AY (2010) Artificial neural network model for river flow forecasting in a develo** country. J Hydroinf 12(1):22–35. https://doi.org/10.2166/hydro.2010.027
Sit M, Demiray B, Demir I (2021) Short-term Hourly Streamflow Prediction with Graph Convolutional GRU Networks. 1–6. Available at: http://arxiv.org/abs/2107.07039. Accessed 3 Dec 2023
Sugiartawan P, Pulungan R, Kartika AK (2017) Prediction by a Hybrid of Wavelet Transform and Long-Short-Term-Memory Neural Network. Int J Advanced Computer Sci Appl 8(2). https://doi.org/10.14569/ijacsa.2017.080243
Sunnetci KM, Kaba E, Celiker FB, Alkan A (2024) Deep Network-Based Comprehensive Parotid Gland Tumor Detection. Acad Radiol 31(1):157–167. https://doi.org/10.1016/j.acra.2023.04.028
Tao L, He X, Li J, Yang D (2021) A multiscale long short-term memory model with attention mechanism for improving monthly precipitation prediction. J Hydrol 602(January):126815. https://doi.org/10.1016/j.jhydrol.2021.126815
Wegayehu EB, Muluneh FB (2021) Multivariate Streamflow Simulation Using Hybrid Deep Learning Models. Computational Intell Neurosci 2021(1). https://doi.org/10.1155/2021/5172658
**a M, Malladi S, Gururangan S, Arora S, Chen D (2024) LESS: Selecting Influential Data for Targeted Instruction Tuning. Available at: http://arxiv.org/abs/2402.04333. Accessed 7 June 2024
**ao S, Mantilla R, Gurbuz F, Mudireddy A (2021) The role of AI algorithms in flood prediction and mitigation. In AGU Fall Meeting Abstracts 2021:H35D-1063
**e Y, Ding M, Tomizuka M, Zhan W (2024) Towards free data selection with general-purpose models. Advances in Neural Information Processing Systems 36
Zhang D, Lindholm G, Ratnaweera H (2018) Use long short-term memory to enhance Internet of Things for combined sewer overflow monitoring. J Hydrol 556:409–418. https://doi.org/10.1016/j.jhydrol.2017.11.018
Zhao X, Lv H, Wei Y, Lv S, Zhu X (2021) Streamflow forecasting via two types of predictive structure-based gated recurrent unit models. Water (switzerland) 13(1):1–17. https://doi.org/10.3390/w13010091
Acknowledgements
The author(s) received no financial support for the research, authorship, and publication of this article.
Funding
No funding was obtained for this study.
Author information
Authors and Affiliations
Contributions
AUM: Conceptualization, Methodology, and Formal analysis. TM, HY, and AFB contributed in methodology and conceptualization, ST, JMA, AUB performed the analysis, MMB, MAHA, USD, and MSY writing- review and editing.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Conflict of interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Muhammad, A.U., Muazu, T., Ying, H. et al. Enhanced streamflow forecasting using attention-based neural network models: a comparative study in MOPEX basins. Model. Earth Syst. Environ. (2024). https://doi.org/10.1007/s40808-024-02088-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40808-024-02088-y