Log in

Short-term load analysis and forecasting using stochastic approach considering pandemic effects

  • Original Paper
  • Published:
Electrical Engineering Aims and scope Submit manuscript

Abstract

The COVID-19 pandemic and its containment have changed the pattern of electricity load. Hence, accurate forecasting of load for shorter interval of time during pandemic has become extremely challenging. Application of machine learning (ML) and deep learning (DL) techniques has improved accuracy to forecast load. This study compares ML and DL algorithms for short-term load forecasting. This research introduces a novel ’COVID Operator’ for load forecasting. The operator is characterized by three distinct levels, namely 0, 1, and 2. The ’0’ denotes pre-COVID, ’1’ signifies during, and ’2’ designates post-COVID. Unlike previous studies that just looked at the beginning of the pandemic, this study examines electricity load data from March 2017 to January 2021. Outliers of data are removed using interquartile range (IQR) method. After outliers are removed, data is trained using five different technique-based ML algorithms viz Gaussian Process Regression (GPR), Ensemble, support vector machine (SVM), Light Gradient-Boosting Machine (LightGBM) Categorical Boosting (CatBoost) and DL algorithm viz Deep Neural Network (DNN). After comparing all methods, GPR is the best method due to a good trade-off between training time and root mean square error (RMSE), and its ability to sensitivity to load changes. GPR is further hyperparameter tuned with Grid search, Random Search, and Bayesian Optimisation with an objective of reducing mean square error (MSE). Due to hyper-parameter tuning, the MSE of GPR is decreased by 10.3% with Grid Search being the optimal choice. Moreover, in this study, February 2021 data set is considered as ‘Subject Out’ set, and tested using developed algorithms. It is found that GPR is having less error in terms of RMSE as 64.38 MW and similar results for other performance parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Germany)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Alasali F, Haben S, Becerra V, Holderbaum W (2018) Day-ahead industrial load forecasting for electric RTG cranes. J Modern Power Syst Clean Energy 6(2):223–234

    Article  Google Scholar 

  2. Selvarajan S, Manoharan H, Khadidos AO, Shankar A, Khadidos AO, Onyema EM (2023) Obstacles uncovering system for slender pathways using unmanned aerial vehicles with automatic image localization technique. Int J Comput Intell Syst 16(1):164

    Article  Google Scholar 

  3. Al-Ani AK, Ul Arfeen Laghari S, Manoharan H, Selvarajan S, Uddin M (2023) Improved transportation model with internet of things using artificial intelligence algorithm. Comput Mater Contin76(2)

  4. Nejati M, Amjady N (2022) A new solar power prediction method based on feature clustering and hybrid-classification-regression forecasting. IEEE Trans Sustain Energy 13(2):1188–1198. https://doi.org/10.1109/TSTE.2021.3138592

    Article  Google Scholar 

  5. Vardhan BS, Khedkar M, Srivastava I (2021) Cost effective day-ahead scheduling with stochastic load and intermittency forecasting for distribution system considering distributed energy resources. Energy Sources Part A Recov Utili Environ Eff 1–26

  6. Gan LK, Zhang P, Lee J, Osborne MA, Howey DA (2021) Data-driven energy management system with gaussian process forecasting and MPC for interconnected microgrids. IEEE Trans Sustain Energy 12(1):695–704. https://doi.org/10.1109/TSTE.2020.3017224

    Article  Google Scholar 

  7. Malekizadeh M, Karami H, Karimi M, Moshari A, Sanjari M (2020) Short-term load forecast using ensemble neuro-fuzzy model. Energy 196:117127. https://doi.org/10.1016/j.energy.2020.117127

    Article  Google Scholar 

  8. Krannichfeldt LV, Wang Y, Zufferey T, Hug G (2022) Online ensemble approach for probabilistic wind power forecasting. IEEE Trans Sustain Energy 13(2):1221–1233. https://doi.org/10.1109/TSTE.2021.3124228

    Article  Google Scholar 

  9. Yang L, He M, Zhang J, Vittal V (2015) Support-vector-machine-enhanced Markov model for short-term wind power forecast. IEEE Trans Sustain Energy 6(3):791–799. https://doi.org/10.1109/TSTE.2015.2406814

    Article  Google Scholar 

  10. Ding C, Bao TY, Huang HL (2021) Quantum-inspired support vector machine. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3084467

    Article  Google Scholar 

  11. Vardhan BVS, Khedkar M, Srivastava I (2021) Cost effective day -ahead scheduling with stochastic load and intermittency forecasting for distribution system considering distributed energy resources. Energy Sources Part A Recov Util Environ Eff. https://doi.org/10.1080/15567036.2021.1983669

    Article  Google Scholar 

  12. Aggarwal CC et al (2018) Neural networks and deep learning, vol 10. Springer, Berlin, pp 978–3

    Book  Google Scholar 

  13. Panigrahi R, Patne NR, Pemmada S, Manchalwar AD (2022) Prediction of electric energy consumption for demand response using deep learning. In: 2022 international conference on intelligent controller and computing for smart power (ICICCSP), Hyderabad, India, pp 1–6. https://doi.org/10.1109/ICICCSP53532.2022.9862353

  14. Wang Y, Chen J, Chen X, Zeng X, Kong Y, Sun S, Guo Y, Liu Y (2021) Short-term load forecasting for industrial customers based on tcn-lightgbm. IEEE Trans Power Syst 36(3):1984–1997. https://doi.org/10.1109/TPWRS.2020.3028133

    Article  Google Scholar 

  15. Park S, Jung S, Jung S, Rho S, Hwang E (2021) Sliding window-based lightgbm model for electric load forecasting using anomaly repair. J Supercomput 77(11):12857–12878

    Article  Google Scholar 

  16. Micci-Barreca D (2001) A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems. SIGKDD Explor 3, 1(2001):27–32

    Article  Google Scholar 

  17. Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A (2018) Catboost: unbiased boosting with categorical features. Adv Neural Inf Process Syst 31

  18. Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139

    Article  MathSciNet  Google Scholar 

  19. Brindha GSS (2022) In: 2022 International Conference on Communication, Computing and Internet of Things (IC3IoT), pp 1–4. https://doi.org/10.1109/IC3IOT53935.2022.9768005

  20. Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(null):281–305

    MathSciNet  Google Scholar 

  21. Nguyen V (2019) Bayesian optimization for accelerating hyper-parameter tuning. In: 2019 IEEE second international conference on artificial intelligence and knowledge engineering (AIKE), Sardinia, Italy, pp 302–305. https://doi.org/10.1109/AIKE.2019.00060

  22. Yu T, Zhu H (2020) Hyper-parameter optimization: a review of algorithms and applications. ar**v preprint ar**v:2003.05689

  23. Vardhan BS, Khedkar M, Srivastava I, Thakre P, Bokde ND (2023) A comparative analysis of hyperparameter tuned stochastic short term load forecasting for power system operator. Energies 16(3):1243

    Article  Google Scholar 

  24. Panigrahi R, Patne NR, Pemmada S, Manchalwar AD (2022) Regression model-based hourly aggregated electricity demand prediction. Energy Rep 8:16-24

    Article  Google Scholar 

  25. Lewis C (1982) International and business forecasting methods butterworths: London

  26. Cestnik B (1990) In: Proceedings of the 9th European conference on artificial intelligence, 1990

  27. Dorogush AV, Ershov V, Gulin A (2018) Catboost: gradient boosting with categorical features support. ar**v preprint ar**v:1810.11363

  28. Farrokhabadi M (2020) Day-ahead electricity demand forecasting: post-covid paradigm. https://doi.org/10.21227/67vy-bs34

  29. Benkessirat A, Benblidia N (2019) In: 2019 IEEE/ACS 16th international conference on computer systems and applications (AICCSA), pp 1–6. https://doi.org/10.1109/AICCSA47632.2019.9035281

Download references

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: RP, BVSV; Methodology: RP, BVSV; Formal analysis and investigation: RP, NRP, BVSV, MK; Writing - original draft preparation: RP, BVSV; Writing - review and editing: RP, BVSV; Supervision: NRP, MK.

Corresponding author

Correspondence to B. V. Surya Vardhan.

Ethics declarations

Conflict of interest

No, I declare that the authors have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Panigrahi, R., Patne, N.R., Surya Vardhan, B.V. et al. Short-term load analysis and forecasting using stochastic approach considering pandemic effects. Electr Eng 106, 3097–3108 (2024). https://doi.org/10.1007/s00202-023-02135-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00202-023-02135-4

Keywords

Navigation