Abstract
The COVID-19 pandemic and its containment have changed the pattern of electricity load. Hence, accurate forecasting of load for shorter interval of time during pandemic has become extremely challenging. Application of machine learning (ML) and deep learning (DL) techniques has improved accuracy to forecast load. This study compares ML and DL algorithms for short-term load forecasting. This research introduces a novel ’COVID Operator’ for load forecasting. The operator is characterized by three distinct levels, namely 0, 1, and 2. The ’0’ denotes pre-COVID, ’1’ signifies during, and ’2’ designates post-COVID. Unlike previous studies that just looked at the beginning of the pandemic, this study examines electricity load data from March 2017 to January 2021. Outliers of data are removed using interquartile range (IQR) method. After outliers are removed, data is trained using five different technique-based ML algorithms viz Gaussian Process Regression (GPR), Ensemble, support vector machine (SVM), Light Gradient-Boosting Machine (LightGBM) Categorical Boosting (CatBoost) and DL algorithm viz Deep Neural Network (DNN). After comparing all methods, GPR is the best method due to a good trade-off between training time and root mean square error (RMSE), and its ability to sensitivity to load changes. GPR is further hyperparameter tuned with Grid search, Random Search, and Bayesian Optimisation with an objective of reducing mean square error (MSE). Due to hyper-parameter tuning, the MSE of GPR is decreased by 10.3% with Grid Search being the optimal choice. Moreover, in this study, February 2021 data set is considered as ‘Subject Out’ set, and tested using developed algorithms. It is found that GPR is having less error in terms of RMSE as 64.38 MW and similar results for other performance parameters.
Similar content being viewed by others
References
Alasali F, Haben S, Becerra V, Holderbaum W (2018) Day-ahead industrial load forecasting for electric RTG cranes. J Modern Power Syst Clean Energy 6(2):223–234
Selvarajan S, Manoharan H, Khadidos AO, Shankar A, Khadidos AO, Onyema EM (2023) Obstacles uncovering system for slender pathways using unmanned aerial vehicles with automatic image localization technique. Int J Comput Intell Syst 16(1):164
Al-Ani AK, Ul Arfeen Laghari S, Manoharan H, Selvarajan S, Uddin M (2023) Improved transportation model with internet of things using artificial intelligence algorithm. Comput Mater Contin76(2)
Nejati M, Amjady N (2022) A new solar power prediction method based on feature clustering and hybrid-classification-regression forecasting. IEEE Trans Sustain Energy 13(2):1188–1198. https://doi.org/10.1109/TSTE.2021.3138592
Vardhan BS, Khedkar M, Srivastava I (2021) Cost effective day-ahead scheduling with stochastic load and intermittency forecasting for distribution system considering distributed energy resources. Energy Sources Part A Recov Utili Environ Eff 1–26
Gan LK, Zhang P, Lee J, Osborne MA, Howey DA (2021) Data-driven energy management system with gaussian process forecasting and MPC for interconnected microgrids. IEEE Trans Sustain Energy 12(1):695–704. https://doi.org/10.1109/TSTE.2020.3017224
Malekizadeh M, Karami H, Karimi M, Moshari A, Sanjari M (2020) Short-term load forecast using ensemble neuro-fuzzy model. Energy 196:117127. https://doi.org/10.1016/j.energy.2020.117127
Krannichfeldt LV, Wang Y, Zufferey T, Hug G (2022) Online ensemble approach for probabilistic wind power forecasting. IEEE Trans Sustain Energy 13(2):1221–1233. https://doi.org/10.1109/TSTE.2021.3124228
Yang L, He M, Zhang J, Vittal V (2015) Support-vector-machine-enhanced Markov model for short-term wind power forecast. IEEE Trans Sustain Energy 6(3):791–799. https://doi.org/10.1109/TSTE.2015.2406814
Ding C, Bao TY, Huang HL (2021) Quantum-inspired support vector machine. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3084467
Vardhan BVS, Khedkar M, Srivastava I (2021) Cost effective day -ahead scheduling with stochastic load and intermittency forecasting for distribution system considering distributed energy resources. Energy Sources Part A Recov Util Environ Eff. https://doi.org/10.1080/15567036.2021.1983669
Aggarwal CC et al (2018) Neural networks and deep learning, vol 10. Springer, Berlin, pp 978–3
Panigrahi R, Patne NR, Pemmada S, Manchalwar AD (2022) Prediction of electric energy consumption for demand response using deep learning. In: 2022 international conference on intelligent controller and computing for smart power (ICICCSP), Hyderabad, India, pp 1–6. https://doi.org/10.1109/ICICCSP53532.2022.9862353
Wang Y, Chen J, Chen X, Zeng X, Kong Y, Sun S, Guo Y, Liu Y (2021) Short-term load forecasting for industrial customers based on tcn-lightgbm. IEEE Trans Power Syst 36(3):1984–1997. https://doi.org/10.1109/TPWRS.2020.3028133
Park S, Jung S, Jung S, Rho S, Hwang E (2021) Sliding window-based lightgbm model for electric load forecasting using anomaly repair. J Supercomput 77(11):12857–12878
Micci-Barreca D (2001) A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problems. SIGKDD Explor 3, 1(2001):27–32
Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A (2018) Catboost: unbiased boosting with categorical features. Adv Neural Inf Process Syst 31
Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139
Brindha GSS (2022) In: 2022 International Conference on Communication, Computing and Internet of Things (IC3IoT), pp 1–4. https://doi.org/10.1109/IC3IOT53935.2022.9768005
Bergstra J, Bengio Y (2012) Random search for hyper-parameter optimization. J Mach Learn Res 13(null):281–305
Nguyen V (2019) Bayesian optimization for accelerating hyper-parameter tuning. In: 2019 IEEE second international conference on artificial intelligence and knowledge engineering (AIKE), Sardinia, Italy, pp 302–305. https://doi.org/10.1109/AIKE.2019.00060
Yu T, Zhu H (2020) Hyper-parameter optimization: a review of algorithms and applications. ar**v preprint ar**v:2003.05689
Vardhan BS, Khedkar M, Srivastava I, Thakre P, Bokde ND (2023) A comparative analysis of hyperparameter tuned stochastic short term load forecasting for power system operator. Energies 16(3):1243
Panigrahi R, Patne NR, Pemmada S, Manchalwar AD (2022) Regression model-based hourly aggregated electricity demand prediction. Energy Rep 8:16-24
Lewis C (1982) International and business forecasting methods butterworths: London
Cestnik B (1990) In: Proceedings of the 9th European conference on artificial intelligence, 1990
Dorogush AV, Ershov V, Gulin A (2018) Catboost: gradient boosting with categorical features support. ar**v preprint ar**v:1810.11363
Farrokhabadi M (2020) Day-ahead electricity demand forecasting: post-covid paradigm. https://doi.org/10.21227/67vy-bs34
Benkessirat A, Benblidia N (2019) In: 2019 IEEE/ACS 16th international conference on computer systems and applications (AICCSA), pp 1–6. https://doi.org/10.1109/AICCSA47632.2019.9035281
Author information
Authors and Affiliations
Contributions
Conceptualization: RP, BVSV; Methodology: RP, BVSV; Formal analysis and investigation: RP, NRP, BVSV, MK; Writing - original draft preparation: RP, BVSV; Writing - review and editing: RP, BVSV; Supervision: NRP, MK.
Corresponding author
Ethics declarations
Conflict of interest
No, I declare that the authors have no competing interests as defined by Springer, or other interests that might be perceived to influence the results and/or discussion reported in this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Panigrahi, R., Patne, N.R., Surya Vardhan, B.V. et al. Short-term load analysis and forecasting using stochastic approach considering pandemic effects. Electr Eng 106, 3097–3108 (2024). https://doi.org/10.1007/s00202-023-02135-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00202-023-02135-4