Abstract
Cloud computing is the delivery of on-demand, network accessed and easily configurable computing resources on a pay-as-you-go basis. These resources are dynamically assigned and can be scaled up and down in response to users’ needs. An increasing number of businesses are switching to cloud based computing systems for internal uses. Hence, there is a need to explore queuing theory to model systems bound by the constraint of a finite user population. In this work, a model for the analysis of request stage of finite population cloud computing systems has been presented. The losses in the system due to impatient users owing to balking and reneging in the system have also been taken into account in the model. A scheduling method to improve the load balancing of the request stage of the system has been introduced. A cost and reliability measurement scheme has been used to analyse the performance/cost trade-off associated with request stage of the system. The results obtained have been presented and compared with existing model working in the same domain. Experimental results show that improved cost saving (as high as \(\approx 91\%\)) and high throughput rate can be achieved by applying the proposed CCRM scheme.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig7_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig8_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig9_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig10_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig11_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig12_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig13_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig14_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig15_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig16_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs13369-021-05813-2/MediaObjects/13369_2021_5813_Fig17_HTML.png)
Similar content being viewed by others
Availability of Data and Material
All the data have been obtained by using the codes which can be obtained from the link mentioned in the next section.
References
Sivathanu, Sankaran; Liu, Ling; Yiduo, Mei; Pu, **ng: Storage management in virtualized cloud environment. In 2010 IEEE 3rd international conference on cloud computing, pages 204–211. IEEE, (2010)
Zhang, Rui; Liu, Ling: Security models and requirements for healthcare application clouds. In 2010 IEEE 3rd international conference on cloud computing, pages 268–275. IEEE, (2010)
Chiang, Yi.-Ju.; Ouyang, Yen-Chieh.: Profit optimization in SLA-aware cloud services with a finite capacity queuing model. Math. Prob. Eng. 1–11, 2014 (2014)
Keskin, Tayfun; Taskin, Nazim: A pricing model for cloud computing service. In 2014 47th Hawaii international conference on system sciences, pages 699–707. IEEE, (2014)
Atmaca, Tulin, Begin, Thomas, Brandwajn, Alexandre, Castel-Taleb, Hind: Performance evaluation of cloud computing centers with general arrivals and service. IEEE Trans. Parallel Distrib. Syst. 27(8), 2341–2348 (2016)
Khazaei, H., Misic, J., Misic, V.B.: Performance analysis of cloud computing centers using M/G/m/m+r queuing systems. IEEE Trans. Parallel Distrib. Syst. 23(5), 936–943 (2012)
Dai, Yuan-shun.; Yang, Bo; Dongarra, Jack; Zhang, Gewei: Cloud Service Reliability : Modeling and Analysis. In 15th IEEE Pacific Rim international symposium on dependable computing, pages 1–17. Citeseer, (2009)
Chiang, Yi.-Ju., Ouyang, Yen-Chieh., Hsu, Ching-Hsien. : Performance and cost-effectiveness analyses for cloud services based on rejected and impatient users. IEEE Trans. Serv. Comput. 9(3), 446–455 (2016)
Goswami, V.; Patra, S.S.; Mund, G.B.: Performance analysis and optimal resource usage in finite population cloud environment. Proceedings of 2012 2nd IEEE international conference on parallel, distributed and grid computing, PDGC 2012, pages 679–684, (2012)
Goswami, V.; Patra, S.S.; Mund, G.B.: Performance analysis of cloud with queue-dependent virtual machines. 2012 1st international conference on recent advances in information technology, RAIT-2012, pages 357–362, (2012)
Quennel, Zhao: Yiqiang; Alfa Sule, Attahiru, : Performance analysis of a telephone system with both patient and impatient customers. Telecommun. Syst. 4(1), 201–215 (1995)
Mandelbaum, Avi, Zeltyn, Sergey: The impact of customers? patience on delay and abandonment: some empirically-driven experiments with the M/M/ n + G queue. OR Spectrum 26(3), 377–411 (2004)
Doran, Derek; Lipsky, Lester; Thompson, Steve: Cost-based optimization of buffer size in M/G/1/N systems under different service-time distributions. Proceedings - 2010 9th IEEE international symposium on network computing and applications, NCA 2010, pages 28–35, (2010)
Ghosh, Arka P., Weerasinghe, Ananda P.: Optimal buffer size and dynamic rate control for a queueing system with impatient customers in heavy traffic. Stoch. Process. Their Appl. 120(11), 2103–2141 (2010)
Mehdi: Impatient Task Map** in Elastic Cloud using Genetic Algorithm. J. Comput. Sci. 7(6), 877–883 (2011)
Mehdi, Nawfal A.; Mamat, Ali; Ibrahim, Hamidah; Syrmabn, Shamala K.: Virtual machines cooperation for impatient jobs under cloud paradigm. World Academy of science, engineering and technology 51(Section III), 1119–1125 (2011)
Khazaei, Hamzeh, Misic, J., Misic, Vojislav B.: Performance analysis of cloud computing centers using M/G/m/m+r queuing systems. IEEE Trans. Parallel Distrib. Syst. 23(5), 936–943 (2012)
Cappos, Justin; Beschastnikh, Ivan; Krishnamurthy, Arvind; Anderson, Tom: Seattle: A Platform for Educational Cloud Computing. In Proceedings of the 40th ACM technical symposium on Computer science education - SIGCSE ’09, page 111, New York, New York, USA, (2009). ACM Press.
Shouraboura, Caroline, Bleher, Pavel: Placement of applications in computing clouds using Voronoi diagrams. J. Intern. Serv. Appl. 2(3), 229–241 (2011)
** Lim, Boon; Kit Chong, Poh; Kandasamy Karuppiah, Ettikan; Mohamad Yassin, Yaszrina; Nazir, Amril; Noor Batcha, Mohamed Farid: FARCREST: Euclidean Steiner Tree based cloud service latency prediction system. 2013 IEEE 10th Consumer Communications and Networking Conference, CCNC 2013, pages 859–860, (2013)
Quarati, Alfonso; Agostino, Daniele; Galizia, Antonella; Mangini, Matteo; Clematis, Andrea: Delivering Cloud Services with QoS Requirements: An Opportunity for ICT SMEs. In Kurt Vanmechelen, Jörn Altmann, and Omer F Rana, editors, Economics of Grids, Clouds, Systems, and Services, pages 197-211, Berlin, Heidelberg, (2012). Springer Berlin Heidelberg.
Mishra, Suchintan; Narayan Sahoo, Manmath; Kumar Sangaiah, Arun; Bakshi, Sambit; D’: Nature-inspired cost optimisation for enterprise cloud systems using joint allocation of resources. Enterprise Information Systems 15(2), 174–196 (2021)
Selvarani S.; Sudha Sadhasivam, G.: Improved cost-based algorithm for task scheduling in cloud computing. 2010 IEEE international conference on computational intelligence and computing research, ICCIC 2010, pages 620–624, (2010)
Yang, Zhi; Yin, Changqin; Liu, Yan: A Cost-Based Resource Scheduling Paradigm in Cloud Computing. In 2011 12th international conference on parallel and distributed computing, applications and technologies, pages 417–422. IEEE, (2011)
Yang, Bo., Tan, Feng, Dai, Shun, Yuan, : Performance evaluation of cloud service considering fault recovery. J. Supercomput. 65(1), 426–444 (2013)
Hadji, Makhlouf; Zeghlache, Djamal: Minimum cost maximum flow algorithm for dynamic resource allocation in clouds. Proceedings - 2012 IEEE 5th international conference on cloud computing, CLOUD 2012, pages 876–882, (2012)
Hwang, Ren-Hung., Lee, Chung-Nan., Chen, Yi.-Ru., Zhang-Jian, Da-**g. : Cost optimization of elasticity cloud resource subscription policy. IEEE Trans. Serv. Comput. 7(4), 561–574 (2014)
Shortle, John F., Thompson, James M., Gross, Donald, Harris, Carl M.: Fundamentals of Queueing Theory. Wiley Series in Probability and Statistics. Wiley, Hoboken, NJ, USA (2018)
Cao, Jiuxin; Yang, Liu; Zheng, **ao; Liu, Bo; Zhao, Lei; Ni, Xudong; Dong, Fang; Mao, Bo: Social attribute based web service information publication mechanism in delay tolerant network. In 2011 14th IEEE international conference on computational science and engineering, pages 435–442. IEEE, (2011)
Armony, Mor, Maglaras, Constantinos: Contact centers with a call-back option and real-time delay information. Op. Res. 52(4), 527–545 (2004)
Guo, Pengfei, Zipkin, Paul: Analysis and comparison of queues with different levels of delay information. Manag. Sci. 53(6), 962–970 (2007)
John, D.C.: Little. A Proof for the Queuing Formula: L = \(\lambda \) W. Operations Research 9(3), 383–387 (1961)
Ullah, Amjad, Li, **gpeng, Shen, Yindong, Hussain, Amir: A control theoretical view of cloud elasticity: taxonomy, survey and challenges. Clust. Comput. 21(4), 1735–1764 (2018)
Nathuji, Ripal; Kansal, Aman; Ghaffarkhah, Alireza: Q-Clouds: Managing Performance Interference Effects for QoS-Aware Clouds. In Proceedings of the 5th European conference on Computer systems - EuroSys ’10, volume 298, page 237, New York, New York, USA, (2010). ACM Press.
Calheiros, Rodrigo N.; Ranjan, Rajiv; Buyya, Rajkumar: Virtual machine provisioning based on analytical performance and QoS in cloud computing environments. In 2011 international conference on parallel processing, pages 295–304. IEEE, (2011)
Bradley, John, Gerald, Fitz, John; Kearney, Ide, : Modelling supply in an open economy using a restricted cost function. Econ. Modell. 10(1), 11–21 (1993)
Brown, Randall S., Caves, Douglas W., Christensen, Laurits R.: Modelling the structure of cost and production for multiproduct firms. South. Econ. J. 46(1), 256 (1979)
Funding
Not applicable
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of Interest/competing interests
The authors have no conflicting interests.
Code Availability
The codes used in this work are available in an open-source GitHub directory here. All the codes were written by the authors on MATLAB 2016.
Rights and permissions
About this article
Cite this article
Sharma, R., Singh, R. A Highly Reliable and Cost-effective Service Model for Finite Population Clouds: Analysis and Implementation. Arab J Sci Eng 47, 1181–1196 (2022). https://doi.org/10.1007/s13369-021-05813-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13369-021-05813-2