Abstract
Containers are increasingly gaining popularity and are going to be a major deployment model in cloud computing. However, consolidation technique is also used extensively in the cloud context to optimize resources utilization and reduce the power consumption. In this paper, we present a new containers scheduling consolidation approach for cloud computing environment based on a machine learning technique. Our approach is proposed to address the problem of a company that aims to adapt dynamically the number of active nodes to reduce the power consumption when several containers are submitted online each day by their users. In our context, the frequency of containers submission varies within one hour. However, for each hour, the submission frequency is essentially the same each day. The principle of our approach consists into applying a machine learning technique to detect, from a previous containers submission historical, three submission periods (high, medium and low). Each submission period represents a time slot of one day. For instance, the high submission period represents the slot time where the number of submitted containers is the highest compared to other periods. Then, according to the submission periods slot time, our approach dynamically adapts the number of active nodes that must be used to execute each new submitted container. Our proposed consolidation approach is implemented inside Docker Swarmkit which is a well-known container scheduler framework developed by Docker. Experiments demonstrate the potential of our approach under different scenarios.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
http://prezi.com/scale/ and now available at https://lipn.univ-paris13.fr/~menouer/Jobs_Prezi.txt.
References
Ahmad, R.W., Gani, A., Hamid, S.H.A., Shiraz, M., Yousafzai, A., **a, F.: A survey on virtual machine migration and server consolidation frameworks for cloud data centers. J. Netw. Comput. Appl. 52, 11–25 (2015). http://www.sciencedirect.com/science/article/pii/S1084804515000284
Beloglazov, A., Buyya, R.: Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers. In: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science, MGC 2010, pp. 4:1–4:6. ACM, New York (2010). http://doi.acm.org/10.1145/1890799.1890803
Ben Maaouia, O., Fkaier, H., Cerin, C., Jemni, M., Ngoko, Y.: On optimization of energy consumption in a volunteer cloud. In: Vaidya, J., Li, J. (eds.) ICA3PP 2018, Part II. LNCS, vol. 11335, pp. 388–398. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-05054-2_31
Catuogno, L., Galdi, C., Pasquino, N.: An effective methodology for measuring software resource usage. IEEE Trans. Instrum. Measur. 67(10), 2487–2494 (2018)
Clouet, F., et al.: A unified monitoring framework for energy consumption and network traffic. In: TRIDENTCOM - International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, Vancouver, Canada, p. 10, June 2015. https://hal.inria.fr/hal-01167915
Dong, Z., Zhuang, W., Rojas-Cessa, R.: Energy-aware scheduling schemes for cloud data centers on Google trace data. In: 2014 IEEE Online Conference on Green Communications (OnlineGreenComm), pp. 1–6, November 2014
Grid5000. https://www.grid5000.fr/. Accessed 25 Jan 2019
Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques, 3rd edn. Elsevier, New York (2011)
Hirofuchi, T., Nakada, H., Itoh, S., Sekiguchi, S.: Reactive consolidation of virtual machines enabled by postcopy live migration. In: Proceedings of the 5th International Workshop on Virtualization Technologies in Distributed Computing, VTDC 2011, pp. 11–18. ACM, New York (2011). http://doi.acm.org/10.1145/1996121.1996125
Le, Q.V., et al.: Building high-level features using large scale unsupervised learning. In: Proceedings of the 29th International Coference on International Conference on Machine Learning, ICML 2012, USA, pp. 507–514. Omnipress (2012). http://dl.acm.org/citation.cfm?id=3042573.3042641
Medel, V., Tolón, C., Arronategui, U., Tolosana-Calasanz, R., Bañares, J.Á., Rana, O.F.: Client-side scheduling based on application characterization on kubernetes. In: Pham, C., Altmann, J., Bañares, J.Á. (eds.) GECON 2017. LNCS, vol. 10537, pp. 162–176. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68066-8_13
Menouer, T., Darmon, P.: New scheduling strategy based on multi-criteria decision algorithm. In: 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 101–107, February 2019
Piraghaj, S.F., Dastjerdi, A.V., Calheiros, R.N., Buyya, R.: A framework and algorithm for energy efficient container consolidation in cloud data centers. In: 2015 IEEE International Conference on Data Science and Data Intensive Systems, pp. 368–375, December 2015
Silver, D.L., Yang, Q., Li, L.: Lifelong machine learning systems: beyond learning algorithms. In: AAAI Spring Symposium: Lifelong Machine Learning, vol. 13, p. 05 (2013)
Menouer, T., Cérin, C., Saad, W., Shi, X.: A resource allocation framework with qualitative and quantitative SLA classes. In: Mencagli, G., et al. (eds.) Euro-Par 2018. LNCS, vol. 11339, pp. 69–81. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-10549-5_6
Zheng, K., Wang, X., Li, L., Wang, X.: Joint power optimization of data center network and servers with correlation analysis. In: IEEE INFOCOM 2014 - IEEE Conference on Computer Communications, pp. 2598–2606, April 2014
The apache software foundation. Mesos, apache. http://mesos.apache.org/. Accessed 25 Jan 2019
Docker swarmkit. https://github.com/docker/swarmkit/. Accessed 25 Jan 2019
Kubernetes scheduler. https://kubernetes.io/. Accessed 25 Jan 2019
Acknowledgments
We thank the Grid5000 team for their help to use the testbed. Grid’5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several universities as well as other organizations.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Menouer, T., Darmon, P. (2019). Containers Scheduling Consolidation Approach for Cloud Computing. In: Esposito, C., Hong, J., Choo, KK. (eds) Pervasive Systems, Algorithms and Networks. I-SPAN 2019. Communications in Computer and Information Science, vol 1080. Springer, Cham. https://doi.org/10.1007/978-3-030-30143-9_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-30143-9_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-30142-2
Online ISBN: 978-3-030-30143-9
eBook Packages: Computer ScienceComputer Science (R0)