Containers Scheduling Consolidation Approach for Cloud Computing

  • Conference paper
  • First Online:
Pervasive Systems, Algorithms and Networks (I-SPAN 2019)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1080))

Included in the following conference series:

Abstract

Containers are increasingly gaining popularity and are going to be a major deployment model in cloud computing. However, consolidation technique is also used extensively in the cloud context to optimize resources utilization and reduce the power consumption. In this paper, we present a new containers scheduling consolidation approach for cloud computing environment based on a machine learning technique. Our approach is proposed to address the problem of a company that aims to adapt dynamically the number of active nodes to reduce the power consumption when several containers are submitted online each day by their users. In our context, the frequency of containers submission varies within one hour. However, for each hour, the submission frequency is essentially the same each day. The principle of our approach consists into applying a machine learning technique to detect, from a previous containers submission historical, three submission periods (high, medium and low). Each submission period represents a time slot of one day. For instance, the high submission period represents the slot time where the number of submitted containers is the highest compared to other periods. Then, according to the submission periods slot time, our approach dynamically adapts the number of active nodes that must be used to execute each new submitted container. Our proposed consolidation approach is implemented inside Docker Swarmkit which is a well-known container scheduler framework developed by Docker. Experiments demonstrate the potential of our approach under different scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 42.79
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 53.49
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://golang.org.

  2. 2.

    http://prezi.com/scale/ and now available at https://lipn.univ-paris13.fr/~menouer/Jobs_Prezi.txt.

References

  1. Ahmad, R.W., Gani, A., Hamid, S.H.A., Shiraz, M., Yousafzai, A., **a, F.: A survey on virtual machine migration and server consolidation frameworks for cloud data centers. J. Netw. Comput. Appl. 52, 11–25 (2015). http://www.sciencedirect.com/science/article/pii/S1084804515000284

    Article  Google Scholar 

  2. Beloglazov, A., Buyya, R.: Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers. In: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science, MGC 2010, pp. 4:1–4:6. ACM, New York (2010). http://doi.acm.org/10.1145/1890799.1890803

  3. Ben Maaouia, O., Fkaier, H., Cerin, C., Jemni, M., Ngoko, Y.: On optimization of energy consumption in a volunteer cloud. In: Vaidya, J., Li, J. (eds.) ICA3PP 2018, Part II. LNCS, vol. 11335, pp. 388–398. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-05054-2_31

    Chapter  Google Scholar 

  4. Catuogno, L., Galdi, C., Pasquino, N.: An effective methodology for measuring software resource usage. IEEE Trans. Instrum. Measur. 67(10), 2487–2494 (2018)

    Article  Google Scholar 

  5. Clouet, F., et al.: A unified monitoring framework for energy consumption and network traffic. In: TRIDENTCOM - International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, Vancouver, Canada, p. 10, June 2015. https://hal.inria.fr/hal-01167915

  6. Dong, Z., Zhuang, W., Rojas-Cessa, R.: Energy-aware scheduling schemes for cloud data centers on Google trace data. In: 2014 IEEE Online Conference on Green Communications (OnlineGreenComm), pp. 1–6, November 2014

    Google Scholar 

  7. Grid5000. https://www.grid5000.fr/. Accessed 25 Jan 2019

  8. Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques, 3rd edn. Elsevier, New York (2011)

    MATH  Google Scholar 

  9. Hirofuchi, T., Nakada, H., Itoh, S., Sekiguchi, S.: Reactive consolidation of virtual machines enabled by postcopy live migration. In: Proceedings of the 5th International Workshop on Virtualization Technologies in Distributed Computing, VTDC 2011, pp. 11–18. ACM, New York (2011). http://doi.acm.org/10.1145/1996121.1996125

  10. Le, Q.V., et al.: Building high-level features using large scale unsupervised learning. In: Proceedings of the 29th International Coference on International Conference on Machine Learning, ICML 2012, USA, pp. 507–514. Omnipress (2012). http://dl.acm.org/citation.cfm?id=3042573.3042641

  11. Medel, V., Tolón, C., Arronategui, U., Tolosana-Calasanz, R., Bañares, J.Á., Rana, O.F.: Client-side scheduling based on application characterization on kubernetes. In: Pham, C., Altmann, J., Bañares, J.Á. (eds.) GECON 2017. LNCS, vol. 10537, pp. 162–176. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68066-8_13

    Chapter  Google Scholar 

  12. Menouer, T., Darmon, P.: New scheduling strategy based on multi-criteria decision algorithm. In: 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 101–107, February 2019

    Google Scholar 

  13. Piraghaj, S.F., Dastjerdi, A.V., Calheiros, R.N., Buyya, R.: A framework and algorithm for energy efficient container consolidation in cloud data centers. In: 2015 IEEE International Conference on Data Science and Data Intensive Systems, pp. 368–375, December 2015

    Google Scholar 

  14. Silver, D.L., Yang, Q., Li, L.: Lifelong machine learning systems: beyond learning algorithms. In: AAAI Spring Symposium: Lifelong Machine Learning, vol. 13, p. 05 (2013)

    Google Scholar 

  15. Menouer, T., Cérin, C., Saad, W., Shi, X.: A resource allocation framework with qualitative and quantitative SLA classes. In: Mencagli, G., et al. (eds.) Euro-Par 2018. LNCS, vol. 11339, pp. 69–81. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-10549-5_6

    Chapter  Google Scholar 

  16. Zheng, K., Wang, X., Li, L., Wang, X.: Joint power optimization of data center network and servers with correlation analysis. In: IEEE INFOCOM 2014 - IEEE Conference on Computer Communications, pp. 2598–2606, April 2014

    Google Scholar 

  17. The apache software foundation. Mesos, apache. http://mesos.apache.org/. Accessed 25 Jan 2019

  18. Docker swarmkit. https://github.com/docker/swarmkit/. Accessed 25 Jan 2019

  19. Kubernetes scheduler. https://kubernetes.io/. Accessed 25 Jan 2019

Download references

Acknowledgments

We thank the Grid5000 team for their help to use the testbed. Grid’5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several universities as well as other organizations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tarek Menouer .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Menouer, T., Darmon, P. (2019). Containers Scheduling Consolidation Approach for Cloud Computing. In: Esposito, C., Hong, J., Choo, KK. (eds) Pervasive Systems, Algorithms and Networks. I-SPAN 2019. Communications in Computer and Information Science, vol 1080. Springer, Cham. https://doi.org/10.1007/978-3-030-30143-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-30143-9_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-30142-2

  • Online ISBN: 978-3-030-30143-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Navigation