Abstract
Grid and Internet Computing have proved their worth executing large-scale bag-of-task class applications. Numerous middlewares have been developed to manage their execution in either dedicated environments or opportunistic and shared ad-hoc grids. While job dependencies are now being resolved by middleware capable of scheduling workflows, these environments have yet to be shown beneficial for message passing parallel applications. Obtaining high performance in these widely available environments without rewriting existing parallel applications is of up most importance to e-Science. The key to an efficient solution may be an alternative execution model and the efficient dynamic scheduling of application processes. This paper presents a hierarchical scheme for dynamically scheduling parallel DAG applications across a set of non-dedicated heterogeneous resources. In order to efficiently tackle process dependencies and adapt to varying system characteristics, dynamic schedulers are distributed within the application and operate in a collaborative and pro-active fashion to keep overheads low.
This work is supported by research grants from CNPq and FAPERJ.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Buyya, R., Abramson, D., Giddy, J.: Nimrod/G: An architecture for a resource management and scheduling system in a global computational grid. In: Proc. 4th International Conf. on High Performance Computing in the Asia-Pacific Region, vol. 1, pp. 283–289. IEEE Computer Society Press, Los Alamitos (2000)
Buyya, R., Abramson, D., Venugopal, S.: The grid economy. Proceedings of the IEEE, Special Issue on Grid Computing 93(3), 698–714 (2005)
Casanova, H., Legrand, A., Zagorodnov, D., Berman, F.: Heuristics for scheduling parameter sweep applications in grid environments. In: Proc. 9th Heterogeneous Computing Workshop (HCW 2000), pp. 349–363. IEEE Computer Society Press, Los Alamitos (2000)
Choudhury, P., Kumar, R., Chakrabarti, P.P.: Hybrid scheduling of dynamic task graphs with selective duplication for multiprocessors under memory and time constraints. IEEE Trans. Parallel Distributed Systems 19(7), 967–980 (2008)
Berman, F., et al.: New grid scheduling and rescheduling methods in the GrADS project. International Journal of Parallel Programming 33(2), 209–229 (2005)
Cirne, W., et al.: Running bag-of-tasks applications on computational grids: The MyGrid approach. In: Proc. 32nd International Conference on Parallel Processing (ICPP 2003), pp. 407–416. IEEE Computer Society Press, Los Alamitos (2003)
Frey, J., Tannenbaum, T., Livny, M., Foster, I., Tuecke, S.: Condor-G: A computational management agent for multi-institutional grids. Journal of Cluster Computing 3(5), 237–246 (2002)
Huedo, E., Montero, R.S., Lorente, I.M.: The GridWay framework for adaptive scheduling and execution on grids. Scalable Computing: Practice and Experience 6(3), 1–8 (2005)
Makino, J.: An efficient parallel algorithm for O(N 2) direct summation method and its variations on distributed-memory parallel machines. New Astronomy 7(7), 373–384 (2002)
Nascimento, A.P., Boeres, C., Rebello, V.E.F.: Dynamic self-scheduling for parallel applications with task dependencies. In: Proc. 6th International Workshop on Middleware for Grid Computing. ACM Press, New York (2008)
Nascimento, A.P., Sena, A.C., Boeres, C., Rebello, V.E.F.: Distributed and dynamic self-scheduling of parallel MPI grid applications. Concurrency and Computation: Practice and Experience 19(14), 1955–1974 (2007)
Parashar, M., Hariri, S.: Autonomic Computing: Concepts, Infrastructure, and Applications. CRC Press, Boca Raton (2007)
Riakotakis, I., Ciorba, F.M., Andronikos, T., Papakonstantinou, G.: Self-adapting scheduling for tasks with dependencies in stochastic environments. In: Proc. 5th International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks (HeteroPar 2006), pp. 1–8. IEEE Computer Society Press, Los Alamitos (2006)
Sena, A.C., Nascimento, A.P., Boeres, C., Rebello, V.E.F.: EasyGrid enabling of iterative tightly-coupled parallel MPI applications. In: Proc. IEEE International Symposium on Parallel and Distributed Processing with Applications (ISPA 2008). IEEE Computer Society Press, Los Alamitos (2008)
Sena, A.C., Nascimento, A.P., Silva, J.A.d., Vianna, D.Q.C., Boeres, C., Rebello, V.E.F.: On the advantages of an alternative MPI execution model for grids. In: Proc. 7th IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2007), pp. 575–582. IEEE Computer Society Press, Los Alamitos (2007)
Topcuoglu, H., Hariri, S., Wu, M.Y.: Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Transactions on Parallel and Distributed Systems 13(3), 260–274 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nascimento, A.P., Sena, A., Boeres, C., Rebello, V.E.F. (2009). On the Feasibility of Dynamically Scheduling DAG Applications on Shared Heterogeneous Systems. In: Sips, H., Epema, D., Lin, HX. (eds) Euro-Par 2009 Parallel Processing. Euro-Par 2009. Lecture Notes in Computer Science, vol 5704. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03869-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-03869-3_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03868-6
Online ISBN: 978-3-642-03869-3
eBook Packages: Computer ScienceComputer Science (R0)