Abstract
High Energy Physics (HEP) experiments at the LHC collider at CERN were among the first scientific communities with very high computing requirements. Nowadays, researchers in other scientific domains are in need of similar computational power and storage capacity. Solution for the HEP experiments was found in the form of computational grid - distributed computing infrastructure integrating large number of computing centers based on commodity hardware. These infrastructures are very well suited for High Throughput applications used for analysis of large volumes of data with trivial parallelization in multiple independent execution threads. More advanced applications in HEP and other scientific domains can exploit complex parallelization techniques using multiple interacting execution threads. A growing number of High Performance Computing (HPC) centers, or supercomputers, support this mode of operation. One of the software toolkits developed for building distributed computing systems is the DIRAC Interware. It allows seamless integration of computing and storage resources based on different technologies into a single coherent system. This product was very successful to solve problems of large HEP experiments and was upgraded in order to offer a general-purpose solution. The DIRAC Interware can help including also HPC centers into a common federation to achieve similar goals as for computational grids. However, integration of HPC centers imposes certain requirements on their internal organization and external connectivity presenting a complex co-design problem. A distributed infrastructure including supercomputers is planned for construction. It will be applied for inter-disciplinary large-scale problems of modern science and technology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Tsaregorodtsev, A., et al.: DIRAC3: the new generation of the LHCb grid software. J. Phys. Conf. Ser. 219, 062029 (2010)
DIRAC Project. http://diracgrid.org
Casajus, A., Graciani, R., Tsaregorodtsev, A.: DIRAC pilot framework and the DIRAC Workload Management System. J. Phys. Conf. Ser. 219, 062049 (2010)
BES III Collaboration. http://bes.ihep.ac.cn/bes3
Kuhr, T., Hara, T.: Computing at Belle II. In: Proceedings of the CHEP 2012 International Conference, New-York, May 2012
Arrabito, L., et al.: Application of the DIRAC framework in CTA: first evaluation. In: Proceedings of the CHEP 2012 International Conference, New-York, May 2012
OpenScience Grid. https://www.opensciencegrid.org/
ARC project. http://www.nordugrid.org/arc/
Smith, A., Tsaregorodtsev, A.: DIRAC: data production management. J. Phys. Conf. Ser. 119, 062046 (2008)
Gfal2 Project. https://dmc.web.cern.ch/projects-tags/gfal-2
Tsaregorodtsev, A., Hamar, V.: MPI support in the DIRAC Pilot Job Workload Management System. J. Phys. Conf. Ser. 396, 032109 (2012)
Stagni, F., Charpentier, P.: The LHCb DIRAC-based production and data management operations systems. J. Phys.: Conf. Ser. 368, 012010 (2012)
WLCG Computing Grid Infrastructure. http://wlcg.web.cern.ch
Zhang, X.M., Pelevanyuk, I., Korenkov, V., et al.: Design and operation of the BES-III distributed computing system. Procedia Comput. Sci. 66, 619–624 (2015)
Yan, T., Suo, B., et al.: Multi-VO support in IHEP’s distributed computing environment. J. Phys. Conf. Ser. 664, 062068 (2015)
Tsaregorodtsev, A.: DIRAC Distributed Computing Services. J. Phys. Conf. Ser. 513, 03209 (2014)
Barkalov, K., Gergel, V.: Multilevel scheme of dimensionality reduction for parallel global search algorithms. In: OPT-i 2014. An International Conference on Engineering and Applied Sciences Optimization, Kos Island, Greece, 4–6 June 2014, pp. 2111–2124 (2014)
Gergel, V.P., Strongin, R.G.: Parallel computing for globally optimal decision making on cluster systems. Future Gener. Computer Systems 21(5), 673–678 (2005)
Bastrakov, S., Meyerov, I., Gergel, V., et al.: High performance computing in biomedical applications. Procedia Comput. Sci. 18, 10–19 (2013)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Gergel, V., Korenkov, V., Tsaregorodtsev, A., Svistunov, A. (2016). Efficient Distributed Computations with DIRAC. In: Carretero, J., et al. Algorithms and Architectures for Parallel Processing. ICA3PP 2016. Lecture Notes in Computer Science(), vol 10049. Springer, Cham. https://doi.org/10.1007/978-3-319-49956-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-319-49956-7_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-49955-0
Online ISBN: 978-3-319-49956-7
eBook Packages: Computer ScienceComputer Science (R0)