SpringerLink
Log in

Generic Library Interception for Improved Performance Measurement and Insight

  • Conference paper
  • First Online:
Programming and Performance Visualization Tools (ESPT 2017, ESPT 2018, VPA 2017, VPA 2018)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 11027))

Abstract

As applications grow in capability, they also grow in complexity. This complexity in turn gets pushed into modules and libraries. In addition, hardware configurations become increasingly elaborate, too. These two trends make understanding, debugging and analyzing the performance of applications more and more difficult.

To enable detailed insight into library usage of applications, we present an approach and implementation in Score-P that supports intuitive and robust creation of wrappers for arbitrary C/C++ libraries. Runtime analysis then uses these wrappers to keep track of how applications interact with libraries, how they interact with each other, and record the exact timing of their functions.

This manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Thailand)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 48.14
Price includes VAT (Thailand)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 57.99
Price excludes VAT (Thailand)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://sourceware.org/binutils/docs-2.28/ld/Options.html.

  2. 2.

    http://man7.org/linux/man-pages/man8/ld.so.8.html.

  3. 3.

    Full example: https://github.com/score-p/scorep_libwrap_examples/tree/1564c272311d04575f9886cd982fc611e07eb295/qt5/qtgui-and-qtwidgets.

  4. 4.

    Creating a source file for each function and try compiling and linking it is a common technique among configure tools. Doing this in one compile-link-step would require parsing the output of each supported compiler and version, which is not portable across compilers and linkers.

  5. 5.

    Not doing this would initially always wrap everything including functions from system headers.

  6. 6.

    https://github.com/score-p/scorep_libwrap_examples/blob/1564c272311d04575f9886cd982fc611e07eb295/qt5/qtgui-and-qtwidgets/fix-type-scopes.sh.

  7. 7.

    https://github.com/score-p/scorep_libwrap_examples/tree/1564c272311d04575f9886cd982fc611e07eb295/fftw3.

References

  1. Adhianto, L., et al.: HPCToolkit: tools for performance analysis of optimized parallel programs. Concurrency Comput.: Pract. Exp. 22(6), 685–701 (2010)

    Google Scholar 

  2. Arm MAP—Arm, August 2017. https://www.arm.com/products/development-tools/hpc-tools/cross-platform/forge/map

  3. Balay, S., et al.: PETSc users manual revision 3.7. Technical report, Argonne National Lab. (ANL), Argonne, IL (United States) (2016)

    Google Scholar 

  4. Beazley, D.M., et al.: SWIG: an easy to use tool for integrating scripting languages with C and C++. In: TCL/TK Workshop (1996)

    Google Scholar 

  5. Brunst, H., Weber, M.: Custom hot spot analysis of HPC software with the vampir performance tool suite. In: Cheptsov, A., Brinkmann, S., Gracia, J., Resch, M., Nagel, W. (eds.) Tools for High Performance Computing, pp. 95–114. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-37349-7_7

    Chapter  Google Scholar 

  6. Butenhof, D.R.: Programming with POSIX Threads. Addison-Wesley Professional, Boston (1997)

    Google Scholar 

  7. Clang: a C language family frontend for LLVM, August 2017. http://clang.llvm.org

  8. Google/clif: Wrapper generator foundation to wrap C++ for Python and other languages using LLVM, August 2017. https://github.com/google/clif

  9. CTool library, August 2017. http://ctool.sourceforge.net

  10. CUDA zone—NVIDIA developer, August 2017. https://developer.nvidia.com/cuda-zone

  11. Dietrich, R., Ilsche, T., Juckeland, G.: Non-intrusive performance analysis of parallel hardware accelerated applications on hybrid architectures. In: 2010 39th International Conference on Parallel Processing Workshops (ICPPW), pp. 135–143. IEEE (2010)

    Google Scholar 

  12. Edison design group, August 2017. http://edg.com

  13. Eichenberger, A.E., et al.: OMPT: an OpenMP tools application programming interface for performance analysis. In: Rendell, A.P., Chapman, B.M., Müller, M.S. (eds.) IWOMP 2013. LNCS, vol. 8122, pp. 171–185. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40698-0_13

    Chapter  Google Scholar 

  14. Extrae—BSC tools, August 2017. https://tools.bsc.es/extrae

  15. Farhat, C., Roux, F.X.: A method of finite element tearing and interconnecting and its parallel solution algorithm. Int. J. Numer. Methods Eng. 32(6), 1205–1227 (1991)

    Article  MathSciNet  Google Scholar 

  16. Folk, M., Heber, G., Koziol, Q., Pourmal, E., Robinson, D.: An overview of the HDF5 technology suite and its applications. In: Proceedings of the EDBT/ICDT 2011 Workshop on Array Databases, pp. 36–47. ACM (2011)

    Google Scholar 

  17. Frigo, M., Johnson, S.G.: FFTW: an adaptive software architecture for the FFT. In: Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 3, pp. 1381–1384. IEEE (1998)

    Google Scholar 

  18. Hapla, V., Horak, D., Pospisil, L., Cermak, M., Vasatova, A., Sojka, R.: Solving contact mechanics problems with PERMON. In: Kozubek, T., Blaheta, R., Šístek, J., Rozložník, M., Čermák, M. (eds.) HPCSE 2015. LNCS, vol. 9611, pp. 101–115. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40361-8_7

    Chapter  Google Scholar 

  19. Hilbrich, T., Schulz, M., de Supinski, B.R., Müller, M.S.: MUST: a scalable approach to runtime error detection in MPI programs. In: Müller, M., Resch, M., Schulz, A., Nagel, W. (eds.) Tools for High Performance Computing, pp. 53–66. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-11261-4_5

    Chapter  Google Scholar 

  20. Knüpfer, A., et al.: Score-P: a joint performance measurement run-time infrastructure for Periscope, Scalasca, TAU, and Vampir. In: Brunst, H., Müller, M., Nagel, W., Resch, M. (eds.) Tools for High Performance Computing, pp. 79–91. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-31476-6_7

    Chapter  Google Scholar 

  21. Lemkul, J.A.: Gromacs tutorial: Lysozyme in water, September 2017. http://www.bevanlab.biochem.vt.edu/Pages/Personal/justin/gmx-tutorials/lysozyme/index.html

  22. Lofstead, J.F., Klasky, S., Schwan, K., Podhorszki, N., **, C.: Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS). In: Proceedings of the 6th International Workshop on Challenges of Large Applications in Distributed Environments, pp. 15–24. ACM (2008)

    Google Scholar 

  23. de Melo, A.C.: Performance counters on Linux. In: Linux Plumbers Conference (2009)

    Google Scholar 

  24. Intel® math kernel library (intel® mkl)—intel® software, August 2017. https://software.intel.com/en-us/mkl

  25. Message Passing Interface (MPI) forum, August 2017. http://mpi-forum.org

  26. Profiler: CUDA toolkit documentation, August 2017. http://docs.nvidia.com/cuda/profiler-users-guide/index.html

  27. Qt—cross-platform software development for embedded & desktop, August 2017. https://www.qt.io/

  28. Shende, S., Malony, A.D., Spear, W., Schuchardt, K.: Characterizing I/O performance using the TAU performance system. In: PARCO, pp. 647–655 (2011)

    Google Scholar 

  29. Van Der Spoel, D., Lindahl, E., Hess, B., Groenhof, G., Mark, A.E., Berendsen, H.J.: GROMACS: fast, flexible, and free. J. Comput. Chem. 26(16), 1701–1718 (2005)

    Article  Google Scholar 

  30. Intel® VTune™ Amplifier, August 2017. https://software.intel.com/en-us/intel-vtune-amplifier-xe

Download references

Acknowledgments

This research used resources of the Oak Ridge Leadership Computing Facility at Oak Ridge National Laboratory, which is supported by the Office of Science of the Department of Energy under Contract DE-AC05-00OR22725.

This work is supported in part by the German Research Foundation (DFG) within the CRC 912 - HAEC.

Author information

Authors and Affiliations

  1. Oak Ridge National Laboratory, Oak Ridge, USA

    Ronny Brendel

  2. Technische Universität Dresden, Dresden, Germany

    Bert Wesarg, Ronny Tschüter, Matthias Weber, Thomas Ilsche & Sebastian Oeste

Authors
  1. Ronny Brendel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bert Wesarg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ronny Tschüter
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Matthias Weber
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Thomas Ilsche
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sebastian Oeste
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ronny Brendel .

Editor information

Editors and Affiliations

  1. Lawrence Livermore National Laboratory, Livermore, CA, USA

    Abhinav Bhatele

  2. Lawrence Livermore National Laboratory, Livermore, CA, USA

    David Boehme

  3. The University of Arizona, Tucson, AZ, USA

    Joshua A. Levine

  4. University of Oregon, Eugene, OR, USA

    Allen D. Malony

  5. Technical University of Munich, Munich, Germany

    Martin Schulz

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Brendel, R., Wesarg, B., Tschüter, R., Weber, M., Ilsche, T., Oeste, S. (2019). Generic Library Interception for Improved Performance Measurement and Insight. In: Bhatele, A., Boehme, D., Levine, J., Malony, A., Schulz, M. (eds) Programming and Performance Visualization Tools. ESPT ESPT VPA VPA 2017 2018 2017 2018. Lecture Notes in Computer Science(), vol 11027. Springer, Cham. https://doi.org/10.1007/978-3-030-17872-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-17872-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-17871-0

  • Online ISBN: 978-3-030-17872-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation