SpringerLink
Log in

A novel framework for distributing computations DisPyTE – distributing Python tasks environment

  • Published:
Journal of Computational Electronics Aims and scope Submit manuscript

Abstract

This paper proposes a novel framework for the distribution of concurrent tasks. DisPyTE (Distributing Python Tasks Environment) is written in the portable, interpreted programming language Python. It makes use of an event-driven, asynchronous network communication interface, which renders it especially well suited for application in heterogeneous network environments. After a short discussion on existing parallelization techniques, this paper illustrates the key principles of DisPyTE, including the main components and the call scheme. In a first example, it is demonstrated how DisPyTE can be used to distribute objective function evaluations in the scope of a heuristic optimization routine (genetic algorithm).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. TOP500 Supercomputer Sites, http://www.top500.org

  2. Gropp, W. et al.: Portable Parallel Programming with the Message Passing Interface. MIT Press, Cambridge, MA (1999)

    Google Scholar 

  3. Geist, A. et al.: PVM: Parallel Virtual Machine. MIT press (1994)

  4. Quinn, M.: Parallel Programming in C with MPI and OpenMP. McGraw-Hill (2003)

  5. Programming Language Python Homepage, http://www.python.org

  6. Simplified Wrapper and Interface Generator (SWIG). http://www.swig.org

  7. Fetting, A.: Twisted Network Programming Essentials. O’Reilly, Sebastopol, CA (2005)

    Google Scholar 

  8. Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, MA (1989)

    MATH  Google Scholar 

  9. Fühner, T. Jung, T.: Use of genetic algorithms for the development and optimization of crystal growth processes. Journal of Crystal Growth 266(1–3), 229 (2004)

    Article  Google Scholar 

  10. Fühner, T. et al.: Genetic algorithms to improve mask and illumination geometries in lithographic imaging systems. EvoWorkshops 2004, 208–217 (2004)

Download references

Author information

Authors and Affiliations

  1. Fraunhofer Institute of Integrated Systems and Device Technology, Schottkystrasse 10, 91058, Erlangen, Germany

    Tim Fühner

  2. Department of Computer Science and Mathematics, University of Applied Science Regensburg, Universitaetsstrasse 31, 93053, Regensburg, Germany

    Stephan Popp

  3. Fraunhofer Institute of Integrated Systems and Device Technology, Schottkystrasse 10, 91058, Erlangen, Germany

    Thomas Jung

Authors
  1. Tim Fühner
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stephan Popp
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Thomas Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tim Fühner.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fühner, T., Popp, S. & Jung, T. A novel framework for distributing computations DisPyTE – distributing Python tasks environment. J Comput Electron 5, 349–352 (2006). https://doi.org/10.1007/s10825-006-0026-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10825-006-0026-5

Keywords

Search

Navigation