One-Shot Approaches to Design Optimzation

  • Chapter
  • First Online:
Trends in PDE Constrained Optimization

Part of the book series: International Series of Numerical Mathematics ((ISNM,volume 165))

Abstract

The paper describes general methodologies for the solution of design optimization problems. In particular we outline the close relations between a fixed point solver based piggy back approach and a Reduced SQP method in Jacobi and Seidel variants. The convergence rate and general efficacy is shown to be strongly dependent on the characteristics of the state equation and the objective function. In the QP scenario where the state equation is linear and the objective quadratic, finite termination in two steps is obtained by the Seidel variant with Newton state solver and perfect design space preconditioning. More generally, it is shown that the retardation factor between simulation and optimization is bounded below by 2 with the difference depending on a cross-term representing the total sensitivity of the adjoint equation with respect to the design.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free ship** worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. A. Battermann, E. Sachs, Block preconditioners for KKT systems in PDE-governed optimal control problems, in Fast Solution of Discretized Optimization Problems, ed. by K.-H. Hoffmann, R.H.W. Hoppe, V. Schulz. Number 138 in ISNM (Birkhaeuser, Basel, 2001), pp. 1–18

    Google Scholar 

  2. R. Becker, R. Rannacher, An optimal control approach to a posteriori error estimation in finite element methods. Acta Numer. 10(1), 1–102 (2001)

    MATH  MathSciNet  Google Scholar 

  3. M. Benzi, A.J. Wathen, Some preconditioning techniques for saddle point problems, in Model Order Reduction: Theory, Research Aspects and Applications, ed. by W.H.A. Schilders, H.A. Vorst, J. Rommes. Mathematics in Industry, vol. 13 (Springer, Berlin/Heidelberg, 2008), pp. 195–211

    Google Scholar 

  4. G. Biros, O. Ghattas, Parallel lagrange-Newton-Krylov-Schur methods for PDE-constrained optimization. Part I: the Krylov-Schur solver. SIAM J. Sci. Comput. 27(2), 687–713 (2005)

    MATH  MathSciNet  Google Scholar 

  5. G. Biros, O. Ghattas, Parallel Lagrange-Newton-Krylov-Schur methods for pde-constrained optimization. Part II: the Lagrange-Newton solver, and its application to optimal control of steady viscous flows. SIAM J. Sci. Comput. 27(2), 714–739 (2005)

    Google Scholar 

  6. H.G. Bock, Numerical treatment of inverse problems in chemical reaction kinetics, in Modelling of Chemical Reaction Systems, ed. by K.H. Ebert, P. Deuflhard, W. Jäger. Number 18 in Springer Series in Chemical Physics (Springer-Verlag Berlin Heidelberg, 1981)

    Google Scholar 

  7. H.G. Bock, Randwertproblemmethoden zur Parameteridentifizierung in Systemen nichtlinearer Differentialgleichungen, Bonner Mathematische Schriften, Vol. 183, (Rheinische Friedrich-Wilhelms-Universität, Bonn, 1987)

    Google Scholar 

  8. H.G. Bock, V.H. Schulz, Mathematical aspects of CFD-model based optimization, in Optimization and Computational Fluid Dynamics, ed. by D. Thevenin, G. Janiga (Springer-Verlag Berlin Heidelberg, 2008), pp. 61–78

    Google Scholar 

  9. H.G. Bock, E. Kostina, J.P. Schöder, On the role of natural level functions to achieve global convergence for damped Newton methods. Syst. Model. Optim. IFIP Int. Fed. Inf. Process. 46, 51–74 (2000)

    Google Scholar 

  10. H.G. Bock, A. Potschka, S. Sager, J.P. Schlöder, On the connection between forward and optimization problem in one-shot one-step methods, in Constrained Optimization and Optimal Control for Partial Differential Equations, ed. by G. Leugering, S. Engell, A. Griewank, M. Hinze, R. Rannacher, V. Schulz, M. Ulbrich, S. Ulbrich. International Series of Numerical Mathematics, vol. 160 (Springer, Basel, 2012), pp. 37–49

    Google Scholar 

  11. J.F. Bonnans, A. Shapiro, Perturbation Analysis of Optimization Problems. Springer Series in Operations Research (Springer, New York, 2000)

    Google Scholar 

  12. A. Borzì, V. Schulz, Multigrid methods for PDE optimization. SIAM Rev. 51(2), 361–39 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  13. A. Borzì, V. Schulz, Computational Optimization of Systems Governed by Partial Differential Equations. Number 08 in SIAM Book Series on Computational Science and Engineering (SIAM, Philadelphia, 2012)

    Google Scholar 

  14. T. Bosse, L. Lehmann, A. Griewank, Adaptive sequencing of primal, dual, and design steps in simulation based optimization. Comput. Optim. Appl. 57(3), 731–760 (2014)

    Article  MATH  MathSciNet  Google Scholar 

  15. G. Chavent, J. Jaffré, Mathematical Models and Finite Elements for Reservoir Simulation: Single Phase, Multiphase, and Multicomponent Flows Through Porous Media. Studies in Mathematics and Its Applications (Elsevier, Amsterdam, 1986)

    Google Scholar 

  16. E.J. Cramer, P.D. Frank, G.R. Shubin, J.E. Dennis, R Lewis, On alternative problem formulations for multidisciplinary design optimization, in Proceedings of the Fourth AIAA/USAF/NASA/OAI Symposium on Multidisciplinary Analysis and Optimization, Cleveland, 1992, AIAA-Paper 92-4572, 518–530 (1992)

    Google Scholar 

  17. P. Deuflhard, Newton Methods for Nonlinear Problems, Affine Invariance and Adaptive Algorithms. Number 35 in Springer Series in Computational Mathematics (Springer, Berlin/Heidelberg, 2004)

    Google Scholar 

  18. M.A. Diaz Viera, P. Sahay, M. Coronado, A.O. Tapia, Mathematical and Numerical Modeling in Porous Media: Applications in Geosciences, 1st edn. (CRC, Boca Raton, 2012)

    Google Scholar 

  19. S.E. Eisenstat, H.F. Walker, Globally convergent inexact Newton methods. SIAM J. Optim. 4(2), 393–422 (1994)

    Article  MATH  MathSciNet  Google Scholar 

  20. K. Eppler, S. Schmidt, V. Schulz, C. Ilic, Preconditioning the pressure tracking in fluid dynamics by shape hessian information. J. Optim. Theory Appl. 141(3), 513–531 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  21. J.H. Ferziger, M. Perić, Computational Methods for Fluid Dynamics, vol. 3 (Springer, Berlin, 1996)

    Book  MATH  Google Scholar 

  22. A. Fowler, Mathematical Geoscience. Interdisciplinary Applied Mathematics (Springer, London, 2011)

    Book  MATH  Google Scholar 

  23. N. Gauger, A. Griewank, A. Hamdi, C. Kratzenstein, E. Oezkaya, T. Slawig, Automated extension of fixed point PDE solvers for optimal design with bounded retardation. Int. Ser. Numer. Math. 106, 99–122 (2012)

    Google Scholar 

  24. A. Griewank, Projected Hessians for preconditioning in one-step one-shot design optimization, in Large-Scale Nonlinear Optimization. Nonconvex Optimization and Its Applications, vol. 83 (Springer, New York, 2006), pp. 151–171

    Google Scholar 

  25. A. Griewank, C. Faure, Reduced functions, gradients and Hessians from fixed-point iterations for state equations. Numer. Algorithms 30(2), 113–139 (2002)

    Article  MATH  MathSciNet  Google Scholar 

  26. A. Griewank, C. Faure, Piggyback differentiation and optimization, in Large-Scale PDE-Constrained Optimization (Santa Fe, NM, 2001). Lecture Notes in Computational Science and Engineering, vol. 30 (Springer, Berlin, 2003), pp. 148–164

    Google Scholar 

  27. A. Griewank, E. Özkaya, Quantifying retardation in simulation based optimization, in Optimization, Simulation, and Control. Springer Optimization and Its Application, vol. 76 (Springer, New York, 2013), pp. 79–96

    Google Scholar 

  28. A. Griewank, A. Walther, How up-to-date are low-rank updates? Rev. Investig. Oper. 25(2), 137–147 (2004)

    MATH  MathSciNet  Google Scholar 

  29. S. Günther, Simultane Optimierung unter PDE-Nebenbedingungen. Ein Vergleich zweier One-Shot-Methoden (Simultaneous optimization under PDE-constraints. A comparison of two One-shot methods). Diploma thesis, University of Trier, 2012

    Google Scholar 

  30. R.T. Haftka, Z. Gurdal, Elements of Structural Optimization. Contributions to Phenomenology (Kluwer Academic, Dordrecht, 1992)

    Google Scholar 

  31. Ad. Hamdi, A. Griewank, Properties of an augmented lagrangian for design optimization. Optim. Methods Softw. 25(4), 645–664 (2010)

    Google Scholar 

  32. S.B. Hazra, V. Schulz, J. Brezillon, N.R. Gauger, Aerodynamic shape optimization using simultaneous pseudo-timestep**. J. Comput. Phys. 204(1), 46–64 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  33. M. Heinkenschloss, L.N. Vicente, Analysis of inexact trust-region sqp algorithms. SIAM J. Optim. 12(2), 283–302 (2002)

    Article  MathSciNet  Google Scholar 

  34. R. Herzog, E. Sachs, Preconditioned conjugate gradient method for optimal control problems with control and state constraints. SIAM J. Matrix Anal. Appl. 31(5), 2291–2317 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  35. M. Hinze, R. Pinnau, M. Ulbrich, S. Ulbrich, Optimization with PDE Constraints. Number 23 in Mathematical Modelling: Theory and Applications (Springer, Cham, 2009)

    Google Scholar 

  36. K. Ito, K. Kunisch, V. Schulz, I. Gherman, Approximate nullspace iterations for KKT systems. SIAM J. Matrix Anal. Appl. 31(4), 1835–1847 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  37. A. Jameson, Aerodynamic design via control theory, in Recent Advances in Computational Fluid Dynamics (Princeton, NJ, 1988). Lecture Notes in Engineering, vol. 43 (Springer, Berlin, 1989), pp. 377–401

    Google Scholar 

  38. C. Kanzow, Numerik Linearer Gleichungssysteme – Direkte und Iterative Verfahren, 1. aufl. edn. (Gabler Wissenschaftsverlage, Wiesbaden, 2004)

    Google Scholar 

  39. C.T. Kelley, Iterative Methods for Optimization. Frontiers in Applied Mathematics, vol. 18 (SIAM, Philadelphia, 1999)

    Google Scholar 

  40. C. Kratzenstein, T. Slawig, Simultaneous model spin-up and parameter identification with the one-shot method in a climate model example. Int. J. Optim. Control 3(2), 99–110 (2013)

    MATH  MathSciNet  Google Scholar 

  41. A. Lashanizadegan, Sh. Ayatollahi, M. Homayoni, Simultaneous heat and fluid flow in porous media: case study: steam injection for tertiary oil recovery. Chem. Eng. Commun. 195(5), 521–535 (2008)

    Article  Google Scholar 

  42. G. Leugering, S. Engell, A. Griewank, M. Hinze, R. Rannacher, V. Schulz, M. Ulbrich, S. Ulbrich, Constrained Optimization and Optimal Control for Partial Differential Equations. International Series of Numerical Mathematics (Springer, Basel, 2012)

    Book  MATH  Google Scholar 

  43. A. Nemili, E. Özkaya, N.R. Gauger, A. Carnarius, F. Thiele, Optimal control of unsteady flows using discrete adjoints, AIAA-Paper 3720, 1–14 (2011)

    Google Scholar 

  44. J. Nocedal, S.J. Wright, Numerical Optimization. Springer Series in Operations Research and Financial Engineering, 2nd edn. (Springer, New York, 2006)

    Google Scholar 

  45. E. Özkaya, N.R. Gauger, Single-step one-shot aerodynamic shape optimization, in Optimal Control of Coupled Systems of Partial Differential Equations. International Series of Numerical Mathematics, vol. 158 (Birkhäuser Verlag, Basel, 2009), pp. 191–204

    Google Scholar 

  46. E. Özkaya, N.R. Gauger, Automatic transition from simulation to one-shot shape optimization with Navier-Stokes equations. GAMM-Mitt. 33(2), 133–147 (Springer-Verlag Berlin Heidelberg, 2010)

    Google Scholar 

  47. E. Özkaya, N. R. Gauger, An efficient one-shot algorithm for aerodynamic shape design, in New Results in Numerical and Experimental Fluid Mechanics VII (2010), pp. 35–42

    Google Scholar 

  48. P. Parekh, M.J. Follows, E.A. Boyle, Decoupling of iron and phosphate in the global ocean. Glob. Biogeochem. Cycles 19(2), GB2020 (2005)

    Google Scholar 

  49. O. Pironneau, On optimum profiles in Stokes flow. J. Fluid Mech. 59(01), 117–128 (1973)

    Article  MATH  MathSciNet  Google Scholar 

  50. S. Schmidt, V. Schulz, Impulse response approximations of discrete shape Hessians with application in CFD. SIAM J. Control Optim. 48(4), 2562–2580 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  51. S. Schmidt, C. Ilic, V. Schulz, N. Gauger, Three-dimensional large-scale aerodynamic shape optimization based on shape calculus. AIAA J. 51(11), 2615–2627 (2013)

    Article  Google Scholar 

  52. J. Schöberl, W. Zulehner, Symmetric indefinite preconditioners for saddle point problems with applications to PDE-constrained optimization problems. SIAM J. Matrix Anal. Appl. 29(3), 752–773 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  53. S. Ta’asan, ’One Shot’methods for optimal control of distributed parameter systems i: finite dimensional control. Technical report, DTIC Document, 1991

    Google Scholar 

  54. I.B. Tjoa, L.T. Biegler, Simultaneous solution and optimization strategies for parameter estimation of differential-algebraic equation systems. Ind. Eng. Chem. Res. 30(2), 376–385 (1991)

    Article  Google Scholar 

  55. F. Tröltzsch, Optimale Steuerung partieller Differentialgleichungen (Vieweg, Wiesbaden, 2005)

    Book  MATH  Google Scholar 

  56. J.C. Ziems, S. Ulbrich, Adaptive multilevel inexact sqp methods for pde-constrained optimization. SIAM J. Optim. 21(1), 1–40 (2011)

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andreas Griewank .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Bosse, T., Gauger, N.R., Griewank, A., Günther, S., Schulz, V. (2014). One-Shot Approaches to Design Optimzation. In: Leugering, G., et al. Trends in PDE Constrained Optimization. International Series of Numerical Mathematics, vol 165. Birkhäuser, Cham. https://doi.org/10.1007/978-3-319-05083-6_5

Download citation

Publish with us

Policies and ethics

Navigation