The Nth-Order Comprehensive Adjoint Sensitivity Analysis Methodology, Volume I: Overcoming the Curse of Dimensionality: Linear Systems

The computational models of physical systems comprise parameters, independent and dependent variables. Since the physical processes themselves are seldom known precisely and since most of the model parameters stem from experimental procedures which are also subject to imprecisions, the results predicted by these models are also imprecise, being affected by the uncertainties underlying the respective model. The functional derivatives (also called "sensitivities") of results (also called "responses") produced by mathematical/computational models are needed for many purposes, including: (i) understanding the model by ranking the importance of the various model parameters; (ii) performing "reduced-order modeling" by eliminating unimportant parameters and/or processes; (iii) quantifying the uncertainties induced in a model response due to model parameter uncertainties; (iv) performing "model validation," by comparing computations to experiments to address the question "does the model represent reality?" (v) prioritizing improvements in the model; (vi) performing data assimilation and model calibration as part of forward "predictive modeling" to obtain best-estimate predicted results with reduced predicted uncertainties; (vii) performing inverse "predictive modeling"; (viii) designing and optimizing the system.

This 3-Volume monograph describes a comprehensive adjoint sensitivity analysis methodology, developed by the author, which enables the efficient and exact computation of arbitrarily high-order sensitivities of model responses in large-scale systems comprising many model parameters. The qualifier "comprehensive" is employed to highlight that the model parameters considered within the framework of this methodology also include the system's uncertain boundaries and internal interfaces in phase-space. The model's responses can be either scalar-valued functionals of the model's parameters and state variables (e.g., as customarily encountered in optimization problems) or general function-valued responses.

Since linear operators admit bona-fide adjoint operators, responses of models that are linear in the state functions (i.e., dependent variables) can depend simultaneously on both the forward and the adjoint state functions. Hence, the sensitivity analysis of such responses warrants the treatment of linear systems in their own right, rather than treating them as particular cases of nonlinear systems. This is in contradistinction to responses for nonlinear systems, which can depend only on the forward state functions, since nonlinear operators do not admit bona-fide adjoint operators (only a linearized form of a nonlinear operator may admit an adjoint operator). Thus, Volume 1 of this book presents the mathematical framework of the n^th-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Response-Coupled Forward/Adjoint Linear Systems (abbreviated as "n^th-CASAM-L"), which is conceived for the most efficient computation of exactly obtained mathematical expressions of arbitrarily-high-order (n^th-order) sensitivities of a generic system response with respect to all of the parameters underlying the respective forward/adjoint systems. Volume 2 of this book presents the application of the n^th-CASAM-L to perform a fourth-order sensitivity and uncertainty analysis of an OECD/NEA reactor physics benchmark which is representative of a large-scale model comprises many (21,976) uncertain parameters, thereby amply illustrating the unique potential of the n^th-CASAM-L to enable the exact and efficient computation of chosen high-order response sensitivities to model parameters. Volume 3 of this book presents the "n^th-Order Comprehensive Adjoint Sensitivity Analysis Methodology for Nonlinear Systems" (abbreviation: n^th-CASAM-N) for the practical, efficient, and exact computation of arbitrarily-high order sensitivities of responses to model parameters for systems that are also nonlinear in their underlying state functions. Such computations are not feasible with any other methodology.

The application of the n^th-CASAM-L and the n^th-CASAM-N overcomes the so-called "curse of dimensionality" in sensitivity and uncertainty analysis, thus revolutionizing all of the fields of activities which require accurate computation of response sensitivities. Since this monograph includes many illustrative, fully worked-out, paradigm problems, it can serve as a textbook or as supplementary reading for graduate courses in academic departments in the natural sciences and engineering.