Null Space Sensitivity Analysis
Sensitivity is the variation in model solution values due to variability, or uncertainty, in one or more model input values. The null space is the region of model solution space for which changes to parameter values (during calibration or training) do not result in changes to the objective function that is minimized for training. Because parameter value change does not impact calibration and inverse-style selection of optimal parameter values, parameters in the null space can be set to any value (constrained by professional judgement), and the model will maintain calibration. Null space sensitivity analysis is an important precursor to model-related decision making.
Assimilating Complex Models with Indirect Observations under Data Insufficiency
Data assimilation (DA) provides optimal combination of model simulation results with observed values. There are four sources of uncertainty for any DA: 1) inherent uncertainty from limitations of scientific knowledge, 2) data insufficiency, which is insufficient information content in target observations for history matching-constrained parameter selection, 3) observation or measurement error, and 4) model representation error. Null space sensitivity analysis is a technique to examine data sufficiency. Sensitivity is the variation in model solution values due to variability, or uncertainty, in one or more parameter values. Parameters are in the null space when their variation causes minimal change to history matching skill during assimilation. As a result, null space parameters can be set to any value, constrained only by professional judgement, to produce a best fit model. Null space parameters that generate significant changes to important model predictions are however diagnostic of data insufficiency. We present a new null space sensitivity analysis for the iterative ensemble smoother (iES) algorithm, which provides an ensemble method for DA, in PEST++. A fundamental advantage of iES is computational efficiency through efficient and empirical sampling of posterior parameter distributions. Our new method leverages uncertainty analysis post-assimilation rather than robust Monte Carlo sampling, which is computationally expensive, to determine empirical parameter sensitivity and maintain the computational advantages of iES. Sensitivity analysis is generated by an ensemble of models with insensitive parameters varying across the feasible range of parameter values and sensitive parameters fixed to best-fit model values. The case study application of the null space sensitivity analysis identified data insufficiency leading to limited decision support regarding the amount of groundwater storage in the system, and it demonstrated a more than 97% reduction in computational requirements relative to the Null Space Monte Carlo (NSMC) method.