Documentation

This page lists some of the scientific publications developed by our research group about SAFE and Global Sensitivity Analysis in general. These are useful readings to learn about the rationale of the SAFE toolbox, how to use it, what kind of questions GSA can address and the key steps in setting up GSA.
For a quicker, hands-on introduction to SAFE/GSA, instead, you can look at some of our interactive Jupyter Notebooks (they can be run from the browser, no need to download/install SAFE):
– Using GSA to identify the most influential model parameters: application to a hydrological model
– Using GSA to find the key controls of a system: an ecological model example

Resources about SAFE

A general introduction to the rationale and architecture of SAFE is given in:
Pianosi, F., Sarrazin, F., Wagener, T. (2015), A Matlab toolbox for Global Sensitivity Analysis, Environmental Modelling & Software, 70, 80-85.
Detailed documentation on how to use the toolbox is given in the workflow scripts provided with the Toolbox and in the help of each function.

Getting started

To get started using SAFE, we suggest opening one of the workflow scripts and running the code step by step. The header of each workflow script gives a short description of the method and case study model, and of the main steps and purposes of that workflow, as well as references for further reading. The name of each workflow is composed as:

workflow_<method>_<model>

<model> includes: two hydrological models (Hymod and HBV) and two benchmark functions (the Ishigami and Homma function, and the Sobol’ g-function).
<method> includes: eet (elementary effects test, or method of Morris), fast (Fourier amplitude sensitivity test), rsa (regional sensitivity analysis), vbsa (variance-based sensitivity analysis, or method of Sobol’), PAWN.
Furthermore, SAFE includes additional workflow scripts on how to connect SAFE to a model running outside matlab/octave (external) and how to use visualisation functions for qualitative GSA (visual).

Resources about Global Sensitivity Analysis

Why doing GSA

A literature review of GSA applications in the context of earth systems modelling, focusing on what can be learnt about the construction, testing and use of environmental models through the application of GSA:
Wagener, T. & Pianosi, F. (2019), What has Global Sensitivity Analysis ever done for us? A systematic review to support scientific advancement and to inform policy-making in earth system modelling, Earth-Science Reviews, 149, 1-18.
This paper could be a useful starting point to explore the type of questions GSA can address, and why using GSA in the first place.

A discussion about the connection between GSA and model evaluation particularly for impacts assessment under change:
Wagener, T., Reinecke R., Pianosi, F. (2022) On the evaluation of climate change impact models, WIREs Climate Change, 13(3), e772

Support in setting up a GSA

A general introduction to the working principles of Global Sensitivity Analysis and how to make key set-up choices (how to choose the GSA method, the sampling strategy, the sample size, etc.) is given in:
Pianosi, F., Beven, K., Freer, J.W. Hall, J. Rougier, J. Stephenson, D.B., Wagener, T. (2016), Sensitivity analysis of environmental models: A systematic review with practical workflow, Environmental Modelling & Software, 79, 214-232.

More discussion on the practical effects of some of the key set-up choices, and how to interpret them, is given in:
Noacco, V., Sarrazin, F., Pianosi, F. and Wagener, T. (2019), Matlab/R workflows to assess critical choices in Global Sensitivity Analysis using the SAFE toolbox, MethodX, 6, 2258-2280.

Specific discussion on the choice of the sample size for EET, RSA and VBSA can be found in:
Sarrazin, F., Pianosi, F., Wagener, T. (2016), Sensitivity analysis of environmental models: Convergence and validation Environmental Modelling & Software, 79, 135-152.