In applied statistics, optimal estimation is a regularized matrix inverse method based on Bayes' theorem. It is used very commonly in the geosciences, particularly for atmospheric sounding. A matrix inverse problem looks like this:

${\displaystyle \mathbf {A} {\vec {x}}={\vec {y}}}$

The essential concept is to transform the matrix, A, into a conditional probability and the variables, ${\displaystyle {\vec {x}}}$ and ${\displaystyle {\vec {y}}}$ into probability distributions by assuming Gaussian statistics and using empirically determined covariance matrices.

Typically, one expects the statistics of most measurements to be Gaussian. So for example for ${\displaystyle P({\vec {y}}|{\vec {x}})}$, we can write:

${\displaystyle P({\vec {y}}|{\vec {x}})={\frac {1}{(2\pi )^{mn/2}|{\boldsymbol {S_{y}}}|}}\exp \left[-{\frac {1}{2}}({\boldsymbol {A}}{\vec {x}}-{\vec {y}})^{T}{\boldsymbol {S_{y}}}^{-1}({\boldsymbol {A}}{\vec {x}}-{\vec {y}})\right]}$

where m and n are the numbers of elements in ${\displaystyle {\vec {x}}}$ and ${\displaystyle {\vec {y}}}$ respectively ${\displaystyle {\boldsymbol {A}}}$ is the matrix to be solved (the linear or linearised forward model) and ${\displaystyle {\boldsymbol {S_{y}}}}$ is the covariance matrix of the vector ${\displaystyle {\vec {y}}}$. This can be similarly done for ${\displaystyle {\vec {x}}}$:

${\displaystyle P({\vec {x}})={\frac {1}{(2\pi )^{m/2}|{\boldsymbol {S_{x_{a}}}}|}}\exp \left[-{\frac {1}{2}}({\vec {x}}-{\widehat {x_{a}}})^{T}{\boldsymbol {S_{x_{a}}}}^{-1}({\vec {x}}-{\widehat {x_{a}}})\right]}$

Here ${\displaystyle P({\vec {x}})}$ is taken to be the so-called "a-priori" distribution: ${\displaystyle {\widehat {x_{a}}}}$ denotes the a-priori values for ${\displaystyle {\vec {x}}}$ while ${\displaystyle {\boldsymbol {S_{x_{a}}}}}$ is its covariance matrix.

The nice thing about the Gaussian distributions is that only two parameters are needed to describe them and so the whole problem can be converted once again to matrices. Assuming that ${\displaystyle P({\vec {x}}|{\vec {y}})}$ takes the following form:

${\displaystyle P({\vec {x}}|{\vec {y}})={\frac {1}{(2\pi )^{mn/2}|{\boldsymbol {S_{x}}}|}}\exp \left[-{\frac {1}{2}}({\vec {x}}-{\widehat {x}})^{T}{\boldsymbol {S_{x}}}^{-1}({\vec {x}}-{\widehat {x}})\right]}$

${\displaystyle P({\vec {y}})}$ may be neglected since, for a given value of ${\displaystyle {\vec {x}}}$, it is simply a constant scaling term. Now it is possible to solve for both the expectation value of ${\displaystyle {\vec {x}}}$, ${\displaystyle {\widehat {x}}}$, and for its covariance matrix by equating ${\displaystyle P({\vec {x}}|{\vec {y}})}$ and ${\displaystyle P({\vec {y}}|{\vec {x}})P({\vec {x}})}$. This produces the following equations:

${\displaystyle {\boldsymbol {S_{x}}}=({\boldsymbol {A}}^{T}{\boldsymbol {S_{y}^{-1}}}{\boldsymbol {A}}+{\boldsymbol {S_{x_{a}}^{-1}}})^{-1}}$

${\displaystyle {\widehat {x}}={\widehat {x_{a}}}+{\boldsymbol {S_{x}}}{\boldsymbol {A}}^{T}{\boldsymbol {S_{y}}}^{-1}({\vec {y}}-{\boldsymbol {A}}{\widehat {x_{a}}})}$

Because we are using Gaussians, the expected value is equivalent to the maximum likely value, and so this is also a form of maximum likelihood estimation.

Typically with optimal estimation, in addition to the vector of retrieved quantities, one extra matrix is returned along with the covariance matrix. This is sometimes called the resolution matrix or the averaging kernel and is calculated as follows:

${\displaystyle {\boldsymbol {R}}=({\boldsymbol {A}}^{T}{\boldsymbol {S_{y}}}^{-1}{\boldsymbol {A}}+{\boldsymbol {S_{x_{a}}}}^{-1})^{-1}{\boldsymbol {A}}^{T}{\boldsymbol {S_{y}}}^{-1}{\boldsymbol {A}}}$

This tells us, for a given element of the retrieved vector, how much of the other elements of the vector are mixed in. In the case of a retrieval of profile information, it typical indicates the altitude resolution for a given altitude. For instance if the resolution vectors for all the altitudes contain non-zero elements (to a numerical tolerance) in their four nearest neighbours, then the altitude resolution is only one fourth that of the actual grid size.

• Clive D. Rodgers (1976). "Retrieval of Atmospheric Temperature and Composition From Remote Measurements of Thermal Radiation". Reviews of Geophysics and Space Physics. 14 (4): 609. Bibcode:1976RvGSP..14..609R. doi:10.1029/RG014i004p00609.

• Clive D. Rodgers (2000). Inverse Methods for Atmospheric Sounding: Theory and Practice. World Scientific.

• Clive D. Rodgers (2002). "Atmospheric Remote Sensing: The Inverse Problem". Proceedings of the Fourth Oxford/RAL Spring School in Quantitative Earth Observation. University of Oxford.