Formation matrix

This article may be too technical for most readers to understand. Please help improve it to make it understandable to non-experts, without removing the technical details. (May 2014) (Learn how and when to remove this message)

In statistics and information theory, the expected formation matrix of a likelihood function ${\displaystyle L(\theta )}$ is the matrix inverse of the

of ${\displaystyle L(\theta )}$, while the observed formation matrix of ${\displaystyle L(\theta )}$ is the inverse of the of ${\displaystyle L(\theta )}$.^[1]

Currently, no notation for dealing with formation matrices is widely used, but in books and articles by

, the symbol ${\displaystyle j^{ij}}$ is used to denote the element of the i-th line and j-th column of the observed formation matrix. The

geometric interpretation

of the Fisher information matrix (metric) leads to a notation of ${\displaystyle g^{ij}}$ following the notation of the (contravariant) metric tensor in differential geometry. The Fisher information metric is denoted by ${\displaystyle g_{ij}}$ so that using Einstein notation we have ${\displaystyle g_{ik}g^{kj}=\delta _{i}^{j}}$.

These matrices appear naturally in the asymptotic expansion of the distribution of many statistics related to the likelihood ratio.

See also

• Fisher information
• Shannon entropy

Notes

References

• Barndorff-Nielsen, O.E., Cox, D.R. (1989), Asymptotic Techniques for Use in Statistics, Chapman and Hall, London.
  ISBN 0-412-31400-2
• Barndorff-Nielsen, O.E., Cox, D.R., (1994). Inference and Asymptotics. Chapman & Hall, London.
• P. McCullagh, "Tensor Methods in Statistics", Monographs on Statistics and Applied Probability, Chapman and Hall, 1987.
• Edwards, A.W.F. (1984) Likelihood. CUP.
  ISBN 0-521-31871-8