Safe computation of logarithm-determinat of large matrix

Version 1.0.0.0 (2.25 KB) by Dahua Lin
Computes the logarithm of determinant of a matrix in a safe way that avoids overflow/underflow.
3.7K Downloads
Updated 8 Nov 2008

View License

Logarithm of determinant of a matrix widely occurs in the context of multivariate statistics. The log-pdf, entropy, and divergence of Gaussian distribution typically comprises a term in form of log-determinant. This function might be useful there, especially in a high-dimensional space.

However, the standard way of computing log-determinant:

log(det(A));

is likely to run into underflow or overflow, especially for large matrices, such as 1000 x 1000 or larger ones. The main cause of the problem is that the value of determinant is too large to be represented by a single or double number. However, what is needed is the logarithm of this value rather than the determinant itself. So an approach to circumvent this difficulty is to keep the computation at logarithm scale.

The key idea of the implementation is based on the mathematical fact that the determinant of a triangular matrix equals the product of its diagonal elements. Hence, the matrix's log-determinant is equal to the sum of their logarithm values. Therefore, we can effectively tackle the problem by computing sum-of-log rather than computing log-of-product. For generic matrix, it uses LU factorization, while for positive definite matrices, cholesky factorization can be used, which is typically more efficient.

The core of the implementation contains only several lines. Actually, this function is not to solve kind of complicated problems, but rather it is aimed at offering convenient help for you when you want to compute log-determinant of large matrices. The usage is very simple:

For generic matrix:

v = logdet(A);

for positive definite matrix (such as covariance matrix), it is faster to write

v = logdet(A, 'chol');

Hope it helps.

Cite As

Dahua Lin (2024). Safe computation of logarithm-determinat of large matrix (https://www.mathworks.com/matlabcentral/fileexchange/22026-safe-computation-of-logarithm-determinat-of-large-matrix), MATLAB Central File Exchange. Retrieved .

MATLAB Release Compatibility
Created with R2008a
Compatible with any release
Platform Compatibility
Windows macOS Linux
Categories
Find more on Numerical Integration and Differential Equations in Help Center and MATLAB Answers
Acknowledgements

Inspired: Control Functionals

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!
Version Published Release Notes
1.0.0.0