Mutual Information In probability theory and information theory
The definition of mutual information could resort to wiki:
http://en.wikipedia.org/wiki/Mutual_information
For marginal mutual information, we say it is :
I(A,B)=sum sum P(A,B) log[P(A,B)/P(A)P(B)]
For conditional mutual information, we say it is :
I(A,B|C)=sum sum P(A,B|C) log[P(A,B|C)/P(A|C)P(B|C)]
For mutual information matric, we say it is:
the matric saves all pairs of I(A,B)
Please refer to "ControlCentor.m", we have a simple example for you understanding. If there is any question, please let me know, i will help you as soon as possible.
PS: fast mex programming functions are provided for advance users here too
Cite As
Guangdi Li (2024). Mutual Information In probability theory and information theory (https://www.mathworks.com/matlabcentral/fileexchange/23274-mutual-information-in-probability-theory-and-information-theory), MATLAB Central File Exchange. Retrieved .
MATLAB Release Compatibility
Platform Compatibility
Windows macOS LinuxTags
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!Discover Live Editor
Create scripts with code, output, and formatted text in a single executable document.