No BSD License  

Highlights from
Kullback-Leibler Divergence

4.0

4.0 | 1 rating Rate this file 86 Downloads (last 30 days) File Size: 982 Bytes File ID: #20688

Kullback-Leibler Divergence

by Nima Razavi

 

13 Jul 2008 (Updated 15 Jul 2008)

Calculates the Kullback-Leibler Divergence between two probability distributions

| Watch this File

File Information
Description

For the description of the divergence you can take a look at :
http://en.wikipedia.org/wiki/Kullback-Leibler_divergence

MATLAB release MATLAB 7.4 (R2007a)
Tags for This File  
Everyone's Tags
Tags I've Applied
Add New Tags Please login to tag files.
Comments and Ratings (4)
14 Jul 2008 Dimitri Shvorob

Your implementation is third of its kind on FEX: please take time to search FEX for existing code before posting.

07 Mar 2011 Nate Greene

Please note that the logarithms should be base 2 if calculating values in bits.

07 May 2011 Hung nguyen  
18 Oct 2011 amjad khan

dear sir we need kld for feature selection in MRI brain image can some one help me

Please login to add a comment or rating.
Updates
15 Jul 2008

BUG_FIXED

Tag Activity for this File
Tag Applied By Date/Time
statistics Nima Razavi 22 Oct 2008 10:10:01
probability Nima Razavi 22 Oct 2008 10:10:01
kullbackleibler divergence Nima Razavi 22 Oct 2008 10:10:01
relative entropy Nima Razavi 22 Oct 2008 10:10:01
infor Nima Razavi 22 Oct 2008 10:10:01
information gain Nima Razavi 22 Oct 2008 10:10:01
infor Haimonti 10 Jan 2009 22:35:39
information gain Haimonti 10 Jan 2009 22:35:42
kullbackleibler divergence Thanneer 10 Jan 2010 22:13:27
kullbackleibler divergence John Lee (Complete) 08 Jul 2010 16:36:22
kullbackleibler divergence Vamshidhar 10 Aug 2010 06:13:15
statistics Vamshidhar 10 Aug 2010 06:13:25
kullbackleibler divergence Charles 12 Aug 2010 16:17:47
statistics Jasper Grendel 22 Nov 2010 05:20:58
infor Jasper Grendel 22 Nov 2010 05:21:02
information gain Jasper Grendel 22 Nov 2010 05:21:03
kullbackleibler divergence Jasper Grendel 22 Nov 2010 05:21:05
martin distance improcess 03 Sep 2011 18:28:42
kullbackleibler divergence Woojin 05 Nov 2011 10:46:45

Contact us at files@mathworks.com