View License

Download apps, toolboxes, and other File Exchange content using Add-On Explorer in MATLAB.

» Watch video

Highlights from
Conditional Entropy

Be the first to rate this file! 18 Downloads (last 30 days) File Size: 1.38 KB File ID: #28693 Version: 1.0

Conditional Entropy


Will Dwinnell (view profile)


Calculates the conditional entropy of a discrete variable, given other discrete variables.

| Watch this File

File Information

ConditionalEntropy: Calculates conditional entropy (in bits) of Y, given X

  H = ConditionalEntropy(Y,X)
  H = calculated entropy of Y, given X (in bits)
  Y = dependent variable (column vector)
  X = independent variable(s)
  Note 1: Each distinct value is considered a unique symbol.

  Note 2: requires 'Entropy' and 'MutualInformation' functions
  Example: 'X' (1 bit of entropy), 'Y' (2 bits of entropy)
    Given 'X', 'Y's conditional entropy is 1 bit.
  Note: Estimated entropy values are slightly less than true, due to finite sample size.
  Y = ceil(4 * rand(1e3,1)); X = double(Y <= 2);

MATLAB release MATLAB 6.0 (R12)
Other requirements Requires function 'MutualInformation'.
Tags for This File   Please login to tag files.
Please login to add a comment or rating.

Contact us