Informedness of a Contingency Matrix

Calculates the probability results are informed and recall, precision, F factor, G factor.

Description

The informedness of a prediction method as captured by a contingency matrix is defined as the probability that the prediction method will make a correct decision as opposed to guessing and is calculated using the bookmaker algorithm.

Alternate measures of the usefulness of a prediction method are all defective in that they do not take into account all cells of the contingency matrix, they do not take into account the baseline performance due to chance/guessing, or they are concerned with significance or information rather than correctness. Significance tests and ROC tuning are complementary analyses that should also be performed.

The Recall, Precision and Rank average are calculated for comparison, along
with the F and G measures corresponding to their harmonic and geometric means.

For technical paper see www.infoeng.flinders.edu.au/papers/20030007.doc

For tutorial poster see www.infoeng.flinders.edu.au/papers/20030003.ppt

• Acknowledgements: This submission has inspired the following:; paralled buddy prima
• MATLAB release: MATLAB 5.2 (R10)