MATLAB Answers

0

T-test on two classifiers

Asked by mohammad Alsajri on 1 Aug 2019
Latest activity Answered by Image Analyst
on 2 Aug 2019
hello mathworkers,
I have two classifiers classify the same dataset, run the experemnet ten times for each one on the same data, means I have for each classifer 10 accuracy result on same data , can i do the T-test to detrmine which classifier is best ?

  0 Comments

Sign in to comment.

Tags

2 Answers

Star Strider
Answer by Star Strider
on 1 Aug 2019
 Accepted Answer

I seriously doubt that a t-test or anything similar to it (even non-parametric tests) are appropriate to compare classifiers.
I refer you to the documentation section on classifier Model Building and Assessment for guidance. That in turn refers you to the testcholdout and testckfold functions that may be what you want.
I leave the rest to you.

  2 Comments

thanks dear Star Strider
Star Strider
on 2 Aug 2019
As always, my pleasure.

Sign in to comment.


Answer by Image Analyst
on 2 Aug 2019

Do you have ground truth for your data? If so, why not simply get the accuracy percentage for each classifier?

  0 Comments

Sign in to comment.