T-test on two classifiers

7 views (last 30 days)
mohammad Alsajri
mohammad Alsajri on 1 Aug 2019
Answered: Image Analyst on 2 Aug 2019
hello mathworkers,
I have two classifiers classify the same dataset, run the experemnet ten times for each one on the same data, means I have for each classifer 10 accuracy result on same data , can i do the T-test to detrmine which classifier is best ?

Accepted Answer

Star Strider
Star Strider on 1 Aug 2019
I seriously doubt that a t-test or anything similar to it (even non-parametric tests) are appropriate to compare classifiers.
I refer you to the documentation section on classifier Model Building and Assessment for guidance. That in turn refers you to the testcholdout and testckfold functions that may be what you want.
I leave the rest to you.
  2 Comments
mohammad Alsajri
mohammad Alsajri on 2 Aug 2019
thanks dear Star Strider
Star Strider
Star Strider on 2 Aug 2019
As always, my pleasure.

Sign in to comment.

More Answers (1)

Image Analyst
Image Analyst on 2 Aug 2019
Do you have ground truth for your data? If so, why not simply get the accuracy percentage for each classifier?

Categories

Find more on Statistics and Machine Learning Toolbox in Help Center and File Exchange

Tags

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!