File Exchange

image thumbnail

Measures of Effect Size Toolbox

version 1.5 (1.11 MB) by

Computes diverse effect size statistics including confidence intervals

83 Downloads

Updated

View License

Editor's Note: This file was selected as MATLAB Central Pick of the Week

The Measures of Effect Size (MES) Toolbox is a set of functions which compute a wide range of effect size statistics. The four main toolbox functions cover common analysis designs, including two-sample-, oneway- and twoway- data sets as well as categorical data (tables). Data may be repeated-measures (within-subjects).
MES for contrasts can be computed. Confidence intervals are generated for the large majority of MES, either via bootstrapping or by analytical computation, in part via noncentral t, Chi square or F distributions.
Effect size statistics are complemented by t/Chi square/F statistics and/or full ANOVA tables, which are also provided as output variables.
The toolbox was developed by Harald Hentschke (University of Tübingen) and Maik Stüttgen (University of Bochum) and is accompanied by a paper (Hentschke and Stüttgen, Eur J Neurosci 34:1887-1894, 2011).
Among the ESM available are:
Hedges’ g
Glass’ delta
requivalent (point-biserial correlation)
common language effect size
Cohen’s U1
Cohen’s U3
receiver-operating characteristic
right/left tail ratio
rank-biserial correlation

standardized mean differences for contrasts
eta squared
partial eta squared
omega squared
partial omega squared

risk difference
risk ratio
odds ratio
phi
sensitivity
specificity
positive predictive value
negative predictive value
binomial effect size display
Cramer’s V

For more details please see the documentation.

Comments and Ratings (20)

Yamil Vidal

I got it...
You apply correction for bias due to small sample size.
Thanks a lot.

korkam

korkam (view profile)

gooey

gooey (view profile)

Harald Hentschke

mes1way is intended for statistics on two or more groups, similar to a oneway ANOVA. If you read the first 20 or so lines of the help you'll know how to arrange the input into mes1way (which is a trifle more complicated than with mes).

Oliver Kumar

Nice toolbox!
Is there a way to yous mes1way to compare two variables A and B. Like it is for mes? Thanks

Harald Hentschke

This would indeed be a worthwile addition (thanks for the hint), but for a lack of time we have to restrict ourselves to maintenance and minor edits of the code, at least for now.

Julie

Julie (view profile)

Great toolbox - have you thought of adding one for heterogeneous variances (e.g. Johnston et al 2004 http://www.ncbi.nlm.nih.gov/pubmed/15058860)?

Harald Hentschke

The example you refer to in the documentation has a line break in an unfortunate place, namely right after the second minus sign in the contrast weights matrix. I presume that upon pasting the example in the command window the code line read (incorrectly)

'cWeight',[1 -1 0; 1 0 - 1]

instead of

'cWeight',[1 -1 0; 1 0 -1]

(note the space after the second minus sign in the incorrect line), which is the likely cause of the error. We'll make sure that in the next version of the documentation code line breaks are more reasonably placed.

Jay Buckey

Ran this example in the manual:
mes1way(com_post,'partialeta2','group',group,'cWeight',[1 -1 0; 1 0 - 1],'isDep',1,'nBoot',10000)

and got this error:
Dimensions of matrices being concatenated are not consistent.

Dominika I

Nolan Conaway

korkam

korkam (view profile)

Hi Pat,

it seems that your data are not sorted in a way mes2way expects them to be, although your example suggests they should be. Anyways, let's assume

tmpData=
[1.4 1 1
 1.5 1 2
 2 1 3
 ...
is a N by 3 array containing the dependent variable (whatever it is that you record) in the first column and the numbers coding for the levels of the first and second factor in the 2nd and 3rd column, respectively (in your example, groups and blocks). The following lines

tmpData=sortrows(tmpData,[2 3]);
x=tmpData(:,1);
group=tmpData(:,[2 3]);

should do the trick.

Pat

Pat (view profile)

Hello Harald,

I'm trying this toolbox with a two-way ANOVA, with 3 groups and 40 blocks. I'm not sure how to code the X and g matrices. Right now I have something like:

data Groups Blocks # -->> not in the matrix

1.4 1 1
1.5 1 2
2 1 3
.
.
.
1.5 1 40
.
.
.
and so on for the other 2 groups

But it yielded this error:
??? Error using ==> mes2way at 335
mes2way expects samples from each group to form contiguous blocks. Please sort your data accordingly

Can you help me out,

Thanks

Pat

Zhiguo Ma

Excellent toolbox and document.
It makes effect size and its confidence iterval estimation easy to use and understand.
Thanks very much for your code.

Harald Hentschke

Hello James, no, sorry, it's neither possible nor planned for the near future

James

James (view profile)

Is it possible to use this toolbox for ANOVAs with >2 factors?

Hi Jonathan, yes it does: Hedges' g is one manifestation of Cohen's D, maybe the most popular one. For more details on this, please see the documentation.

Jonathan

does this have Cohen's D, by some other name?? could it be added? at least in Psychology, its a widely used effect size estimate. Thanks!

Wow!
Very impressed with the well written code and manual. Thanks a bunch!

Updates

1.5

- mixed within/between analyses are now possible with unequal sample sizes along the between-subjects factor
- minor edits of comments in code and documentation

See VersionHistory_MESToolbox.pdf for details

1.4

- mixed within/between analyses are now possible with unequal sample sizes along the between-subjects factor
- minor edits of comments in code and documentation
See VersionHistory_MESToolbox.pdf for details

1.3

- implementation of exact confidence intervals for g1
- option to plot data in twoway analysis
- enhancement & correction of documentation

See VersionHistory_MESToolbox.pdf for details.

1.2

- added unstandardized MES (mean difference & contrasts)
- enhanced documentation accordingly
- bug fix in mes1way
- streamlined computation of t statistics in mes1way

The changes are explained in more detail in VersionHistory_MESToolbox.pdf

1.1

- some bug fixes
- additions to the documentation
- added example data (which were missing in the previous version, sorry)

Details are listed in VersionHistory.pdf

MATLAB Release
MATLAB 7.5 (R2007b)

Download apps, toolboxes, and other File Exchange content using Add-On Explorer in MATLAB.

» Watch video