Repeated Measures ANOVA Calculator

Multiple comparisons tests and calculation steps

Within-subjects design, the same subjects show up in each group, or exposed to every treatment.

Enter data in table
Enter data in columns
Enter data from excel
The data should be separated by Enter or , (comma).
The tool ignores empty cells or non-numeric cells.

One-way repeated measures ANOVA

One-way ANOVA with dependent groups

The one-way repeated measures ANOVA checks if the difference between the averages of two or more dependent groups is significant.
While on one-way ANOVA each subject appears only in one group, on one-way repeated measures ANOVA each subject appears in every group. A one-way repeated measures ANOVA contains only one categorical variable, each group/treatment is one value of the categorical variable.
For two categorical variables, use two-way ANOVA calculator The paired t-test is a special case of repeated measures ANOVA with two groups.
If you use a two-way mix model ANOVA with no repeat, with subject as the random factor, and group as the fixed factor

There are many possible models, this calculator deal currently only with the following balanced models: You may use data with replications, or data without replications.

Targets

The two way ANOVA test checks if the difference between the averages of two or more dependent groups is significant.

When performing ANOVA test, we try to determine if the difference between the averages reflects a real difference between the groups, or is due to the random noise inside each group.
The F statistic represents the ratio of the variance between the groups and the variance inside the groups. Unlike many other statistic tests, the smaller the F statistic the more likely the averages are equal.

Right-tailed F test, for ANOVA test you can use only the right tail. Why?
Hypotheses
H0: μ1 = ... = μk
H1: not(μ1 = ... = μk)
Formula
F =MSTreatment
MSError
F distribution
t distribution two tailed

How to use the repeated measures ANOVA calculator?
  1. Significance level (α): A p-value less than the significance level is statistically significant.
    Researchers usually use 0.05, but if the price of a mistake is big, they may use a smaller value like 0.01.
  2. Correction method - correct the significance level(α) for the multiple comparisons.
    No correction - use the significance level you entered for the repeated measures ANOVA, without a correction.
    Bonferroni correction
    Sidak correction
  3. Sphericity Correction - the repeated measures ANOVA calculator checks the Sphericity assumption using the Mauchly's test.
    Automatic - use the Greenhouse-Geisser correction only if the Mauchly's test rejected the Sphericity assumption.
    Greenhouse-Geisser - always use the Greenhouse-Geisser correction even if the Sphericity assumption could not be rejected (i.e., Mauchly's test is not significant, p > 0.05).
    Hyunh-Feldt - always use the Greenhouse-Geisser correction even if the Sphericity assumption could not be rejected.
    No correction - don't use any Sphericity correction, even if the Mauchly's test rejected the Sphericity assumption.
  4. Outliers: extreme values. relevant only if you entered raw data.
    included - the calculator will calculate the outliers but will include them in the calculation.
    Excluded - The calculator will exclude the outliers before calculating the average and the standard deviation.
  5. Advanced fields - for sample size
    When planning the experiment, you should choose the effect size that the test should identify. You should choose the sample size before conducting the research. We added this field to alert users that didn't calculate the sample size, or did it incorrectly.
    If you use the calculator for homework you may ignore these fields.
    Effect - If you don't know the required effect size, you may use the 'effect' field. The default is 'Medium', if you change the value, it will change 'effect type' to 'Standardized effect size' and fill the proper value per Cohen's suggestion in the 'effect size' field. (0.2: Small, 0.5: medium, 0.8: large) The calculator will not use this field when pressing the 'calculate' button.
    Effect type
    f - effect size.
    f2 - effect size.
    η2 - ETA squared = SSB / (SSB + SSE)
    Effect size - the value that you want the test to be able to identify. You need a larger sample size to be able to identify a smaller effect size.
  6. Rounding - how to round the results?
    When a resulting value is larger than one, the tool rounds it, but when a resulting value is less than one the tool displays the significant figures.
  7. How to enter data?
    Enter data in table - enter one value in each cell.
    Enter data in columns - each column is one group or treatment.
    The order in the column represent the subject, for example the second value in each column represent subject #2.
    Enter data from excel - copy the raw data with the group header and without the subjects left column, and paste in the calculator. you may copy from Excel or Google sheets, or any tool that separates data with tab and line feed. copy the entire block, include the header .

Assumptions

  • The dependent variable is continuous (ratio or interval)
  • One categorical independent variable
  • Each subject appears in each group/treatment
  • The residuals distribution is normal
  • Sphericity - equality of variances of the differences between the groups

Required Sample Data

Sample data from all compared groups

Parameters

a - the number of subjects, number of rows.
b - the number of groups, number of columns.
n - overall sample side, n = a * b.
Ȳi - average of all the observations of subject i of variable A - subjects (row i).
Ȳj - average of all the observations of group j of variable B - treatments/groups (column j).
Ȳ - overall average (ΣYi,j / n, i=1 to a, j=1 to b.

Results calculations

Sum of squares

The sum of squares accumulates the squared differences related to the effect we try to estimate.
SSA - the squared differences related to the effect of variable A. You compare the average of every category to the total average. The same value as the sum of squares between groups in one way ANOVA.
SSB - the same as SSA, for variable B.
and compare to the total average.
A effect = Ȳi - Ȳ
B effect = Ȳj - Ȳ
Error = Cell average - A effect - B effect - Total average.
= Ȳi,j - (Ȳi - Ȳ) - (Ȳj - Ȳ) - Ȳ.
= Ȳi,j - Ȳi - Ȳj + Ȳ.
Take the square of each difference
i,j - Ȳi - Ȳj + Ȳ)2.
Count the square differences of each value in the cell.
SSEiaΣjbni,ji,j - Ȳi - Ȳj + Ȳ)2

Example: Compare the blood pressure results over time, check each subject's blood pressure before treatment, after one week and after two weeks.
Treatments/Groups: Before treatment, after 1 week, after 2 weeks.
Multiple measures of each subject

ANOVA table

SourceDegrees of
Freedom (DF)
Sum of Squares (SS)Mean Square (MS)F statisticp-value
 A - Subjects (rows)
Between the subjects
DFA = a - 1SSA = Σiab(Ȳi-Ȳ)2MSA = SSA / DFAFA = MSA / MSEP(x > FA)
 B - Treatments (Columns)
Between the treatments
DFB = b - 1SSB = Σjba(Ȳj-Ȳ)2MSB = SSB / DFBFB = MSB / MSEP(x > FB)
 Error
Within the cells
DFE = n - a - b + 1SSEiaΣjb(Yi,j - Ȳi - Ȳj + Ȳ)2MSE = SSE / DFE
Total
All the deviations from the average
DFT = n - 1SSTiaΣjb(Yi,j - Ȳ)2
SST=Sample Variance*(n-1)
SST=SSA+SSB+SSE
MSE = S2 = SST / (n - 1)

Sum of squares diagram

In the following diagram you may see the differences per each observation Yi,j that used to calculate the sum of squares.
A - Treatments effect: Ȳi - Ȳ.
B - Subjects effect: Ȳj - Ȳ.
Error: Yi,j - Ȳi - Ȳj + Ȳ.
Total effect: Yi,j - Ȳ.

backgroundLayer 1SSESSTSSESSESSASSASSBSSBȲjȲYi,j,kȲiSSE