Repeated Measures ANOVA Calculator

Multiple comparisons tests and calculation steps

Within-subjects design, the same subjects show up in each group, or exposed to every treatment.

Enter data in a table
Enter data in columns
Enter data from excel
The data should be separated by Enter or , (comma).
The tool ignores empty cells or non-numeric cells.

One-way repeated measures ANOVA test

The test is also called one-way ANOVA with dependent groups.
The one-way repeated measures ANOVA checks if the difference between the averages of two or more dependent groups is significant.
While on one-way ANOVA each subject appears only in one group, on one-way repeated measures ANOVA each subject appears in every group. A one-way repeated measures ANOVA contains only one categorical variable, each group/treatment is one value of the categorical variable.
For two categorical variables, use the two-way ANOVA calculator. The paired t-test is a special case of repeated measures ANOVA with two groups.
If you use a two-way mix model ANOVA with no repeat, with the subject as a random factor, and the group as a fixed factor you will get the same results.

Targets

The repeated measures ANOVA test checks if the difference between the averages of two or more dependent groups is significant when every subject appears in each group.

When performing the repeated measures ANOVA test, we try to determine if the difference between the averages reflects a real difference between the groups, or is due to the random noise inside each group.
The F statistic represents the ratio of the variance between the groups and the error. Unlike many other statistic tests, the smaller the F statistic the more likely the averages are equal.

Right-tailed F test, for the ANOVA test you can use only the right tail. Why?
Hypotheses
H0: μ1 = ... = μk
H1: not(μ1 = ... = μk)
Formula
F =MSTreatment
MSError
F distribution
t distribution two tailed

How to use the repeated measures ANOVA calculator?

  1. Significance level (α): A p-value less than the significance level is statistically significant.
    Researchers usually use 0.05, but if the price of a mistake is big, they may use a smaller value like 0.01.
  2. Correction method - correct the significance level(α) for the multiple comparisons.
    No correction - use the significance level you entered for the repeated measures ANOVA, without a correction.
    Bonferroni correction
    Sidak correction
  3. Sphericity Correction - the repeated measures ANOVA calculator checks the Sphericity assumption using Mauchly's test.
    The violation of the Sphericity leads to a too liberal test with an inflated type I error.
    Like many statistical tests, Mauchly's test has the following problems:
    Small sample size - weak test power to reject the sphericity assumption.
    Large sample size - strong power to reject even a minor violation of the sphericity assumption.
    Hence it might be better to run the sphericity correction in all cases, independent of Mauchly's test result.
    Following the options:
    Automatic - use the Greenhouse-Geisser correction only if Mauchly's test rejected the Sphericity assumption.
    Greenhouse-Geisser - always use the Greenhouse-Geisser correction even if the Sphericity assumption could not be rejected (i.e., Mauchly's test is not significant, p > 0.05).
    Hyunh-Feldt - always use the Hyunh-Feldt correction even if the Sphericity assumption could not be rejected.
    No correction - don't use any Sphericity correction, even if Mauchly's test rejected the Sphericity assumption.

  4. Outliers: extreme values, the calculator uses Tukey's Fences method with k=1.5 to identify the outliers based on the residuals.
    for other methods, you may use the outlier calculator.
    The calculator only identifies the outlier but doesn't exclude it. you should exclude outliers only if you identify them as error data.
  5. Advanced fields - for sample size
    When planning the experiment, you should choose the effect size that the test should identify. You should choose the sample size before conducting the research. We added this field to alert users that didn't calculate the sample size or did it incorrectly.
    If you use the calculator for homework you may ignore these fields.
    Effect - If you don't know the required effect size, you may use the 'effect' field. The default is 'Medium', if you change the value, it will change 'effect type' to 'Standardized effect size' and fill the proper value per Cohen's suggestion in the 'effect size' field. (0.2: Small, 0.5: medium, 0.8: large) The calculator will not use this field when pressing the 'calculate' button.
    Effect type
    f - effect size.
    f2 - effect size.
    η2 - ETA squared = SSB / (SSB + SSE)
    Effect size - the value that you want the test to be able to identify. You need a larger sample size to be able to identify a smaller effect size.
  6. Rounding - how to round the results?
    When a resulting value is larger than one, the tool rounds it, but when a resulting value is less than one the tool displays the significant figures.
  7. How to enter data?
    Enter data in a table - enter one value in each cell.
    Enter data in columns - each column is one group or treatment.
    The order in the column represents the subject, for example, the second value in each column represents subject #2.
    Enter data from excel - copy the raw data with the group header and without the subjects left column, and paste in the calculator. you may copy from Excel or Google sheets, or any tool that separates data with tab and line feed. copy the entire block, and include the header.

Assumptions

  • The dependent variable is continuous (ratio or interval)
  • One categorical independent variable
  • Each subject appears in each group/treatment
  • The residuals distribution is normal
  • Sphericity - equality of variances of the differences between the groups

Required Sample Data

Sample data from all compared groups

Parameters

a - the number of subjects, number of rows.
b - the number of groups, number of columns.
n - overall sample size, n = a * b.
Ȳi - an average of all the observations of subject i of variable A - subjects (row i).
Ȳj - an average of all the observations of group j of variable B - treatments/groups (column j).
Ȳ - overall average (ΣYi,j / n, i=1 to a, j=1 to b.

Results calculations

Sum of squares

The sum of squares accumulates the squared differences related to the effect we try to estimate.
SSA - the squared differences related to the effect of variable A. You compare the average of every category to the total average. The same value as the sum of squares between groups in one-way ANOVA.
SSB - the same as SSA, for variable B.
and compare to the total average.
A effect = Ȳi - Ȳ
B effect = Ȳj - Ȳ
Error = Cell average - A effect - B effect - Total average.
= Ȳi,j - (Ȳi - Ȳ) - (Ȳj - Ȳ) - Ȳ.
= Ȳi,j - Ȳi - Ȳj + Ȳ.
Take the square of each difference
i,j - Ȳi - Ȳj + Ȳ)2.
Count the square differences of each value in the cell.
SSEiaΣjbni,ji,j - Ȳi - Ȳj + Ȳ)2

Example: Compare the blood pressure results over time, check each subject's blood pressure before treatment, after one week and after two weeks.
Treatments/Groups: Before treatment, after 1 week, after 2 weeks.
Multiple measures of each subject

ANOVA table

SourceDegrees of
Freedom (DF)
Sum of Squares (SS)Mean Square (MS)F statisticp-value
 A - Subjects (rows)
Between the subjects
DFA = a - 1SSA = Σiab(Ȳi-Ȳ)2MSA = SSA / DFAFA = MSA / MSEP(x > FA)
 B - Treatments (Columns)
Between the treatments
DFB = b - 1SSB = Σjba(Ȳj-Ȳ)2MSB = SSB / DFBFB = MSB / MSEP(x > FB)
 Error
Within the cells
DFE = n - a - b + 1SSEiaΣjb(Yi,j - Ȳi - Ȳj + Ȳ)2MSE = SSE / DFE
Total
All the deviations from the average
DFT = n - 1SSTiaΣjb(Yi,j - Ȳ)2
SST=Sample Variance*(n-1)
SST=SSA+SSB+SSE
MSE = S2 = SST / (n - 1)

Sum of squares diagram

In the following diagram, you may see the differences per each observation Yi,j that used to calculate the sum of squares.
A - Treatments effect: Ȳi - Ȳ.
B - Subjects effect: Ȳj - Ȳ.
Error: Yi,j - Ȳi - Ȳj + Ȳ.
Total effect: Yi,j - Ȳ.

backgroundLayer 1SSESSTSSESSESSASSASSBSSBȲjȲYi,jȲiSSE