ANOVA with repeated measurement

Repeated measures ANOVA tests whether there are statistically significant differences in three or more dependent samples.

The one-factor analysis of variance with repeated measures is the extension of the t-test for dependent samples for more than two groups.

In the t-test for dependent samples, we examined whether there is a difference between two dependent samples. If we want to test whether there is a difference between more than two dependent samples, we use the analysis of variance with repeated measures.

So what are dependent samples?

In a dependent sample, the measured values are connected. For example, if a sample is drawn of people who have knee surgery and these people are interviewed before the surgery and one week and two weeks after the surgery, it is a dependent sample. This is the case because the same person was interviewed at two points in time.

Difference of analysis of variance with and without repeated measurements

If 3 or more independent samples are available, ANOVA without repeated measures is used. But be careful, of course the assumptions have to be checked! More about this later!

Example of repeated measures ANOVA

You might be interested to know whether therapy after a slipped disc has an influence on the patient's perception of pain. For this purpose, you measure the pain perception before the therapy, in the middle of the therapy and at the end of the therapy. Now you want to know if there is a difference between the different times.

So, your independent Variable is time, or therapy progressing over time. Your dependent variable is the pain perception. You now have a history of the pain perception of each person over time and want to know whether the therapy has an influence on the pain perception.

To put it simply, in the left case the therapy has an influence and in the right case the therapy has no influence on the pain sensation. In the course of time, the pain sensation does not change on the right hand case, but it does on the left hand one.

Research question and hypotheses

What is the research question in a repeated measures ANOVA? The research question is: Is there a significant difference between the dependent groups in terms of the mean?

The null and alternative hypotheses result in:

• Null hypothesis: there are no significant differences between the dependent groups.
• Alternative hypothesis: there is a significant difference between the dependent groups.

Assumptions ANOVA with repeated measures

Now we come to the assumptions of ANOVA with repeated measures and finally I will show you how you can easily calculate it online. So what are the assumptions?

• The samples must be dependent samples.
• The data should be approximately normally distributed and have metric scale level.
• The variance in each group should be equal.

Results of the one-factor analysis of variance with repeated measures.

The analysis of variance with repeated measurement gives you a p-value for your data. With the help of this p-value you can read whether there is a significant difference between the repeated measurements.

If the calculated p-value is smaller than the predefined significance level, which is usually 0.05, the null hypothesis is rejected.

In this example, the p-value is 0.011, which is less than 0.05. Therefore the null hypothesis is rejected and it can be assumed that there is a difference between the different time points.

Effect size for repeated measures ANOVA

In the case of analysis of variance with repeated measures, the effect size can be calculated via the partial eta squared (η_p²). Here, the variance within individuals is related to the variance that cannot be explained, i.e. the error variance.

Bonferroni Post-hoc-Test

As soon as there is a significant difference between the different time points, it is of course also of interest to identify between which exact time points that difference exists. This can be found out with the help of the Bonferroni post-hoc test.

In the Bonferroni post-hoc test in a repeated measures ANOVA, multiple t-tests are calculated for dependent samples. However, the problem with multiple testing is that the so-called alpha error (the false rejection of the null hypothesis) increases with the number of tests. To counteract this, the Bonferroni post-hoc test calculates the obtained p-values times the number of tests.

In the present case, 3 tests were performed, so for the calculation of the Bonferroni post-hoc test, the p-value obtained from the t-test was multiplied by 3 in the background. Between morning and noon there is a significant value of 0.021, therefore it can be assumed that there is a difference between these two time points.

Calculate ANOVA with measurement repetitions with DATAtab

ANOVA with repeated measures can be easily calculated with DATAtab. To do this, simply visit the repeated measures ANOVA calculator on DATAtab and copy your own data into the table.

Now you just need to select your variables. If you select three or more metric variables, an analysis of variance with repeated measures is automatically calculated.

And you get the results. You can read the p value in the table and if you don't know exactly how to interpret the results, just look at the interpretation in words.

In addition, the results are displayed in a boxplot. Finally, the Bonferroni post toc test is calculated.