Analysis Of Variance Article Index for
Analysis Of
Shopping
Variance
Website Links For
Analysis
 

Information About

Analysis Of Variance





OVERVIEW

There are three conceptual classes of such models:

In practice, there are several types of ANOVA depending on the number of treatments and the way they are applied to the subjects in the experiment:
  • One-way ANOVA is used to test for differences among three or more Independent groups.

  • One-way ANOVA For Repeated Measures is used when the subjects are subjected to Repeated Measures ; this means that the same subjects are used for each treatment. Note that this method can be subject to Carryover Effects .

  • and each variable has two levels or distinct values. Factorial ANOVA can also be multi-level such as 3×3, etc. or higher order such as 2×2×2, etc. but analyses with higher numbers of factors are rarely done because the calculations are lengthy and the results are hard to interpret.

  • When one wishes to test two or more independent groups subjecting the subjects to repeated measures, one may perform a factorial Mixed-design ANOVA , in which one factor is independent and the other is repeated measures. This is a type of mixed effect model.

  • Multivariate analysis of variance ( MANOVA ) is used when there is more than one Dependent Variable .



MODELS


Fixed-effects model

The fixed-effects model of analysis of variance applies to situations in which the experimenter has subjected the experimental material to several treatments, each of which affects only the mean of the underlying normal distribution of the "response variable".


Random-effects model

Random effects models are used when the treatments are not fixed. This occurs when the various treatments (also known as factor levels) are sampled from a larger population. Because the treatments themselves are Random Variables , some assumptions and the method of contrasting the treatments differ from Anova model 1.

Most random-effects or mixed-effects models are not concerned with making inferences concerning the particular sampled factors. For example, consider a large manufacturing plant in which many machines produce the same product. The statistician studying this plant would have very little interest in comparing the three particular machines to each other. Rather, inferences that can be made for ''all'' machines are of interest, such as their variability and the overall mean.


ASSUMPTIONS


These together form the common assumption that the error residuals are independently, identically, and normally distributed for fixed effects models, or:

: arepsilon hicksim N(0, \sigma^2).

Anova 2 and 3 have more complex assumptions about the expected value and variance of the residuals since the factors themselves may be drawn from a population.


LOGIC OF ANOVA


Partitioning of the sum of squares

The fundamental technique is a partitioning of the total sum of squares into components related to the effects used in the model. For example, we show the model for a simplified ANOVA with one type of treatment at different levels.

: SS_{\hbox{Total}} = SS_{\hbox{Error}} + SS_{\hbox{Treatments}}\,\!

The number of Degrees Of Freedom (abbreviated df) can be partitioned in a similar way and specifies the Chi-square Distribution which describes the associated sums of squares.

: df_{\hbox{Total}} = df_{\hbox{Error}} + df_{\hbox{Treatments}}\,\!


The F-test

See Also: F-test


The F-test is used for comparisons of the components of the total deviation. For example, in one-way, or single-factor Anova, statistical significance is tested for by comparing the F test statistic

  • = rac{MSTR}{MSE}

  • :where:

:MSTR = rac{SSTR}{I-1}, ''I'' = number of treatments
:and
:MSE = rac{SSE}{n_T-I}, ''nT'' = total number of cases

to the F-distribution with ''I-1'',''nT'' degrees of freedom. Using the F-distribution is a natural candidate because the test statistic is the quotient of two mean sums of squares which have a Chi-square Distribution .


ANOVA on ranks

As first suggested by Conover and Iman in 1981, in many cases when the data do not meet the assumptions of ANOVA, one can replace each original data value by its rank from 1 for the smallest to N for the largest, then run a standard ANOVA calculation on the rank-transformed data. "Where no equivalent nonparametric methods have yet been developed such as for the two-way design, rank transformation results in tests which are more robust to non-normality, and resistant to outliers and non-constant variance, than is ANOVA without the transformation. (Helsel & Hirsch, 2002, Page 177)."
However Seaman ''et al.'' (1994) noticed that the rank transformation of Conover and Iman (1981) is not appropriate for testing interactions among effects in a factorial design as it can cause an increase in Type I error (alpha error). Furthermore, if both main factors are significant there is little power to detect interactions


  • Helsel, D.R. and R. M. Hirsch, 2002. Statistical Methods in Water Resources: Techniques of Water Resourses Investigations, Book 4, chapter A3. U.S. Geological Survey. 522 pages. {Link without Title}


  • Seaman, J. W., Walls, S. C., Wide, S.E. and Jaeger, R.G.(1994) Caveat emptor: rank transform methods and interactions. Trends Ecol. Evol. 9, 261-263.



EXAMPLES

Group A is given vodka, Group B is given gin, and Group C is given a Placebo . All groups are then tested with a memory task. A one-way ANOVA can be used to assess the effect of the various treatments (that is, the vodka, gin, and placebo).

Group A is given vodka and tested on a memory task. The same group is allowed a rest period of five days and then the experiment is repeated with gin. The procedure is repeated using a placebo. A one-way ANOVA with repeated measures can be used to assess the effect of the vodka versus the impact of the placebo.

In an experiment testing the effects of expectations, subjects are randomly assigned to four groups:

# expect vodka-receive vodka
# expect vodka-receive placebo
# expect placebo-receive vodka
# expect placebo-receive placebo (the last group is used as the Control Group )

Each group is then tested on a memory task. The advantage of this design is that multiple variables can be tested at the same time instead of running two different experiments. Also, the experiment can determine whether one variable affects the other variable (known as Interaction Effects ). A factorial ANOVA (2×2) can be used to assess the effect of expecting vodka or the placebo and the actual reception of either.


SEE ALSO



REFERENCES

  • Ferguson, George A., Takane, Yoshio. (2005). "Statistical Analysis in Psychology and Education", Sixth Edition. Montréal, Quebec: McGraw-Hill Ryerson Limited.

  • King, Bruce M., Minium, Edward W. (2003). ''Statistical Reasoning in Psychology and Education'', Fourth Edition. Hoboken, New Jersey: John Wiley & Sons, Inc. ISBN 0-471-21187-7

  • Lindman, H. R. (1974). Analysis of variance in complex experimental designs. San Francisco: W. H. Freeman & Co.