More on the language-as-fixed-effect fallacy: Monte Carlo estimates of error rates for F1,F2,F′, and min F′

https://doi.org/10.1016/0022-5371(76)90014-1Get rights and content

Abstract

The properties of four different tests of the treatment effect in experiments using linguistic materials are examined using Monte Carlo procedures for estimating Type I error rates. It is shown that: (a) in extreme cases, the Type I error rates for F1 and F2 can exceed the desired rate by a factor of at least 10; (b) minF′ tends to be a very close estimate of F′; (c) both minF′ and F′ are very conservative tests when between item variance or subject-by-treatment variance is low; (d) requiring both F1 and F2 to be significant before H0 is rejected does not prevent the nominal Type I error rate from being exceeded; (e) most of these problems can be minimized by using multistage decision rules which select the most appropriate test on the basis of preliminary tests of item variance and subject-by-treatment variance.

References (7)

There are more references available in the full text version of this article.

Cited by (0)

View full text