Abstract
In a multilevel framework several researches have investigated the behavior of estimates in finite samples, particularly for continuous dependent variables. Some findings show poor precise estimates for the variance components. On the other hand, discrete response multilevel models have been investigated less widely. In this paper we analyze the influence of different factors on the accuracy of estimates and standard errors of estimates in a binary response 2-level model, through a Monte Carlo simulation study. We investigate the hypothesis of: (a) small sample sizes; (b) different intraclass correlation coefficients; (c) different numbers of quadrature points in the estimation procedure. Standard errors of estimates are studied through a noncoverage indicator. In all instances we have considered, the point estimates are unbiased (even with very small sample sizes), while the variance components are underestimated. The accuracy of the standard errors of variance estimates needs a very large number of groups.
References
(2001). Variance component testing in multilevel models. Journal of Educational and Behavioral Statistics, 26, 133–152.
(1993). Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88, 9–25.
(1995). Bias correction in generalised linear mixed models with a single component of dispersion. Biometrika, 82, 81–91.
(2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1, 473–514.
(2005). Performance of likelihood-based estimation methods for multilevel binary regression models. Journal of Statistical Computation and Simulation, 75, 1003–1017.
(1991). Nonlinear multilevel models, with an application to discrete response data. Biometrika, 78, 45–51.
(2003). Multilevel statistical models (3rd ed.). London, UK: Edward Arnold.
(1996). Improved approximations for multilevel models with binary responses. Journal of the Royal Statistical Society, A 159, 505–513.
(2010). Multilevel analysis: Techniques and applications (2nd ed.). New York, NY: Routledge Academic.
(1965). Survey sampling. New York, NY: Wiley.
(1996). Are multilevel techniques necessary? An overview, including simulation studies [on-line]. Los Angeles, CA: California State University.
(1998). Introducing multilevel modeling. London, UK: Sage.
(1994). A note on Gauss-Hermite quadrature. Biometrika, 81, 624–629.
(2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58, 127–137.
(2005). Sufficient sample sizes for multilevel modeling. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 1, 86–92.
(2007). A simulation study of sample size for multilevel logistic regression models. BMC Medical Research Methodology, 7, 34.
(1995). Sample size requirements for 2-level designs in educational research. Multilevel Modelling Newsletter, 7, 11–15.
(1995). Approximations to the log-likelihood function in the nonlinear mixed-effects model. Journal of Computational and Graphical Statistics, 4, 12–35.
(1995). An assessment of estimations procedures for multilevel models with binary responses. Journal of the Royal Statistical Society, A 158, 73–89.
(2001). Improved estimation procedures for multilevel models with binary response: A case-study. Journal of the Royal Statistical Society, A 164, 339–355.
. (1999). SAS/Stat user’s guide. Version 8, Volumes 1, 2 and 3.
(1999). Multilevel analysis. An introduction to basic and advanced multilevel modeling. London, UK: Sage.
