Evaluating the Quality of Classification in Mixture Model Simulations

Educ Psychol Meas. 2023 Apr;83(2):351-374. doi: 10.1177/00131644221093619. Epub 2022 Apr 29.

Abstract

The purpose of this study was to evaluate the degree of classification quality in the basic latent class model when covariates are either included or are not included in the model. To accomplish this task, Monte Carlo simulations were conducted in which the results of models with and without a covariate were compared. Based on these simulations, it was determined that models without a covariate better predicted the number of classes. These findings in general supported the use of the popular three-step approach; with its quality of classification determined to be more than 70% under various conditions of covariate effect, sample size, and quality of indicators. In light of these findings, the practical utility of evaluating classification quality is discussed relative to issues that applied researchers need to carefully consider when applying latent class models.

Keywords: Monte Carlo simulation; effects of covariates; latent class analysis; quality of classification; sample size.