Inferential Item-Fit Evaluation in Cognitive Diagnosis Modeling
Resumen: Research related to the fit evaluation at the item level involving cognitive diagnosis models (CDMs) has been scarce. According to the parsimony principle, balancing goodness of fit against model complexity is necessary. General CDMs require a larger sample size to be estimated reliably, and can lead to worse attribute classification accuracy than the appropriate reduced models when the sample size is small and the item quality is poor, which is typically the case in many empirical applications. The main purpose of this study was to systematically examine the statistical properties of four inferential item-fit statistics: S-X2, the likelihood ratio (LR) test, the Wald (W) test, and the Lagrange multiplier (LM) test. To evaluate the performance of the statistics, a comprehensive set of factors, namely, sample size, correlational structure, test length, item quality, and generating model, is systematically manipulated using Monte Carlo methods. Results show that the S-X2 statistic has unacceptable power. Type I error and power comparisons favor LR and W tests over the LM test. However, all the statistics are highly affected by the item quality. With a few exceptions, their performance is only acceptable when the item quality is high. In some cases, this effect can be ameliorated by an increase in sample size and test length. This implies that using the above statistics to assess item fit in practical settings when the item quality is low remains a challenge.
Idioma: Inglés
DOI: 10.1177/0146621617707510
Año: 2017
Publicado en: APPLIED PSYCHOLOGICAL MEASUREMENT 41, 8 (2017), [18 pp.]
ISSN: 0146-6216

Factor impacto JCR: 0.923 (2017)
Categ. JCR: SOCIAL SCIENCES, MATHEMATICAL METHODS rank: 34 / 49 = 0.694 (2017) - Q3 - T3
Categ. JCR: PSYCHOLOGY, MATHEMATICAL rank: 11 / 13 = 0.846 (2017) - Q4 - T3

Factor impacto SCIMAGO: 1.17 - Social Sciences (miscellaneous) (Q1) - Psychology (miscellaneous) (Q1)

Financiación: info:eu-repo/grantAgreement/ES/MINECO/PSI2013-44300-P
Tipo y forma: Artículo (Versión definitiva)
Área (Departamento): Área Metod.Ciencias Comportam. (Dpto. Psicología y Sociología)

Creative Commons Debe reconocer adecuadamente la autoría, proporcionar un enlace a la licencia e indicar si se han realizado cambios. Puede hacerlo de cualquier manera razonable, pero no de una manera que sugiera que tiene el apoyo del licenciador o lo recibe por el uso que hace. No puede utilizar el material para una finalidad comercial. Si remezcla, transforma o crea a partir del material, no puede difundir el material modificado.


Exportado de SIDERAL (2021-05-07-08:09:49)


Visitas y descargas

Este artículo se encuentra en las siguientes colecciones:
Artículos



 Registro creado el 2017-10-02, última modificación el 2021-05-07


Versión publicada:
 PDF
Valore este documento:

Rate this document:
1
2
3
 
(Sin ninguna reseña)