DETECT is a nonparametric ''full'' dimensionality assessment procedure that clusters dichotomously scored items into dimensions and provides a DETECT index of magnitude of multidimensionality. Four factors (test length, sample size, item response theory [IRT] model, and DETECT index) were manipulated in a Monte Carlo study of bias, standard error, and root mean square error (RMSE) under the condition of unidimensionality. Bias, standard error, and RMSE of both DETECT indices increased as test length and sample size decreased. Results suggest that the cross-validated index should always be preferred over the exploratory index, even for 100 examinees and five items. Bias, standard error, and RMSE may be problematic for both indices under certain conditions of small samples or short tests. A Monte Carlo procedure could be built into DETECT to estimate and adjust for potential bias.
- Monte Carlo
ASJC Scopus subject areas
- Psychology (miscellaneous)
- Social Sciences (miscellaneous)