Effects of statistical models and items difficulties on making trait-level inferences: A simulation study

Researchers dealing with the task of estimating locations of individuals on continuous latent variables may rely on several statistical models described in the literature. However, weighting costs and benefits of using one specific model over alternative models depends on empirical information that...

Full description

Bibliographic Details
Main Authors: Nelson Hauck Filho, Wagner de Lara Machado, Bruno Figueiredo Damásio
Format: Article
Language:English
Published: SpringerOpen 2014-12-01
Series:Psicologia: Reflexão e Crítica
Subjects:
Online Access:http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-79722014000400670&lng=en&tlng=en
_version_ 1818096523253121024
author Nelson Hauck Filho
Wagner de Lara Machado
Bruno Figueiredo Damásio
author_facet Nelson Hauck Filho
Wagner de Lara Machado
Bruno Figueiredo Damásio
author_sort Nelson Hauck Filho
collection DOAJ
description Researchers dealing with the task of estimating locations of individuals on continuous latent variables may rely on several statistical models described in the literature. However, weighting costs and benefits of using one specific model over alternative models depends on empirical information that is not always clearly available. Therefore, the aim of this simulation study was to compare the performance of seven popular statistical models in providing adequate latent trait estimates in conditions of items difficulties targeted at the sample mean or at the tails of the latent trait distribution. Results suggested an overall tendency of models to provide more accurate estimates of true latent scores when using items targeted at the sample mean of the latent trait distribution. Rating Scale Model, Graded Response Model, and Weighted Least Squares Mean- and Variance-adjusted Confirmatory Factor Analysis yielded the most reliable latent trait estimates, even when applied to inadequate items for the sample distribution of the latent variable. These findings have important implications concerning some popular methodological practices in Psychology and related areas.
first_indexed 2024-12-10T23:05:58Z
format Article
id doaj.art-18893ecc97864b3fad2f7067520f1d3e
institution Directory Open Access Journal
issn 1678-7153
language English
last_indexed 2024-12-10T23:05:58Z
publishDate 2014-12-01
publisher SpringerOpen
record_format Article
series Psicologia: Reflexão e Crítica
spelling doaj.art-18893ecc97864b3fad2f7067520f1d3e2022-12-22T01:30:03ZengSpringerOpenPsicologia: Reflexão e Crítica1678-71532014-12-0127467067810.1590/1678-7153.201427407S0102-79722014000400670Effects of statistical models and items difficulties on making trait-level inferences: A simulation studyNelson Hauck FilhoWagner de Lara MachadoBruno Figueiredo DamásioResearchers dealing with the task of estimating locations of individuals on continuous latent variables may rely on several statistical models described in the literature. However, weighting costs and benefits of using one specific model over alternative models depends on empirical information that is not always clearly available. Therefore, the aim of this simulation study was to compare the performance of seven popular statistical models in providing adequate latent trait estimates in conditions of items difficulties targeted at the sample mean or at the tails of the latent trait distribution. Results suggested an overall tendency of models to provide more accurate estimates of true latent scores when using items targeted at the sample mean of the latent trait distribution. Rating Scale Model, Graded Response Model, and Weighted Least Squares Mean- and Variance-adjusted Confirmatory Factor Analysis yielded the most reliable latent trait estimates, even when applied to inadequate items for the sample distribution of the latent variable. These findings have important implications concerning some popular methodological practices in Psychology and related areas.http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-79722014000400670&lng=en&tlng=enPsicometriaTeoria de Resposta ao ItemTeoria Clássica dos Testesanálise fatorialsimulação de dadosmodelos de variáveis latentes
spellingShingle Nelson Hauck Filho
Wagner de Lara Machado
Bruno Figueiredo Damásio
Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
Psicologia: Reflexão e Crítica
Psicometria
Teoria de Resposta ao Item
Teoria Clássica dos Testes
análise fatorial
simulação de dados
modelos de variáveis latentes
title Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
title_full Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
title_fullStr Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
title_full_unstemmed Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
title_short Effects of statistical models and items difficulties on making trait-level inferences: A simulation study
title_sort effects of statistical models and items difficulties on making trait level inferences a simulation study
topic Psicometria
Teoria de Resposta ao Item
Teoria Clássica dos Testes
análise fatorial
simulação de dados
modelos de variáveis latentes
url http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-79722014000400670&lng=en&tlng=en
work_keys_str_mv AT nelsonhauckfilho effectsofstatisticalmodelsanditemsdifficultiesonmakingtraitlevelinferencesasimulationstudy
AT wagnerdelaramachado effectsofstatisticalmodelsanditemsdifficultiesonmakingtraitlevelinferencesasimulationstudy
AT brunofigueiredodamasio effectsofstatisticalmodelsanditemsdifficultiesonmakingtraitlevelinferencesasimulationstudy