Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming

Studies of language production often make use of picture naming tasks to investigate the cognitive processes involved in speaking, and many of these studies report a wide range of individual variability in how long speakers need to prepare the name of a picture. It has been assumed that this variabi...

Full description

Bibliographic Details
Main Authors: Pamela Fuhrmeister, Shereen Elbuy, Audrey Bürki
Format: Article
Language:English
Published: Ubiquity Press 2024-01-01
Series:Journal of Cognition
Subjects:
Online Access:https://account.journalofcognition.org/index.php/up-j-jc/article/view/337
_version_ 1797315787789172736
author Pamela Fuhrmeister
Shereen Elbuy
Audrey Bürki
author_facet Pamela Fuhrmeister
Shereen Elbuy
Audrey Bürki
author_sort Pamela Fuhrmeister
collection DOAJ
description Studies of language production often make use of picture naming tasks to investigate the cognitive processes involved in speaking, and many of these studies report a wide range of individual variability in how long speakers need to prepare the name of a picture. It has been assumed that this variability can be linked to inter-individual differences in cognitive skills or abilities (e.g., attention or working memory); therefore, several studies have tried to explain variability in language production tasks by correlating production measures with scores on cognitive tests. This approach, however, relies on the assumption that participants are reliable over time in their picture naming speed (i.e., that faster speakers are consistently fast). The current study explicitly tested this assumption by asking participants to complete a simple picture naming task twice with one to two weeks in between sessions. In one experiment, we show that picture naming speed has excellent within-task reliability and good test-retest reliability, at least when participants perform the same task in both sessions. In a second experiment with slight task variations across sessions (a speeded and non-speeded picture naming task), we replicated the high split-half reliability and found moderate consistency over tasks. These findings are as predicted under the assumption that the speed of initiating responses for speech production is an intrinsic property or capacity of an individual. We additionally discuss the consequences of these results for the statistical power of correlational designs.
first_indexed 2024-03-08T03:08:54Z
format Article
id doaj.art-6d763b5d3f734cf385d0fa82776a1ded
institution Directory Open Access Journal
issn 2514-4820
language English
last_indexed 2024-03-08T03:08:54Z
publishDate 2024-01-01
publisher Ubiquity Press
record_format Article
series Journal of Cognition
spelling doaj.art-6d763b5d3f734cf385d0fa82776a1ded2024-02-13T07:37:29ZengUbiquity PressJournal of Cognition2514-48202024-01-0171121210.5334/joc.337336Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture NamingPamela Fuhrmeister0https://orcid.org/0000-0003-0507-1185Shereen Elbuy1https://orcid.org/0000-0002-3547-0841Audrey Bürki2https://orcid.org/0000-0002-1390-2826Universität PotsdamUniversität PotsdamUniversität PotsdamStudies of language production often make use of picture naming tasks to investigate the cognitive processes involved in speaking, and many of these studies report a wide range of individual variability in how long speakers need to prepare the name of a picture. It has been assumed that this variability can be linked to inter-individual differences in cognitive skills or abilities (e.g., attention or working memory); therefore, several studies have tried to explain variability in language production tasks by correlating production measures with scores on cognitive tests. This approach, however, relies on the assumption that participants are reliable over time in their picture naming speed (i.e., that faster speakers are consistently fast). The current study explicitly tested this assumption by asking participants to complete a simple picture naming task twice with one to two weeks in between sessions. In one experiment, we show that picture naming speed has excellent within-task reliability and good test-retest reliability, at least when participants perform the same task in both sessions. In a second experiment with slight task variations across sessions (a speeded and non-speeded picture naming task), we replicated the high split-half reliability and found moderate consistency over tasks. These findings are as predicted under the assumption that the speed of initiating responses for speech production is an intrinsic property or capacity of an individual. We additionally discuss the consequences of these results for the statistical power of correlational designs.https://account.journalofcognition.org/index.php/up-j-jc/article/view/337language productionpicture namingreliabilityindividual differences
spellingShingle Pamela Fuhrmeister
Shereen Elbuy
Audrey Bürki
Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
Journal of Cognition
language production
picture naming
reliability
individual differences
title Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
title_full Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
title_fullStr Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
title_full_unstemmed Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
title_short Are Faster Participants Always Faster? Assessing Reliability of Participants’ Mean Response Speed in Picture Naming
title_sort are faster participants always faster assessing reliability of participants mean response speed in picture naming
topic language production
picture naming
reliability
individual differences
url https://account.journalofcognition.org/index.php/up-j-jc/article/view/337
work_keys_str_mv AT pamelafuhrmeister arefasterparticipantsalwaysfasterassessingreliabilityofparticipantsmeanresponsespeedinpicturenaming
AT shereenelbuy arefasterparticipantsalwaysfasterassessingreliabilityofparticipantsmeanresponsespeedinpicturenaming
AT audreyburki arefasterparticipantsalwaysfasterassessingreliabilityofparticipantsmeanresponsespeedinpicturenaming