Automated Analysis of Digitized Letter Fluency Data

The letter-guided naming fluency task is a measure of an individual’s executive function and working memory. This study employed a novel, automated, quantifiable, and reproducible method to investigate how language characteristics of words produced during a fluency task are related to fluency perfor...

Full description

Bibliographic Details
Main Authors: Sunghye Cho, Naomi Nevler, Natalia Parjane, Christopher Cieri, Mark Liberman, Murray Grossman, Katheryn A. Q. Cousins
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-07-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpsyg.2021.654214/full
_version_ 1819146443095539712
author Sunghye Cho
Naomi Nevler
Natalia Parjane
Christopher Cieri
Mark Liberman
Murray Grossman
Katheryn A. Q. Cousins
author_facet Sunghye Cho
Naomi Nevler
Natalia Parjane
Christopher Cieri
Mark Liberman
Murray Grossman
Katheryn A. Q. Cousins
author_sort Sunghye Cho
collection DOAJ
description The letter-guided naming fluency task is a measure of an individual’s executive function and working memory. This study employed a novel, automated, quantifiable, and reproducible method to investigate how language characteristics of words produced during a fluency task are related to fluency performance, inter-word response time (RT), and over task duration using digitized F-letter-guided fluency recordings produced by 76 young healthy participants. Our automated algorithm counted the number of correct responses from the transcripts of the F-letter fluency data, and individual words were rated for concreteness, ambiguity, frequency, familiarity, and age of acquisition (AoA). Using a forced aligner, the transcripts were automatically aligned with the corresponding audio recordings. We measured inter-word RT, word duration, and word start time from the forced alignments. Articulation rate was also computed. Phonetic and semantic distances between two consecutive F-letter words were measured. We found that total F-letter score was significantly correlated with the mean values of word frequency, familiarity, AoA, word duration, phonetic similarity, and articulation rate; total score was also correlated with an individual’s standard deviation of AoA, familiarity, and phonetic similarity. RT was negatively correlated with frequency and ambiguity of F-letter words and was positively correlated with AoA, number of phonemes, and phonetic and semantic distances. Lastly, the frequency, ambiguity, AoA, number of phonemes, and semantic distance of words produced significantly changed over time during the task. The method employed in this paper demonstrates the successful implementation of our automated language processing pipelines in a standardized neuropsychological task. This novel approach captures subtle and rich language characteristics during test performance that enhance informativeness and cannot be extracted manually without massive effort. This work will serve as the reference for letter-guided category fluency production similarly acquired in neurodegenerative patients.
first_indexed 2024-12-22T13:14:00Z
format Article
id doaj.art-0dfabda7c3e34a2692991abd34bdb52d
institution Directory Open Access Journal
issn 1664-1078
language English
last_indexed 2024-12-22T13:14:00Z
publishDate 2021-07-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Psychology
spelling doaj.art-0dfabda7c3e34a2692991abd34bdb52d2022-12-21T18:24:40ZengFrontiers Media S.A.Frontiers in Psychology1664-10782021-07-011210.3389/fpsyg.2021.654214654214Automated Analysis of Digitized Letter Fluency DataSunghye Cho0Naomi Nevler1Natalia Parjane2Christopher Cieri3Mark Liberman4Murray Grossman5Katheryn A. Q. Cousins6Linguistic Data Consortium, University of Pennsylvania, Philadelphia, PA, United StatesPenn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, United StatesPenn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, United StatesLinguistic Data Consortium, University of Pennsylvania, Philadelphia, PA, United StatesLinguistic Data Consortium, University of Pennsylvania, Philadelphia, PA, United StatesPenn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, United StatesPenn Frontotemporal Degeneration Center, University of Pennsylvania, Philadelphia, PA, United StatesThe letter-guided naming fluency task is a measure of an individual’s executive function and working memory. This study employed a novel, automated, quantifiable, and reproducible method to investigate how language characteristics of words produced during a fluency task are related to fluency performance, inter-word response time (RT), and over task duration using digitized F-letter-guided fluency recordings produced by 76 young healthy participants. Our automated algorithm counted the number of correct responses from the transcripts of the F-letter fluency data, and individual words were rated for concreteness, ambiguity, frequency, familiarity, and age of acquisition (AoA). Using a forced aligner, the transcripts were automatically aligned with the corresponding audio recordings. We measured inter-word RT, word duration, and word start time from the forced alignments. Articulation rate was also computed. Phonetic and semantic distances between two consecutive F-letter words were measured. We found that total F-letter score was significantly correlated with the mean values of word frequency, familiarity, AoA, word duration, phonetic similarity, and articulation rate; total score was also correlated with an individual’s standard deviation of AoA, familiarity, and phonetic similarity. RT was negatively correlated with frequency and ambiguity of F-letter words and was positively correlated with AoA, number of phonemes, and phonetic and semantic distances. Lastly, the frequency, ambiguity, AoA, number of phonemes, and semantic distance of words produced significantly changed over time during the task. The method employed in this paper demonstrates the successful implementation of our automated language processing pipelines in a standardized neuropsychological task. This novel approach captures subtle and rich language characteristics during test performance that enhance informativeness and cannot be extracted manually without massive effort. This work will serve as the reference for letter-guided category fluency production similarly acquired in neurodegenerative patients.https://www.frontiersin.org/articles/10.3389/fpsyg.2021.654214/fullneuropsychological testautomated speech analysisverbal retrievalexecutive functionverbal fluencyphonetic similarity
spellingShingle Sunghye Cho
Naomi Nevler
Natalia Parjane
Christopher Cieri
Mark Liberman
Murray Grossman
Katheryn A. Q. Cousins
Automated Analysis of Digitized Letter Fluency Data
Frontiers in Psychology
neuropsychological test
automated speech analysis
verbal retrieval
executive function
verbal fluency
phonetic similarity
title Automated Analysis of Digitized Letter Fluency Data
title_full Automated Analysis of Digitized Letter Fluency Data
title_fullStr Automated Analysis of Digitized Letter Fluency Data
title_full_unstemmed Automated Analysis of Digitized Letter Fluency Data
title_short Automated Analysis of Digitized Letter Fluency Data
title_sort automated analysis of digitized letter fluency data
topic neuropsychological test
automated speech analysis
verbal retrieval
executive function
verbal fluency
phonetic similarity
url https://www.frontiersin.org/articles/10.3389/fpsyg.2021.654214/full
work_keys_str_mv AT sunghyecho automatedanalysisofdigitizedletterfluencydata
AT naominevler automatedanalysisofdigitizedletterfluencydata
AT nataliaparjane automatedanalysisofdigitizedletterfluencydata
AT christophercieri automatedanalysisofdigitizedletterfluencydata
AT markliberman automatedanalysisofdigitizedletterfluencydata
AT murraygrossman automatedanalysisofdigitizedletterfluencydata
AT katherynaqcousins automatedanalysisofdigitizedletterfluencydata