Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm

Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately com...

Full description

Bibliographic Details
Main Authors: Kenes Beketayev, Mark A. Runco
Format: Article
Language:English
Published: PsychOpen GOLD/ Leibniz Institute for Psychology 2016-05-01
Series:Europe's Journal of Psychology
Subjects:
Online Access:http://ejop.psychopen.eu/article/view/1127
_version_ 1797967149745045504
author Kenes Beketayev
Mark A. Runco
author_facet Kenes Beketayev
Mark A. Runco
author_sort Kenes Beketayev
collection DOAJ
description Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.
first_indexed 2024-04-11T02:26:39Z
format Article
id doaj.art-25f5aa71bfe24ac8ba743eab0a79769f
institution Directory Open Access Journal
issn 1841-0413
language English
last_indexed 2024-04-11T02:26:39Z
publishDate 2016-05-01
publisher PsychOpen GOLD/ Leibniz Institute for Psychology
record_format Article
series Europe's Journal of Psychology
spelling doaj.art-25f5aa71bfe24ac8ba743eab0a79769f2023-01-02T22:35:11ZengPsychOpen GOLD/ Leibniz Institute for PsychologyEurope's Journal of Psychology1841-04132016-05-0112221022010.5964/ejop.v12i2.1127ejop.v12i2.1127Scoring Divergent Thinking Tests by Computer With a Semantics-Based AlgorithmKenes Beketayev0Mark A. Runco1Nazarbayev University, Astana, KazakhstanAmerican Institute of Behavioral Research & Technology, Vista, CA, USADivergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r = .74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.http://ejop.psychopen.eu/article/view/1127Divergent thinkingassessing creativitycreativity testflexibilityideasoriginalitysemantic networksassociative networkscomputer creativityideational fluency
spellingShingle Kenes Beketayev
Mark A. Runco
Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
Europe's Journal of Psychology
Divergent thinking
assessing creativity
creativity test
flexibility
ideas
originality
semantic networks
associative networks
computer creativity
ideational fluency
title Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
title_full Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
title_fullStr Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
title_full_unstemmed Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
title_short Scoring Divergent Thinking Tests by Computer With a Semantics-Based Algorithm
title_sort scoring divergent thinking tests by computer with a semantics based algorithm
topic Divergent thinking
assessing creativity
creativity test
flexibility
ideas
originality
semantic networks
associative networks
computer creativity
ideational fluency
url http://ejop.psychopen.eu/article/view/1127
work_keys_str_mv AT kenesbeketayev scoringdivergentthinkingtestsbycomputerwithasemanticsbasedalgorithm
AT markarunco scoringdivergentthinkingtestsbycomputerwithasemanticsbasedalgorithm