AI vs humans in the AUT: Simulations to LLMs
This paper reviews studies of proposed creative machines applied to a prototypical creative task, i.e., the Alternative Uses Task (AUT). Although one system (OROC) did simulate some aspects of human strategies for the AUT, most recent attempts have not been simulation-oriented, but rather have used...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-04-01
|
| Series: | Journal of Creativity |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2713374523000304 |
| _version_ | 1797324335323545600 |
|---|---|
| author | Ken Gilhooly |
| author_facet | Ken Gilhooly |
| author_sort | Ken Gilhooly |
| collection | DOAJ |
| description | This paper reviews studies of proposed creative machines applied to a prototypical creative task, i.e., the Alternative Uses Task (AUT). Although one system (OROC) did simulate some aspects of human strategies for the AUT, most recent attempts have not been simulation-oriented, but rather have used Large Language Model (LLM) systems such as GPT-3 which embody extremely large connectionist networks trained on huge volumes of textual data. Studies reviewed here indicate that LLM based systems are performing on the AUT at near or somewhat above human levels in terms of scores on originality and usefulness. Moreover, similar patterns are found in the data of humans and LLM models in the AUT, such as output order effects and a negative association between originality and value or utility. However, it is concluded that GPT-3 and similar systems, despite generating novel and useful responses, do not display creativity as they lack agency and are purely algorithmic. LLM studies so far in this area have largely been exploratory and future studies should guard against possible training data contamination. |
| first_indexed | 2024-03-08T05:54:39Z |
| format | Article |
| id | doaj.art-630dc85fda2549f1babcae1bbb54da75 |
| institution | Directory Open Access Journal |
| issn | 2713-3745 |
| language | English |
| last_indexed | 2024-03-08T05:54:39Z |
| publishDate | 2024-04-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Journal of Creativity |
| spelling | doaj.art-630dc85fda2549f1babcae1bbb54da752024-02-05T04:32:26ZengElsevierJournal of Creativity2713-37452024-04-01341100071AI vs humans in the AUT: Simulations to LLMsKen Gilhooly0University of Hertfordshire, Hatfield, EnglandThis paper reviews studies of proposed creative machines applied to a prototypical creative task, i.e., the Alternative Uses Task (AUT). Although one system (OROC) did simulate some aspects of human strategies for the AUT, most recent attempts have not been simulation-oriented, but rather have used Large Language Model (LLM) systems such as GPT-3 which embody extremely large connectionist networks trained on huge volumes of textual data. Studies reviewed here indicate that LLM based systems are performing on the AUT at near or somewhat above human levels in terms of scores on originality and usefulness. Moreover, similar patterns are found in the data of humans and LLM models in the AUT, such as output order effects and a negative association between originality and value or utility. However, it is concluded that GPT-3 and similar systems, despite generating novel and useful responses, do not display creativity as they lack agency and are purely algorithmic. LLM studies so far in this area have largely been exploratory and future studies should guard against possible training data contamination.http://www.sciencedirect.com/science/article/pii/S2713374523000304AIAlternative usesDivergent thinking |
| spellingShingle | Ken Gilhooly AI vs humans in the AUT: Simulations to LLMs Journal of Creativity AI Alternative uses Divergent thinking |
| title | AI vs humans in the AUT: Simulations to LLMs |
| title_full | AI vs humans in the AUT: Simulations to LLMs |
| title_fullStr | AI vs humans in the AUT: Simulations to LLMs |
| title_full_unstemmed | AI vs humans in the AUT: Simulations to LLMs |
| title_short | AI vs humans in the AUT: Simulations to LLMs |
| title_sort | ai vs humans in the aut simulations to llms |
| topic | AI Alternative uses Divergent thinking |
| url | http://www.sciencedirect.com/science/article/pii/S2713374523000304 |
| work_keys_str_mv | AT kengilhooly aivshumansintheautsimulationstollms |