Prediction as a basis for skilled reading: insights from modern language models
Reading is not an inborn human capability, and yet, English-speaking adults read with impressive speed. This study considered how predictions of upcoming words impact on this skilled behaviour. We used a powerful language model (GPT-2) to derive predictions of upcoming words in text passages. These...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
The Royal Society
2022-06-01
|
Series: | Royal Society Open Science |
Subjects: | |
Online Access: | https://royalsocietypublishing.org/doi/10.1098/rsos.211837 |