Prediction as a basis for skilled reading: insights from modern language models

Reading is not an inborn human capability, and yet, English-speaking adults read with impressive speed. This study considered how predictions of upcoming words impact on this skilled behaviour. We used a powerful language model (GPT-2) to derive predictions of upcoming words in text passages. These...

Full description

Bibliographic Details
Main Authors: Benedetta Cevoli, Chris Watkins, Kathleen Rastle
Format: Article
Language:English
Published: The Royal Society 2022-06-01
Series:Royal Society Open Science
Subjects:
Online Access:https://royalsocietypublishing.org/doi/10.1098/rsos.211837