Prediction as a basis for skilled reading: insights from modern language models
Reading is not an inborn human capability, and yet, English-speaking adults read with impressive speed.This study considered how predictions of upcoming words impact on this skilled behaviour.We used a powerful language model (GPT-2) to derive predictions of upcoming words in text passages.These predictions were highly accurate and showed a tight r