Models only have so much sort of capacity to ingest a stream of tokens