>1-2 trillion tokens of training for gptx class models
>It would take 20 years for a human to read that many tokens at 8 hrs of reading per day
Normal reading is ~200 words per minute.
That's 12,000 words per hour.
That's 288,000 words per day (reading for 24 hours straight).
That's 105,120,000 words per year.
That's 2,102,400,000 words per 20 years.
A trillion is 1,000,000,000,000.