I would argue that it was more likely caused by widespread minor lead poisoning. If everyone is more forgetful and learns slower, then that isn't something that will be written in history books - the people themselves will just consider that 'normal'.
Yet an empire of forgetful and slow-learning people won't be efficient. Every task will take more man-hours to achieve. Productivity will be lower. Accidents will happen more frequently. Crime will be higher. Strategic mistakes will be made by rulers, but will also be made by local rulers and individual families. "Should we plant corn or wheat this year?" - someone with intellect may read a book to discover the best crop or do a small scale trial, while someone with lead poisoning may just do the same as he did last year because it takes less mental effort.