It goes much farther back than that...
Akademeia was literally the name of the grove where Plato started his Akademeia in 350 BC. Plato took these ideas of an ascetic brotherhood of ideas/mathematics from Pythagoras. No one knows exactly how Pythagoras came up with his ideas, but he did travel widely in his youth, at least as far as Egypt, seeking knowledge.