He was doing this kind of stuff while he was at Tesla too - https://github.com/karpathy/cryptos