Karpathy is building the NN backend in PyTorch, for which C++ is the most popular deployment language.