He's building something like a Huffman tree, but with NNs as a nodes.