Nice. I was wondering if something like this is possible a few days ago. The next step would be somehow extending the discrete->continuous concept to layers.
Now we just need an iterative solver over both the structure and the "weights", and we get both architecture search and training at the same time