+1 to this. Von Neumann was well ahead of his time with his automata ideas. I found in interesting how both Von Neumann and Turing turned to analyse biological systems later in their careers.
Some of you might be interested in an essay I wrote about von Neumann and Norbert Wiener that gives some of the background and context of this work.