von Neumann was angry at a student for writing a program that would produce binary code rather than assembling it by hand
Imagine if, nowadays, a grad student took a node in a scientific cluster to run Dreamweaver in a Windows VM instead of writing HTML by hand. (Sorry, it's the closest analogy I could come up with)
He was probably frustrated that people couldn't see the machine code fully formed in their mind's eye :)