Agreed. You need the perspective if you're running a software startup.
I guess the distinction I'm trying to put is that there's a distinction between "non-technical" and "non-programmer". I can't program, but I know all the technically pertinent details of my product that any VC or customer is going to care about. To some extent, I think it frankly works better that way than if I was doing the coding, because I know what's really important in the product, and won't miss the forest for the trees.
You don't need to know how to code to be able to handle the technical responsibilities of actually running a tech startup. You just need to know the technology itself.