That being said, Sir Clive Sinclair made a pretty remarkable little computer (the ZX-81) but minimizing the parts count to the extreme. And there's a colloquial term for the process of minimizing your component count.
One of my favorite authors in Electronic Design was Bob Pease (now deceased). In a 1992 article [0] he recounts the process used by Earl "Madman" Muntz who was an early television pioneer. I could ruin the story but I'm going to insist you read the original instead. Enjoy!
[0] http://www.electronicdesign.com/boards/whats-all-muntzing-st...
EDIT: I also should have noted that this practice has led to me trying to create the simplest possible software algorithm that solves my problem. A good day is when the LOC count goes down (and not because I've packed more into a single line).