The story is that Knuth chose '$' to denote math mode because math typesetting at the time was prohibitively expensive.