It took $50,000 plus tremendous distribution from his widely read "Joel on Software" articles. Don't underestimate that second part.
i.e. the quote suggests rather than $50,000 is all you need to start something like Fog Creek the lesson might be even starting from his position which was likely to be more privaledged than yours or mine he still kept costs as low as he could until he turned a profit.