Look at the list of contributors at the end of the release notes of the upcoming 0.9.0 release of the bitcoin reference client[1]. Or look at the activity of other projects, e.g. the bitcoinj google group[2]. There's a lot more than 5 people working on bitcoin.