The problem is twofold: the test is notoriously flakey, and the cancer is frequently not an issue. You're also absolutely right that many more men die with prostate cancer than from it — but that's most commonly _without_ treatment or even knowledge of it!
The trouble is exactly that it _can_ manifest early and it can become aggressive and that's when it's crucial to catch and treat.