Yeah got it, civ 4 is not a combat simulator, it's an economy and diplomacy simulator.
Combat plays a strong role in all Civ games. Not least of which because of barbarians forcing you to defend yourself (which are impossible to diplomacy with).
You're going to be spending a non-negligible amount of time in any Civ game (from 2 through 6) building up a standing army, even if only for defensive purposes. Ideally, that aspect of the game should be fun.