40hp is about what you use on the freeway, or at least it used to be before the average car came to weight 2 tons. You don't need a whole lot more than that. Hell, the MG Midget was offered with a 30HP engine once, IIRC.
I'm quite sure in a decade or two we're going to have people saying things like, "It's true you CAN make a car with only 200hp, but it's generally accepted you need at least 800hp for any car"...