I was an aggressive driver when I was younger. Always 5-10mph over the limit, pass at every opportunity, threshold braking at every stop, flooring the gas pulling away from each, generally ignoring warnings to slow down on curves, etc. I only ever got in one very minor accident (I hit a wooden sign that was so rotted it broke at the base and didn't even leave a mark on my bumper) but did have a few close calls (coming up to an exit with traffic too fast and fishtailing into a spinout on the interstate, thankfully not hitting anyone.)
Then I decided to gather data. My daily commute was about 15 minutes, maybe 10 miles of mostly 2-lane highway, some turns I had a stop sign, some didn't, so a bit a variation and reasonable opportunities for my aggressive driving. I did an experiment for a few days where I would drive either as aggressively as I normally did, even kicking it up a notch for science, or just chilling out and taking it easy; and timing how long the drive took me with either style.
After a few trials, I found that the super-aggressive driving did save time over the relaxed style; but it was less than 30 seconds, an amount that could easily be lost or gained by chance at the one stoplight on my drive. And as a bonus, with the relaxed style, when I arrived at my destination, I was actually more relaxed, with my pulse around 70 instead of 90.
I've stuck to a more relaxed style ever since. There have been more than a few times where someone who was in a hurry passed me over a double yellow line and flips my the bird for having the nerve to drive the speed limit and zooms off, and then a mile or two down the road I pull up right behind the exact same driver at a stoplight or other non-passable thing, and I feel that I've made the right choice.