If you do them one at a time it is 5 seconds. And the majority of that 5 seconds is likely IO wait times. You should invest in an SSD, and should also look at running multiple conversions concurrently so that the IO on the SSD is near capped.

Did you see this also: http://www.graphicsmagick.org/index.html

They claim to be faster than ImageMagic.