The speed difference is negligible. The price difference for a custom domain is not.
Half a second is definitively enough that plenty of large scale tests have shown differences in conversion rate.
That difference gets much bigger for people with more than 1 page view due to perfect caching headers.