Do you have Perian installed? Does http://www.youtube.com/html5 report that Safari supports WebM? If so, then what you’re seeing is YouTube preferring WebM over h.264, even though h.264 decoding is hardware accelerated rather than the software decoding that Perian’s WebM support provides. You can try temporarily disabling Perian, relaunching Safari, and then watching a video again to see whether the performance is more in line with your expectations.