It is not a YouTube issue, it is a Chrome issue. I have built a fairly sophisticated html5 player, and Chrome's buffering/caching strategy is just irritating relative to Flash/Safari/IE9. Also Chrome is just not as good a seeking as Safari/IE9.
My player is designed for language learning, so the users are constantly seeking: http://bit.ly/z9J8Cc