Interesting idea, sounds similar in some ways to what the folks at Rewatch.tv are doing. Either way, nice work!