Netflix prize competitor: With the best algorithms, metadata becomes worthless
pragmatictheory.blogspot.com
pragmatictheory.blogspot.com
Compare that with Amazon's approach when they sacrifice the predictive power for the useful explanation (customers who bought X also bought Y)
Twin Peaks: Season 1 (3-Disc Series)
Because you enjoyed: Mulholland Drive Brazil Videodrome
So right away I know that Twin Peaks is pretty freaky.
A common post-processing step for many teams (particularly BellKor/KorBell) is a KNN. The KNN's are used to provide a sort of confidence metric and if the anyone so decided, using the KNN derived network for explanation is pretty simple and not really cheating.
Edit: Yehuda might have made some breakthrough - He'll be presenting a paper at KDD "Factorization Meets the Neighborhood: a Multifaceted Collaborative Filtering Model", the paper will probably be released after the conference.
4th one down
I think most of the component algorithms in the Bell labs method provide fairly straight forward explanations - the best predictor is a nearest neighbour algorithm.
What's funny is that I keep arguing for using more meta-data with my friends who are participating in the competition. I guess I didn't realize that data mining algorithms actually capture the nuances of user tastes.
You'd think that categorizing spam based on keywords (or sender IP, etc) would be useful, but machine learning algorithms can pick up more subtle nuances of language patterns and act more effectively.
http://research.att.com/~volinsky/netflix/ProgressPrize2007B...
I'd be really curious to know which teams in particular use movie metadata? Yehuda Koren (the first commenter in the blog post) has explicitly stated many times that in his humble opinion movie titles and any non-explicit info has been useless.
BellKor, BigChaos, Gravity, and Gavin Potter (just a guy in a garage) are going to be presenting at Yehuda's KDD workshop next week. I'm sure other teams will also be represented. I'll ask them if they use movie metadata, and I'm pretty sure the answer will be no.
Any good model should be able to derive the relationships between films without knowing them beforehand, solely by using users' choices. And, likely, these relationships will be more useful than any from an external database.
Take for example two users who have each rated only Wall-E, and they both rated it a 5. Now, given Jet Li's "The One", what prediction do you give for each user? It is unlikely that two real people with this one data point on Wall-E would have the same outcome on "The One", so any additional data that can help to statistically separate the people can only help your case. For example, is the person male/female? What are the person's favorite genre's (something netflix collects), even things like did the person sign up for 6-at-a-time or 2-at-a-time might correlate slightly.
Metadata is like placing some dots on this line and saying "this spot is horror", "this spot is comedy". It becomes irrelevant, because you are already near enough to the line, and that dot does not help you any.
If I were dealing with this problem, what I would do is break free of these constraints and concentrate on taking the data as an abstract blob of random, then splitting the individual data (i.e, move data into separate 'dimensions') till I had hundreds of straight lines, and then using those for prediction. But I'm sure they must have tested this already :)
I'm rooting for the team with the two jewish guys and the black guy, afterwards they could get together and make a sitcom. Or a joke.
What about deriving statistical information from scripts, reviews, or online forums?