I feel his explanation of activity vectors closely resembles/indicates Hebbian learning rules (due to the dependence on co-occurrences).
Pierre Balid from UCI has a paper coming soon about the theory behind learning rules; I think it might present some interesting ideas for this work from Hinton.