They could be partitioned by department, so (for example) searching through math research wouldn't have to search the biology department's archives as well.
This would allow for defining the context of the search, so that would be a benefit, wouldn't it?
Although I am focusing on personal computing, distributed fits too?
Naturally.
You might be interested in the filesystem research associated with plan9. :)