> Perhaps a better approach would be building an open source www index or even a full current cache - as an enabler for people to build their own search engines?

That's a excellent idea! In the spirit of open-data, and people can do with it what they want.