That should be much higher in Wikimedia's TODO list, IMHO. There is a browser extension called WikipediaP2P for chrome, but if I'm not mistaken the author is not affiliated with the Wikimedia foundation and it's only for chrome.
I donated money once to the foundation so now I receive emails from times to times, asking for more money. It nags me when I read the claim that they need money to pay for servers and yet they don't seem to make any effort to distribute Wikipedia in a P2P way.