This was typically done by a network of symlinks. As best I can remember, you'd have /opt/local exported from the server, with all the open source goodies. It was arranged something like
/opt/local/emacs-19.1.7/bin/emacs
/opt/local/emacs-19.1.8/bin/emacs
/opt/local/emacs -> /opt/local/emacs-19.1.7
<....>
All the clients would have a local /usr/local with another symlink, /usr/local/bin/emacs pointing at /opt/local/emacs/bin/emacs
When you upgraded from 19.1.7 to 19.1.8, you'd just move the symlink on the server. You'd then wait a week or two, and garbage collect the old version (after rsh'ing around to the clients to make sure none had the old version open, if your users were lucky).
The local network of symlinks into /opt/local was maintained by something like cfengine, which ran at install and nightly to update configs (eg, for newly supported stuff, or new binaries in new versions of existing software).
If you screwed this up, and replaced a binary out from under a user, they were rather unhappy..