How does one go about learning more on this topic -- being a Linux admin for a supercomputer?
If you want to play around, go to http://openhpc.community/ , fire up a few virtual machines, follow the installation instructions, and start playing around.