Another really amazing spot on Orkney is Maeshowe, it's a neolithic cairn (from ~3000 BC) but Vikings in the 12th century looted and desecrated it with a bunch of runic graffiti [1]. It's really cool to experience two facets of history in the same location but millennia apart.
[1] http://www.orkneyjar.com/history/maeshowe/maeshrunes.htm