Special relativity is actually quite accessible and really interesting - find a good book or set of lectures on iTunes U or something.
(General relativity, the generalised version including acceleration and gravity, is what makes people think relativity is hard).