Funnily enough, I am writing an article about this now.
FYI I don't think its right to say "forget means, medians, percentiles, etc." They are hugely useful.
You just have to note that they aren't everything. As you've noted, only the raw data is everything.