Plenty of people process language differently.
That's why there are dictionaries of metaphor to help people understand that "raining cats and dogs" just means "raining heavily".
http://www.amazon.co.uk/Its-Raining-Cats-Dogs-Expressions/dp...
http://www.amazon.co.uk/Asperger-Dictionary-Everyday-Express...