Some people (including myself) just really really struggle with names. I've found that people who don't struggle with names don't quite understand how it just doesn't click for other people.
I have to write down the name of everyone I meet in a day and review it before I go to bed in order to even have a chance.
Plus, I have a paralyzing fear of using the wrong name so I don't practice that often unless I'm completely confident.