I think our culture (well, American, capitalist society is all I can really comment on) has a very strong implied link between income and worth/value. We have magazines that routinely have lists of the highest paid / richest people. People give incredible leeway to highly paid execs, as if due to the number of zeros on their paycheck they clearly have to be right/smart. There are sayings like "that decision was made above my paygrade", that seem to show there is a pretty tight linkage, mentally, between income and value as a human.
I don't agree with this mindset at all, mainly because I don't believe most organizations are truly meritocratic in any objective sense. It's a good PR story, but people, evolutionarily, tend to "look out for their own", for whatever traits puts someone in that in-group. I have seen many examples of people espousing meritocracy but clearly considering those with the most "merit" as being one in the same with "those they already seem to like", coincidentally enough. That isn't necessarily a bad thing, with balance. I think a 100% meritocratic org would be lacking in basic humanity and kind of a terrible place to work. All humans make mistakes, have struggles, have setbacks, etc...
Even with that being said, and me not believing in the income -> value/worth link in general, I would not be comfortable talking about my salary with most friends/family. I live a comfortable life with little stress about money, but bragging about that (which even trying to downplay it sounds like a humblebrag) seems wrong somehow.