This is a common attitude, and an understandable one, but it’s very much at odds with the research. There are more studies and discussions, but this is one of them highlighting how this is a nothing burger

https://www.levyinstitute.org/pubs/rpr_2_6.pdf