I went to a lot of work to adopt a “neutral” American accent, with some success. Perfectly adequate for casual conversations.
Why? You run across many people with accents every day, right? Well, it’s a problem; people definitely treat you differently.
This issue isn’t specific to the USA btw, it’s just I’ve been working in the USA for a long time.