I only have the problem with AirPod Pros. The fit test never passes in my right ear and they feel very uncomfortable after about 15 minutes. They also fall out when I speak and walk with them on.
But the worst is that sometimes my own voice resonates back in my ear, its hard to describe but very unpleasant and disturbing in a conversation.