That is how it is working in real life. You can hear the person closer to you speaking, but not the one farther