You would still be holding eye contact (mostly) with the speaker. If the text were above or below, you would see to be looking off into space, which may be worse from the speaker's perspective.