You basically want something closer to an IM UX. Delta chat does this: https://delta.chat/en/

Only issue: Delta Chat doesn't allow to change the subject, so your conversation with someone is going to be a looooong unique thread.

I am myself thinking about doing something closer to what zulip does, with subjects as "channels". Yet another side project.