This is indeed annoying; fortunately David Herrmann is working on a new user-space terminal emulator for Linux called KMSCON which uses the same keyboard input code as XOrg (libxkbcommon) so there is hope for improvement.
https://dvdhrm.wordpress.com/2012/12/10/kmscon-introduction/