Visual Studio Code has a "peek" operation that does something like this. It is indeed quite handy.

https://code.visualstudio.com/docs/editor/editingevolved#_pe...