Damn, that is indeed possible. And I thought I understood these conceptually, now I have to read the papers again.
The paper sited has an example C program that works within a single process, but sets the stage to show how it could be achieved across process boundaries.
C program source: https://pastebin.com/9GSrXhi3
Does the instruction cache get poisoned as well on a mispredict and carried over?