This was indeed the case as early as the N64 - the technique was referred to as High Level Emulation (HLE).

http://en.wikipedia.org/wiki/UltraHLE