Really glad to see someone using Hypervisor.framework, looks like it has a lot of potential. Fusion/Parallels always seem far too heavyweight to me.
Google Chrome, similarly, tends to drain my battery a lot, and that alone has encouraged me to go to Safari on Macs.
I can see the graphics switch happen with gfxCardStatus notifying me. The process occupying the GPU is from Fusion plain as day (I think it's vpx agent?). This happens with nothing else running. This switching is one of the known quirks with OS X after years and years now.
Also, older versions of Fusion may have been less careful about avoiding graphics modes that potentially cause graphics acceleration to kick in and maybe more recent versions than mine do better (still on 6 because I'm a cheapskate).