For some reason, I like this. However, I think that a voting system that 95% of the population can't even understand won't be very popular overall...
Of all the voting systems that will never see the light of day, I think I like this one most of all. However I would say despite its similarity to the status quo it would completely change the nature of government when parties couldn't count on who would get elected despite the safeness of their constituency.
It's definitely crazy, I have a feeling it might work though, eventually as a voter I'd simply vote for whoever in my area promised some kind of sane approach to making decisions.