The difficulty is necessary for moderating consensus given more 'voters' (with their flops) joining the network.

I'm interested by your idea, but you would need to work by a different consensus model. Proof-of-stake would be interesting to investigate, since mining doesn't scale with computation power, rather holding of the currency.