Personal responsibility starts with the individual. The sheer arrogance of those who didn't vote and were upset with the result is astounding. Maybe they'll learn and act appropriately next time.
The assumption that you can manage to fit voting into your life comes from a place of privilege that some people lack. Punishing them harder until they behave more responsibly fixes nothing.
EDIT: It appears the UK has some problems too [1], and being Australian where voting is a legal requirement, easy to enroll and difficult to drop off the register, my perspective is perhaps a bit harsh.
[1] https://www.theguardian.com/public-leaders-network/2015/feb/...
I'm sorry to hear of your situation, but I hardly think it's relevant to the discussion.