People can't be expected to track and understand the hundreds or thousands of issues faced each by their representatives who are in the "business of government".
That's massively inefficient, and would result in people only voting for or against "pet issues". Extreme viewpoints on any particular topic would then "rule".