This is patently untrue. Political progress inherently involves the combined minor effort of numerous people. Campaign volunteers regularly do everything from making a few cold-calls every night to fixing bugs in the web apps that are used to manage the campaign.
You're right that getting things started is non-trivial, but as other commenters have pointed out there are a fair number of organizations already driving for change who would appreciate "a few minutes or hours every once in a while". Here are a few:
http://1984day.com/ https://www.eff.org/ http://www.restorethefourth.net/
Please add more if you know any!