The trick is that you don't actually have to do all the tasks you write down. It is still nice to have a record of what you've planned so if you ever decide to jump back on any task you have a history of what you have done and any context associated with it on hand.

A lot of my todos are something like "I found this article interesting but I don't have the current skills to really understand everything in it" or "I want to add this feature to X but I think I will wait until the new version comes out because it will be easier then" or "I want to remember this when I finally decide to do Y".