I have done the same with my side projects and I have two kids plus a full time job.

I even built a tool that let me add contextual notes or todos to my files, folders, applications, open documents and websites for the next time I picked it up (I am not a developer but a designer) and turned that into a pretty successful notes app.

Now my even bigger project which require me to split things into even smaller buckets is easy to always know where I left it off without having to find the notes again as they are always right there.