As most on this site can probably attest to, one of the biggest issues with part-time/hobby/side projects is motivation and discipline. That problem seems to be already partially solved by the freedom to pick an area of mathematics one is already interested in.
Not having enough time to devote to a problem part-time doesn't seem like a large problem if somebody wants to work on problems of their own choosing as per the OP. Thus, my confusion.
I can definitely see that collaboration is a tougher nut to crack unless most participation starts shifting to evening group meetings.