Don't feel too bad -- I strongly believe that 99.99% of the copies of TAOCP are never read beyond the first chapter.
I'd love to own them and be the kind of person to read them, but I know I would also struggle to give them the proper attention (not with the hundred other books to read on my shelf).