Interesting question... this is one I have thought on and off, and I have a hodge-podge of paper reports and scans, with evernote- to maintain the digital notes, and google drive for the scans.

--

One could customize an open source CRM for this?