This reminds me of this idea that someone had a while back to record every moment of your life with a GoPro-like camera, and then use AI to catalog the salient parts for later reference. The problem was, predictably, that the signal-to-noise ratio was far too low. There was just far too much video to review to find the really interesting things, and so they gave up on it after a year or so working on it.

This is also the primary reason why I've given up on all these note taking apps. Once you get too much data in them, they just become totally unmanageable.

There's a real problem here to be solved, but I just don't see how you make tangible progress on this one without having something much closer to strong AI.