I don't think it's as much of a band-aid as it first appears since this roughly mimics how a human would do it.
The problem is that humans have continuous information retrieval and storage where the current crop of embedding systems are static and mostly one shot.