I'm becoming a fan of the tiny black hole theory. A lot of this seems to point toward a three-way tradeoff between distance, albedo and mass to try to find a sweet spot that explains how something massive enough or close enough could have avoided observation. A small black hole at a pretty significant distance is a rather tidy answer.