Well, yeah, it is weird at first. But once you think about it, it is not unintuitive: if the light was just gone, that would be wrong, too, right? Also, energy == mass, so of course, it is equivalent to throw mass into a black hole or energy. The longer I think about it, the more it is mass that is the weird thing. What is mass? Something like frozen energy...