The other problem is the angle at which the light must be redirected. The Cosmic Horseshoe is composed of two systems almost directly in line, the light comes from the farther system and bends infinitesimally around the black hole to come to us. I don't know if a 180 degree bend is possible.

Also, the foreground galaxy/supermassive black hole in the Cosmic Horseshoe is 5.6 billion light years away, so any light that could come from our solar system, go around the black hole, and come back to our hypothetical hypertelescope would be over 11 billion years old - almost triple the age of our sun.

Saggitarius A* in our own galaxy is, of course, directly in the elliptic and therefore badly occluded by dust, but it would be interesting to look at as it's only 27k light years away. In the absence of that pesky dust, it would give us a picture of the solar system as of the Paleolithic. Andromeda, at 2.5 million light years away, would give us 5-million-year-old light. There are other black holes in the Milky Way on the order of a thousand light years away which are not at the center of the galaxy but have masses comparable to or slightly larger than our sun, these are far closer (within a few thousand years) but have much smaller gravitational fields. Luminous intensity drops off with the square of the distance, but I'm not sure how the gravitational field strength affects the ability of a particular galaxy to bend light.