It's not a closed system internally. Theorizing about the open circuit voltage is legitimate for an ideal voltage source but entirely useless since it is completely isolated. It is indeed a confusing abstraction, I have to concure.