I think most people just don’t realize that when you charge a battery you’re not literally just filling it up with electrons.
When you charge a battery you are pushing electrons from one chamber in the battery to another. A discharged battery is like two tanks of water at equal levels, charging is like pumping water from one to the other so one has a higher level and thus potential energy.