My parents had a off-peak hot water system when I was growing up. The insulated tank would fill and heat up during off-peak hours (i.e. late at night), and merely keep it warm during the rest of the day.

The downside was that once the hot water was gone, we had to wait until the next day for more. The last person to shower occasionally got a cold shower.

On-demand systems win here.