In the before time, deallocating memory meant pulling it out of the board.
To free up memory on our systems, we bought new system and moved the old ones into a landfill.
Permanent storage was on stone tablets, but read/write times were REALLY LONG. Backups took a really long time, too. Restoring was pretty quick, because you would just put the last-known-good tablets into the machine.