When a leak happens, even if you can fix/replace the components mounted to the boards, when you've got multi-layer boards it gets hard to figure out how repair the damage that happened to the internal traces and such.
If possible, replacing those batteries with something less likely to juice all over is what you want to do. And since you don't really know when it will start to leak, getting those old batteries out NOW is the safest option.
OTOH, who’d imagine back then we’d still be using and cherishing these little machines?
People recommend to remove them altogether though, I guess they figure the machines will be sitting in a closet for another 15 years, best to remove the problem altogether.
This is the reason.
At the repair shop where I've worked we do recycling, and there's a lot of electronics that get destroyed by leaky batteries.
If you can do it without voiding warranty (and sometimes even if you do void the warranty), always take the batteries out of electronics when they go into storage.
This read more like "my gran says to always unplug the toaster else the house will surely burn down"