The problem with trying to get rid of those "anachronistic" symbols is that when you task someone with it, they will come up with a bunch of very arbitrary symbols that are also simple permutations that are hard to distinguish.
There was an example in a previous HN thread on this topic. For "save", they had a rounded rectangle and an arrow, and then a bunch of operations had something similar, but with the orientation and details of the two elements changed.
Or, another example that made an impression on me when OS X first came out, was when the basic window controls became circular, jewel like bubbles, only distinguished by color - instead of each having a distinctive pattern/symbol.
It's so easy to fall into the trap as a designer of applying a pleasing uniformity that undermines the user experience. Imagine the nuclear power plant controls with hundreds of identical switches in rows and columns. Or an aircraft.
Nothing would mean anything without the past providing context, so complaining about anachronism is paradoxically complaining that a meaning is too well established.
The letter A is thought to come originally from a diagrammatic ox head, but should we eliminate it because we no longer use it in relation to livestock?
Just because people don't like a floppy disk icon shouldn't count for anything unless it can be demonstrated there is in fact some other symbol that is more associated with saving.