I'd say an external GPU introduces pretty significant upgrade potential.
Non-soldered RAM is a good start, but what about multiple ethernet ports, what about any standard scientific/medical/experimental PCI card, what about the new SSD/HDs that come out in 3 years? What about upgrading the CPU? What about upgrading the screen! Much less using Apple's "most powerful computer" headless?