I'm not sure what institutional reason leads Bart to continue expanding outward, rather than running new tunnels in SF proper, but it doesn't seem to be cost-effectiveness driving them to do it.
Interestingly, Seattle made a special institutional provision to ensure this doesn't occur there - they have a system of "sub-area equity", whereby the tax revenues for each of several regions must be spent within that region. So, for example, political power in the suburbs or a desire to expand the agency's tax base doesn't drive them to unfairly allocate transit where it's relatively unneeded, and they can get their second central tunnel whenever the tax revenues for the core call for it.