For what it's worth, Chris Lattner specifically said in his farewell email [1] that "we don’t expect it to impact day-to-day operations in the Swift Core Team in any significant way." If you take him at his word, presumably that would mean the brain drain will be a nonevent.
[1] https://lists.swift.org/pipermail/swift-evolution/Week-of-Mo...