The one thing I'd really like to see is a more stable autocomplete. Having a decently working editor should be prioritised above everything else in my opinion.
Not only autocomplete, but syntax highlighting as well.
SourceKit seems to crash with every moderately complex expression.
SourceKit crashes are caused by bugs in the Swift type checker most of the time; it's not SourceKit itself that's at fault usually. We did a lot of work to fix architectural problems in 3.1, especially with generics, and there will be more improvements in 4.0. It's definitely a priority now that the language design has settled down.
That's great to hear & thanks for doing an amazing job with Swift. The language itself is great.