Using Swift for sometime here. The language itself is great and I find myself generally more productive.
The annoyances are not with the language, but with the tooling. Slow auto-complete and lack of incremental compilation are my wishes for Apple to fix soon.