My personnal reason for not moving to swift is concurrency. As long as there isn't a clear prefered model for concurrency (node-style event loop with asyncs or actors), i won't start developing on the server with this language (which is great).

Unfortunately i don't see a lot of progress being made on that front since Chris lattner wrote its concurrency manifesto.