TF does have stuff which is still lacking in pytorch: for example complex numbers support, better sparse matrix support. The new distributed api is much more functional than pytorch one, allowing different levels of control, and not only high level. Surely there are more examples outside of my usecases. So yeah, pytorch is default, but if I need feature which is lacking there, I switch back to tf