If you don't open any port on your phone to the public internet, I guess it's fine for this use case? Most (if not all) home routers have firewall enabled by default. So your home devices are protected from inbound connections.