You might have clicked a notification on either device on accidently and set it the wrong direction.

When you first connect, the power capabilities are negotiated and usually the more powerful device takes on the "source" role while the other gets to be the "sink".

This can be dynamically controlled and switched back and forth so some devices have UI to select what to do.