I always look at it like this: If I get fired, they need to hire someone, train them, and only after months they will come close to the productivity that I'm currently providing. In other words, it will cost them loads of time and money.
When I leave, I get paid >=100% at another place, from day 1 when I start.
You are in a much stronger position than you think. Of course your manager doesn't want to make this too obvious ;).
You have an easier time firing your "boss" than the other way around, don't forget that.
And in the end, the difference between freelance and employee is just a legal one.
I never understand why some people willingly put themselves as a "servant" of "the boss". It's a very limiting view on the world. Why not view it as a win-win relationship, where if either party doesn't have any benefit, you can just leave. They pay you, you do the job. They are literally buying your service. If you want to put yourself in a position where "you have to do what they tell you", that's all fine by me. But I will never put myself mentally in that position, because it really is not like that. I don't have to do anything, I'm selling my service under very strict conditions.