In a free market where remote jobs are more desirable than in-office jobs, then eventually, the in-office jobs have to start paying a premium in salary to attract those who would rather want a remote job instead. It isn't "how much is your labor worth?" but rather "how much more do we have to pay someone to come into the office everyday?"

Of course, given your preferences, it doesn't sound like they would have to pay you more to come in the office vs. working at home as long as they pay you what you think you are worth. That is, whether the job is remote or not doesn't affect your pay requirements. If enough people feel the same, then there won't be a pay discrepancy between remote and in-office jobs.