Yes in the general case. But in the case of a backup that's done daily the sender can say... there are all the files that changed since we last did this.
Rsync is designed for the general case. It's useful for backups, but not designed for them.
And the file can change on the server just as easily as the client. So how can it tell this without sending the complete list?