Etymologically Czech is the most conservative here. In other Slavic languages and in Proto-Slavic the original meaning was also forced/compelled labor (hence also why "rab" or "rob" means "slave" and not "worker" in most East and South Slavic languages). It just happened to evolve into a generic term meaning "labor" because the forced/compelled kind was so widespread and normalized.

Slavic languages aren't the only ones with such a trajectory for the term - the German "Arbeit" is directly related and underwent a similar process.