That's because that _is_ the word (大腿) for thigh — native speakers don't perceive it as "big leg", which would be 大的腿 instead.

This is exactly analogous to "little finger" in English.