I agree that sentences in the US are across the board too long but am not sure what that has to do with compelled decryption of hard drives.

The court system didn't make sentences too long. They were dragged there, kicking and screaming, by a polity that overwhelmingly demanded tough-on-crime statutes and tough-on-crime prosecutors, and passed laws to ensure that the courts complied.