NixOS has this. Atomicity is implemented via the filesystem: the final switch between states is changing where a single symlink points from once place to another, which is an atomic operation on Linux and maybe elsewhere.

Transactional filesystems still sound cool, but Unix filesystems already have enough features to implement atomic package installation on top of them.