"Understanding the Linux Kernel" from o'reilly goes into a surprising amount of detail not only from the OS's point of view, but also the architecture it's running on and the memory management unit. It's approachable and is not light on detail.

edit: email me if you have any specific questions.