Shell access by default. A complete unix toolset. Some type of init system I can hook into to run daemons.

Logically separated layers. Not "you don't like the display server... well you have to re-implement everything from scratch yourself". You know, normal computer things.