Hello World is mostly the most primitive program you can write in order to check whether your compiler/interpreter is working properly, so you can get started.

In case of LYAH (or Haskell in general) you have GHCi at hand, an interactive interpreter. That's what LYAH sets up in the very first chapter, and uses throughout the rest of the book.