It depends what you need to build. You can still completely build a website with only a text editor and a basic web server host. Cheap and simple, if you're willing to learn html and/or css.

If you want to build Facebook, that's another kettle of fish.