Garage Band or Audacity and a USB mic (generally better sound + less background noise for non-audiophiles). You can upgrade later if/when you care to.

You don't need to take that advice commenter dontbenebby gave, unless you want to get discouraged and quit.

PS: Reaper is good, too, but has more of a learning curve.