You will for sure, I actually like it but not everyone does. You can remineralize and change the taste without too much trouble. I would avoid any other claims made for that process but it does usually improve the taste. Straight RO water is not great for coffee or tea as well.

Where does the average person find RO water?

Go to your local aquarium/tropical fish dealer and ask. They'll be able to list pretty much all the providers within a reasonable driving range.

Also lots of cities/towns have RO water providers that will sell anywhere from single gallons to thousands.

source: used to be a marine aquarium hobbyist and bought thousands of gallons of RO water to make seawater.

Some grocery stores and walmart's have RO water machines outside their stores also. However, if you choose to use those it would be good to invest in a tester as they do not always change the filters on schedule.

Any drug store will have distilled water

I use RO with a mineralization filter stage and absolutely love the taste of the water. I'm using the 7-stage RO system by iSpring.

And for an extremely cool experience, try black water: http://getblk.com/

For varying definitions of extremely

Sounds like swamp water ;)

It actually tastes like......bottled water.