Unfortunately looking isn't all that's going on. The advertiser can collect data about web browsing habits which I like to keep private. And some ads can actually hurt you: http://www.cnn.com/2014/01/05/tech/yahoo-malware-attack/

Getting served data from someone you didn't choose to send you data is never a good thing.