The big difference as others pointed out if that regardless of how many people believe in astrology, nature will do whatever it wants.

Financial markets, to a certain extent, can be manipulated by people. If enough of them believe that when the face of Jesus appears in the chart they need to sell, the price will go down.