Here's how I've always understood it. People used to make sacrifices to compensate for their sins. The merchants at the temple were selling offerings to be sacrificed, which was problematic for a couple of reasons. They were profiting off of the guilt and shame of others, they created a system that implied you could straightforwardly pay for the right to sin, and they made a mockery of the system of sacrifice for sin in the first place.