Madoff's issue was that he stole from rich people. If he had only stolen from poor people, he probably would have been fine.