IIRC the folks who tried to raise the red flag on Madoff early on was because of what you describe. The numbers just didn't follow any kind of market change often enough / have enough fluctuation to make sense at all.