It sounds like your spending a lot of effort on estimating. I'd guess (I'm not there so probably incorrectly :-) that you've got some combination of:

a) stories being too big

b) stories having to much variation in size

c) doing time based estimation rather that relative estimates or story counting.