I heard "deserve neither and will lose both", which has better meter. No idea which is more accurate.

I _generally_ agree with the sentiment, but Franklin's neighbours didn't have amplified music.