To answer the question, move to the extended real numbers as in, say, H. Royden, Real Analysis.

In short, the extensions work and at times are convenient but work less well than the rules of the real numbers; the extensions are a bit tricky and have to be careful.