When infinity is the relevant concept, use it.
The difference between "bounded" and "infinite" is the difference between "measure" and "cardinality". That is , "bounded" refers to a notion of distance, while "finite" refers to a measure of count. There are bounded infinities (such as the set of all rational or numbers between 0 and 1), but there are no unbounded finities.
A container that contains finite objects of all sizes must be an infinite/unbounded container.
Also, by "we", I should clarify I mean discrete mathematicians and computer scientists, who are usually dealing in the discrete case. In the continuous case, infinities come up "for real" more often.
http://en.wikipedia.org/wiki/Compact_space
*Infnite cardinality of points, not infinite in measure.
I think there's a huge difference between simply saying "unbounded" compared to going through that detailed explanation you just gave. In the latter case, it's very clear what the difference is. But without the explanation I'd guess that people will think something like this:
In other words, without the explanation "unbounded" becomes a synonym for "infinite".