That does seem like the intuition you would like to capture by talking about integers as a group, maybe?

Kind of like how if you talk about points as elements of a vector space, it's useful to think of them as translations from the origin...