That's how I remember it too. Most local calls perhaps were included with the service, but a call to the other side of town might be considered long-distance. I do remember that the rates varied wildly. My parents would occasionally question me or my sister about a specific call on the bill that cost a lot.
I remember calling my grandparents in Arizona cost 5¢ a minute, but calling relatives in the next city over—about 10 miles away—cost something crazy like 29¢ a minute.
This was in California. I'm sure the rate structures varied from state to state.