So basically gas stations are just an excuse to do other business?

Pretty much, depending on their location often people pulling in to refuel are a captive market.

And why convenience stores in Japan (and other places, I assume, though I haven't seen them) frequently sell the same kinds of merchandise as gas stations do in the US, but most don't sell gas because the margins are so small, the pedestrian market smaller, and real estate so expensive.