Some will even consider it fun to be tipped for first time in their life, others will find it offensive and will think that you are looking down to them. But, in any case, tipping is a faux pas in Japan.
"Do as the Romans do" is always the correct behavior, but in this case the potential for offense is entirely overblown.
I can tell you that most Japanese I know hate the concept of tipping and it makes them uncomfortable. They also hate giving tips. Not because of the money, but because they think that tipping is a way of looking down the other person.
Of course, when I say offensive I don't mean that they will curse and hate you forever. But probably some will think: "I already have a salary, I don't need you give me your coins".
If there's an scale of socially awkward situations, I guess tipping would be slightly under asking ketchup for your sashimi. But definitely not as bad as going into someone's house with your shoes on.
To seriously offend some Japanese people you'll have to do something crazy like stick your chopsticks straight up in your rice bowl. Then you'll see them really wince ;-)