I've installed browser extensions to turn off karma/points on as many sites as I can find. For me this has worked well.

I still kid my wife about "internet points" when I take a photo for Google Maps and the like, and I totally empathise with you on the feeling of seeing that number, but for my own peace of mind I've had to restrict myself from it.