Yeah, simple trust metric would be very nice here. Give more weight to people who vote like you and everything will be ranked as if you did it.