Utilitarianism doesn't actually give you an objective measure. It just shifts the subjectivity towards the definition of terms such as "harm" and "benefit". In case of immigration, this is very prominent: e.g. is cultural diversity beneficial or harmful?