You might want to look into the area of robust statistics (e.g. https://en.wikipedia.org/wiki/Robust_statistics), if you haven't done that, yet.