Linear regression doesn't perform when you have outliers in data. Let's understand clearly why this is so and how Robust regression overcomes this problem mathematically.