You're being intentionally obtuse. "Just add more epicycles!" isn't building a better model (for a sensible definition of "better"). It's just overfitting. You are the reason why regularization exists. https://en.wikipedia.org/wiki/Regularization_(mathematics)