I'd bet good money that well crafted XGBoost models will outperform GPT-4 on almost any classification problem that uses numerical or tabular data. Which, historically, is what most classification problems use.