TabPFN vs XGBoost in 2026: 1673 against 1375 Elo, and where trees still win
Gradient-boosted trees stopped setting the accuracy frontier on tabular data in 2026. But the benchmark that shows it also shows why XGBoost and LightGBM still belong in production, and the answer is not the one most