I used a HP ProDresk (USFF) for that. Quite small, reasonably powerful, supports 3 monitors and linux-friendly (at least the i5-9500T Version I have).

Drawback is that it doesn't really take up much less space / weight than a small laptop and you always need external monitor + keyboard, which makes it much less portable.