Of course there is! The GPD family of Windows devices (Win/Win2/Win Max and Pocket/Pocket 2/Pocket2 Max) have pretty good hardware and somewhat decent linux support (they all have official Ubuntu Mate images), and the GPD MicroPC even has quite a few ports more than a modern ultrabook (ethernet, full size usb, 3.5' jack, even a RS232!). They have price points ranging from 400$ to 1000$, so there's something for everyone as well.

Disclaimer: While I don't work for GPD I'm a very happy owner of a Win 2 that I use for light gaming and game streaming with Stadia and Geforce Now, and I've started using it for "computery tasks" more and more as I just keep that and my iPad Pro in my backpack - not that I leave the house often these days, though...

I have a Gemini PDA, and it's not bad. I could wish for an X server to run Emacs against, but it works fine in terminal mode; I could wish for a more comfortable Linux-on-metal experience, but Termux and Firefox on Android are easily good enough. The keyboard is excellent.

Too bad it came along a decade after I ceased to really need the kind of road-warrior sysadmin capability that such a device excels at providing. I'm still glad to have it.