The very small PC form factor (like a NUC or brix) requires a monitor and a keyboard. A tablet with a keyboard more closely fits the bill, but also isn't ideal. I have a tablet, but can't really develop directly on the device, as far as I know. I want a self-contained pocket sized toy for tinkering with, without need for an external build system. CHIP with the Pocket add-on fits that bill perfectly, at a great price.
If the platform itself were more hackable, I'd just go grab an old Droid or similar. I don't really need modern for this particular task (though building Android apps has only recently gotten nice on a level comparable to building for Linux). But, running an unmodified Linux is non-trivial, and running an old Android version is also challenging. But, maybe I shouldn't worry so much about it, and just pick up and old Android phone that's known to be root-able and can run CM, disable the radio, and build the stuff I want to play with for Android. Unfortunately, there aren't any competent existing music trackers written in Java that I'm aware of.