https://en.wikipedia.org/wiki/Rio_Karma
After my Rio broken (failed HD, and a terrible pain in the butt to take apart, and beyond my skills to put back together...) I got an iAudio X5 L and stuck Rockbox on it. After a few years, I upgraded the HDD to a CF-Card using a CF-to-miniIDE adaptor. I loved the battery life on that thing.
https://en.wikipedia.org/wiki/IAUDIO#iAUDIO_X5
But, sadly, now I just use a phone for everything.
I am very happy though that I can at least have foobar2000 on my phone. But, I really miss the well thought-out tactile UI of my previous dedicated players.
It sucks that we don't have a universal battery standard for lithium yet though. Seems like at the very least, the OSHW community should have one.
We could have separate charge and discharge pins, and I2C data, so everything stays chemistry-agnostic, and you could parallel two batteries just with diodes on the discharge pins.
You could have all the connections on one side, and only have one width, just different lengths, so the small ones fit anything with just a a spacer block.
Or you could even specify an integrated screw hole.
In some ways, I think it's a shame we didn't go to consumer goods run on Lithium batteries but in this form factor, with discrete charge management cards. So for instance, replacing the batteries in a Thinkpad could have been commoditised.
Bagged cells are damn good for small devices, but they do make it harder.
My Minidisc players were equally 'my battery, my form factor' as are most digital cameras. I guess some people (Dyson) cannot go past the opportunity to make accessories and replacements bound in them, at their price. After sales income is big.