If you want a new device, these are not too expensive and well supported by Rockbox: https://www.rockbox.org/wiki/AIGOErosQK

Or get a used iPod. That's what I did.