Modding old iPods to have them run flash memory and decent batteries is pretty common, you could look into that. I'm still using my 17 years old iPod 5G like this. Flashed with Rockbox it reads every file format (mostly FLAC) I could ever want.