The biggest barrier today would be that most people stream their music. So the new iPod would need 5G, which means increased price, carrier contracts etc. At that point it is close enough to a phone that it doesn't make sense as a standalone device.

And also, for people who really want to get away from their phone the Apple Watch is already a standalone music player.