Sansa clip (a successful player for those of us who want really small devices to play music on the go, before it I still had a usb-stick/mp3 player combo) had ogg out of the box.