With the shipping software the pogoplugs are usually useless secondhand, as the web interface is hidden if you haven't registered the device with the company (and it can't be de-authed without the original owner's credentials). But the administrative interface is still available, if you know the path. Dropbear is already installed, so you can just start it, log in, overwrite the bootloader[0] and run one of several Linux distributions from a flash drive (I use Debian[1]).
My unit[2] has a 700 MHz dual-ARMv6. It only has 256MB of built-in RAM, but it's simple to allocate 1GB of the OS flash drive as swap.
Last year I picked up a number of old MIDI keyboards a local college was throwing out. I figured they were just old and the college had replaced them with something newer, but they worked fine for me under Linux. So I offered one of them to my brother, and he couldn't get it to work under Windows. Of course, it turns out the device is 15 years old and never had a 64-bit driver. So I've been experimenting with using the Python midistream package to stream MIDI over ethernet to a Windows host. Unfortunately, the package (since subsumed by a project called scenic[3]) hasn't had a new release since 2012. But it still works, and it makes for a pretty fun hack.
[0] http://projects.doozan.com/uboot/
It's dirt cheap ($10-20), easy to load linux on [1], and it can be a simple file server, it can run minidlna, google cloud print [2], all kinds of stuff.
800MHz is not a screamer, but most simple I/O tasks like A/V streaming and printing are a walk in the park.
[1] http://archlinuxarm.org/platforms/armv5/pogoplug-series-4
[2] http://geekvisit.com/hacking-pogoplug-mobile-adding-airprint...