I picked up a Magic Leap a month or two ago with the goal of doing this. I'm building a Wayland compositor that forwards its rendered windows over to a headset, so you can have an arbitrarily large 'display'; windows can be positioned anywhere in space.

The ML1 probably isn't good enough for actual use, due to the text rendering, but I think the HL2 will be. I had the HL1 and its text rendering was plenty good, but the FOV killed it; the 2 should fix that.