News for hackers. Stuff that matters.
Re:ASCII is 50 years old by jokoon on Tuesday June 18, 2013 @05:50PM (#5902299)
I wish there would be other ways to encode text, even phrases.

I once put a lot of time to gather a very short list of the most used english words.

Why not encode a phrase with its grammar ?

Re:ASCII is 50 years old by AaronFriel on Tuesday June 18, 2013 @06:02PM (#5902342)
Because then you could never encode real works of literature that use esoteric or non-standard grammar. Good luck encoding Huckleberry Finn with your system.

On the other hand, encoding smaller units reliably (phonemes, graphemes, whatever is appropriate) and using compression over top of that usually gets you really close to what you wanted, but with greater expressiveness. English text compresses really fantastically well, so why overthink it?